Hadoop and Spark for Administrators Treningskurs

Last updated

Kurskode

hadoopsparkforadmin

Varighet

35 timer (vanligvis 5 dag inkludert pauser)

Krav

  • System administration experience
  • Experience with Linux command line
  • An understanding of big data concepts

Audience

  • System administrators
  • DBAs

Oversikt

Apache Hadoop er et populært databehandlingsramme for å behandle store datasett over mange datamaskiner.

Denne instruktørledede, live-trening (online eller on-site) er rettet mot systemadministratorer som ønsker å lære hvordan å sette opp, implementere og administrere Hadoop kluster innenfor organisasjonen sin.

Ved slutten av denne treningen vil deltakerne være i stand til å:

    Installere og konfigurere Apache Hadoop. Forstå de fire hovedkomponentene i Hadoop økosystemet: HDFS, MapReduce, YARN og Hadoop Common. Bruk Hadoop Distributed File System (HDFS) for å skala en kluster til hundrevis eller tusenvis av noder.   Installer HDFS for å fungere som lagringsmotor for on-premise Spark deployments. Sett opp Spark for å få tilgang til alternative lagringsløsninger som Amazon S3 og NoSQL databasesystemer som Redis, Elasticsearch, Couchbase, Aerospike, etc. Utføre administrative oppgaver som å gi, administrere, overvåke og sikre en Apache Hadoop kluster.

Format av kurset

    Interaktiv forelesning og diskusjon. Mange øvelser og praksis. Hands-on implementering i et live-lab miljø.

Kurs tilpassingsalternativer

    For å be om en tilpasset opplæring for dette kurset, vennligst kontakt oss for å arrangere.

Machine Translated

Kursplan

Introduction

  • Introduction to Cloud Computing and Big Data solutions
  • Overview of Apache Hadoop Features and Architecture

Setting up Hadoop

  • Planning a Hadoop cluster (on-premise, cloud, etc.)
  • Selecting the OS and Hadoop distribution
  • Provisioning resources (hardware, network, etc.)
  • Downloading and installing the software
  • Sizing the cluster for flexibility

Working with HDFS

  • Understanding the Hadoop Distributed File System (HDFS)
  • Overview of HDFS Command Reference
  • Accessing HDFS
  • Performing Basic File Operations on HDFS
  • Using S3 as a complement to HDFS

Overview of the MapReduce

  • Understanding Data Flow in the MapReduce Framework
  • Map, Shuffle, Sort and Reduce
  • Demo: Computing Top Salaries

Working with YARN

  • Understanding resource management in Hadoop
  • Working with ResourceManager, NodeManager, Application Master
  • Scheduling jobs under YARN
  • Scheduling for large numbers of nodes and clusters
  • Demo: Job scheduling

Integrating Hadoop with Spark

  • Setting up storage for Spark (HDFS, Amazon, S3, NoSQL, etc.)
  • Understanding Resilient Distributed Datasets (RDDs)
  • Creating an RDD
  • Implementing RDD Transformations
  • Demo: Implementing a Text Search Program for Movie Titles

Managing a Hadoop Cluster

  • Monitoring Hadoop
  • Securing a Hadoop cluster
  • Adding and removing nodes
  • Running a performance benchmark
  • Tuning a Hadoop cluster to optimizing performance
  • Backup, recovery and business continuity planning
  • Ensuring high availability (HA)

Upgrading and Migrating a Hadoop Cluster

  • Assessing workload requirements
  • Upgrading Hadoop
  • Moving from on-premise to cloud and vice-versa
  • Recovering from failures

Troubleshooting

Summary and Conclusion

Testimonials

★★★★★
★★★★★

Related Categories

Relaterte kurs

Kursrabatter

Kursrabatter Nyhetsbrev

We respect the privacy of your email address. We will not pass on or sell your address to others.
You can always change your preferences or unsubscribe completely.

Some of our clients

is growing fast!

We are looking to expand our presence in Norway!

As a Business Development Manager you will:

  • expand business in Norway
  • recruit local talent (sales, agents, trainers, consultants)
  • recruit local trainers and consultants

We offer:

  • Artificial Intelligence and Big Data systems to support your local operation
  • high-tech automation
  • continuously upgraded course catalogue and content
  • good fun in international team

If you are interested in running a high-tech, high-quality training and consulting business.

Apply now!

This site in other countries/regions