Hadoop 101
|
Learn the basics of Hadoop, the powerful open-source framework for storing and processing large datasets. Understand its architecture and core components.
At a Glance
This beginner Apache Hadoop course introduces you to Big Data concepts, and teaches you how to perform distributed processing of large data sets with Hadoop.
About This Course
Learn the basics of
- Learn about Hadoop’s architecture and core components, such as MapReduce and the Hadoop Distributed File System (HDFS).
- Learn how to add and remove nodes from Hadoop clusters, how to check available disk space on each node, and how to modify configuration parameters.
- Learn about other Apache projects that are part of the Hadoop ecosystem, including Pig, Hive, HBase, ZooKeeper, Oozie, Sqoop, Flume, among others. BDUprovides separate courses on these other projects, but we recommend you start here.
Course Syllabus
-
Module 1 – Introduction to Hadoop
- Understand what Hadoop is
- Understand what Big Data is
- Learn about other open source software related to Hadoop
- Understand how Big Data solutions can work on the Cloud
-
Module 2 – Hadoop Architecture
- Understand the main Hadoop components
- Learn how HDFS works
- List data access patterns for which HDFS is designed
- Describe how data is stored in an HDFS cluster
-
Module 3 – Hadoop Administration
- Add and remove nodes from a cluster
- Verify the health of a clusterStart and stop a clusters components
- Modify Hadoop configuration parameters
- Setup a rack topology
-
Module 4 – Hadoop Components
- Describe the MapReduce philosophy
- Explain how Pig and Hive can be used in a Hadoop environment
- Describe how Flume and Sqoop can be used to move data into Hadoop
- Describe how Oozie is used to schedule and control Hadoop job execution
General Information
- This course is self-paced.
- It can be taken at any time.
- It can be audited as many times as you wish.
Recommended skills prior to taking this course
- Knowledge about Big Data concepts
Requirements
- None
Course Staff
Warren Pettit Warren has been with IBM for over 30 years. For the last 16 years, he has worked in Information Management education where he has been both an instructor and a course developer in the Data Warehouse and Big Data curriculums. For the nine years prior to his joining IBM, he was an application programmer and was responsible for developing a training program for newly hired programmers.
Asma Desai
Daniel Tran
Leons Petrazickis
User Reviews
Be the first to review “Hadoop 101”
Related Products
Big Data Systems
Learn about the architecture and management of big data systems.
Big Data Fundamentals with PySpark
Learn the fundamentals of working with big data with PySpark.
Mastering Big Data with Apache Spark and Java
Explore big data processing techniques using Apache Spark and Java, focusing on data analysis, manipulation, and real-time data processing.
EdinburghX: Data Ethics, AI and Responsible Innovation
Our future is here and it relies on data. Medical robots, smart homes and cities, predictive policing, artificial intelligences – all are fuelled by data and all promise new benefits to society. But will these innovations benefit everyone? Who stands to gain and who is put at risk? How can we ensure that data is part of a just and sustainable world?
IBM: Apache Spark for Data Engineering and Machine Learning
This short course introduces you to the fundamentals of Data Engineering and Machine Learning with Apache Spark, including Spark Structured Streaming, ETL for Machine Learning (ML) Pipelines, and Spark ML. By the end of the course, you will have hands-on experience applying Spark skills to ETL and ML workflows.
HKUSTx: Foundations of Data Analytics
Learn the fundamental techniques for data analytics and to be prepared for learning and applying more advanced big data technologies.
There are no reviews yet.