IBM: Big Data, Hadoop, and Spark Basics
|
This course provides foundational big data practitioner knowledge and analytical skills using popular big data tools, including Hadoop and Spark. Learn and practice your big data skills hands-on.
About this course
Organizations need skilled, forward-thinking Big Data practitioners who can apply their business and technical skills to unstructured data such as tweets, posts, pictures, audio files, videos, sensor data, and satellite imagery, and more, to identify behaviors and preferences of prospects, clients, competitors, and others. ****
This course introduces you to Big Data concepts and practices. You will understand the characteristics, features, benefits, limitations of Big Data and explore some of the Big Data processing tools. You’ll explore how Hadoop, Hive, and Spark can help organizations overcome Big Data challenges and reap the rewards of its acquisition.
Hadoop, an open-source framework, enables distributed processing of large data sets across clusters of computers using simple programming models. Each computer, or node, offers local computation and storage, allowing datasets to be processed faster and more efficiently. Hive, a data warehouse software, provides an SQL-like interface to efficiently query and manipulate large data sets in various databases and file systems that integrate with Hadoop.
Open-source Apache Spark is a processing engine built around speed, ease of use, and analytics that provides users with newer ways to store and use big data.
You will discover how to leverage Spark to deliver reliable insights. The course provides an overview of the platform, going into the different components that make up Apache Spark. In this course, you will also learn how Resilient Distributed Datasets, known as RDDs, enable parallel processing across the nodes of a Spark cluster.
You’ll gain practical skills when you learn how to analyze data in Spark using PySpark and Spark SQL and how to create a streaming analytics application using Spark Streaming, and more.
At a Glance:
Institution: IBM
Subject: Computer Science
Level: Introductory
Prerequisites:
Computer and IT literacy. Curiosity about how data is managed.
Associated programs:
Professional Certificate in NoSQL, Big Data and Spark Fundamentals
Professional Certificate in Data Engineering
Language: English
Video Transcript: English
Associated skills:Satellite Imagery, Pyspark, File Systems, Resilience, Nodes (Networking), Data Warehousing, Apache Spark, SQL (Programming Language), Apache Hive, Big Data, Unstructured Data, Apache Hadoop, Parallel Processing, Analytical Skills, Spark Streaming
User Reviews
Be the first to review “IBM: Big Data, Hadoop, and Spark Basics”
Related Products
TokyoTechX: Introduction to Computer Science and Programming
The term “Computation” refers to the action performed by a computer. A computation can be a basic operation and it can also be a sophisticated computer simulation requiring a large amount of data and substantial resources. This course aims at introducing learners with no prior knowledge to the basic key concepts of computer science. By following the lectures and exercises of this course, you will gain an understanding of algorithms by programming using the language Ruby.
Data Science in Production: Building Scalable Model Pipelines
Learn how to build scalable model pipelines for data science in production environments, focusing on best practices for deployment and management.
Mastering Big Data with Apache Spark and Java
Explore big data processing techniques using Apache Spark and Java, focusing on data analysis, manipulation, and real-time data processing.
An Introduction to Spark
An introductory course for getting familiar with Spark and learning the basics of manipulating data using Spark.
The No Nonsense Introduction To Big Data, Hadoop and Streaming
A straightforward introduction to big data, Hadoop, and streaming technologies, focusing on fundamental concepts and practical applications.
EdinburghX: Data Ethics, AI and Responsible Innovation
Our future is here and it relies on data. Medical robots, smart homes and cities, predictive policing, artificial intelligences – all are fuelled by data and all promise new benefits to society. But will these innovations benefit everyone? Who stands to gain and who is put at risk? How can we ensure that data is part of a just and sustainable world?
There are no reviews yet.