Big Data Fundamentals with PySpark
|
Learn the fundamentals of working with big data with PySpark.
There’s been a lot of buzz about Big Data over the past few years, and it’s finally become mainstream for many companies. But what is this Big Data? This course covers the fundamentals of Big Data via PySpark. Spark is a “lightning fast cluster computing” framework for Big Data. It provides a general data processing platform engine and lets you run programs up to 100x faster in memory, or 10x faster on disk, than Hadoop. You’ll use PySpark, a Python package for Spark programming and its powerful, higher-level libraries such as SparkSQL, MLlib (for machine learning), etc. You will explore the works of William Shakespeare, analyze Fifa 2018 data and perform clustering on genomic datasets. At the end of this course, you will have gained an in-depth understanding of PySpark and its application to general Big Data analysis.
1 review for Big Data Fundamentals with PySpark
Add a review
Related Products
An Introduction to Apache Airflow
Learn the basics of Apache Airflow for workflow management, focusing on scheduling, monitoring, and orchestrating data pipelines.
Deploying a Hadoop Cluster
Gain practical knowledge on how to deploy and manage a Hadoop cluster for big data processing.
EdinburghX: Data Ethics, AI and Responsible Innovation
Our future is here and it relies on data. Medical robots, smart homes and cities, predictive policing, artificial intelligences – all are fuelled by data and all promise new benefits to society. But will these innovations benefit everyone? Who stands to gain and who is put at risk? How can we ensure that data is part of a just and sustainable world?
AdelaideX: Big Data Fundamentals
Learn how big data is driving organisational change and essential analytical tools and techniques, including data mining and PageRank algorithms.
Building Scalable Data Pipelines with Kafka
This course brings any Big Data newbie up to speed on one of the most widely used open-source platform to build data pipelines - Apache Kafka.
Spark
Gain expertise in using Apache Spark for large-scale data processing and analytics.
Jeff –
Course fundamentals of big data are all provided here in this so no need to roam around