Spark and Data Lakes
|
Learn how to process big data using Apache Spark and manage data lakes.
In this course, you will learn about the big data ecosystem and how to use Spark to work with massive datasets. You’ll also learn about how to store big data in a data lake and query it with Spark.
User Reviews
Be the first to review “Spark and Data Lakes”
Related Products
Data Engineering with Microsoft Azure
Explore data engineering concepts on Microsoft Azure’s cloud platform.
Automate Data Pipelines
Learn techniques for automating data pipelines for faster data processing.
Perform data analysis with Azure Databricks
Learn how to perform data analysis using Azure Databricks. Explore various data ingestion methods and how to integrate data from sources like Azure Data Lake and Azure SQL Database. This module guides you through using collaborative notebooks to perform exploratory data analysis (EDA), so you can visualize, manipulate, and examine data to uncover patterns, anomalies, and correlations.
Use Delta Lake in Azure Synapse Analytics
Delta Lake is an open source relational storage area for Spark that you can use to implement a data lakehouse architecture in Azure Synapse Analytics.
Organizational Privacy Engineering
Explore organizational approaches to designing privacy-aware systems and frameworks for data governance.
Transfer and transform data with Azure Synapse Analytics pipelines
Azure Synapse Analytics enables data integration through the use of pipelines, which you can use to automate and orchestrate data transfer and transformation activities.
There are no reviews yet.