Perform advanced streaming data transformations with Apache Spark and Kafka in Azure HDInsight
|
In this module, you learn how to create real-time streaming data analytics pipelines and applications on the cloud by using Azure HDInsight with Apache Kafka and Apache Spark.
When to use Apache Spark and Kafka with HDInsight., Spark Structured Streaming., The architecture of a Kafka and Spark solution., How to provision HDInsight, create a Kafka producer, and stream Kafka data to a Jupyter notebook., How to replicate data to a secondary cluster.
Prerequisites
The following prerequisite should be completed:
Successfully log in to the Azure portal.
Understand the Azure storage options.
Understand the Azure compute options.
Create and configure a HDInsight Cluster in the Azure portal.
User Reviews
Be the first to review “Perform advanced streaming data transformations with Apache Spark and Kafka in Azure HDInsight”
Related Products
Designing Data Systems
Master the principles of designing data systems that handle large-scale data efficiently.
Explore fundamentals of large-scale analytics
Organizations use analytics platforms to build large scale data analytics solutions that generate insights and drive success. Microsoft provides multiple technologies that you can combine to build a large scale data analytics solution.
Introduction to Azure Data Lake Storage Gen2
Data lakes are a core element of data analytics architectures. Azure Data Lake Storage Gen2 provides a scalable, secure, cloud-based solution for data lake storage.
There are no reviews yet.