Enforcing Data Contracts with Kafka Schema Registry
|
Schema Registry is the easiest solution to introduce data governance to your Kafka topics. This course will teach you how Schema Registry can be used to enforce and manage data contracts in your Apache Kafka-powered system.
In a world of data, governance can become chaotic very quickly. In this course, Enforcing Data Contracts with Kafka Schema Registry, you’ll learn to enforce and manage data contracts in your Apache Kafka-powered system. First, you’ll explore how the serialization process takes place and why AVRO makes such a great option. Next, you’ll discover how to manage data contracts using Schema Registry. Finally, you’ll learn how to use other serialization formats while using Apache Kafka. When you’re finished with this course, you’ll have the skills and knowledge of data governance with Schema Registry needed to enforce and manage data contracts in your Apache Kafka setup.
Author Name: Bogdan Sucaciu
Author Description:
Software Engineer by day, Pluralsight author by night, Bogdan likes to experiment with cutting-edge technologies and teach about them. His favorite talking subjects are streaming data, event-driven architectures, distributed systems, and cloud technologies. He has several years of experience “cooking” software with JVM based languages, some flavors of web technologies, and garnishing with automated testing. He holds a BS in Robotics where he spent countless hours programming microcontrollers an… more
Table of Contents
- Course Overview
1min - Serializing Data in Messaging Systems
25mins - Exploring AVRO
26mins - Managing Schemas
31mins - Handling Schema Evolution
38mins - Using Other Serialization Formats
26mins
User Reviews
Be the first to review “Enforcing Data Contracts with Kafka Schema Registry”
Related Products
Transform data with Spark in Azure Synapse Analytics
Data engineers commonly need to transform large volumes of data. Apache Spark pools in Azure Synapse Analytics provide a distributed processing platform that they can use to accomplish this goal.
Use Azure Synapse serverless SQL pools to transform data in a data lake
By using a serverless SQL pool in Azure Synapse Analytics, you can use the ubiquitous SQL language to transform data in files in a data lake.
Organizational Privacy Engineering
Explore organizational approaches to designing privacy-aware systems and frameworks for data governance.
Data lakes and Lakehouses with Spark and Azure Databricks
Learn to manage and process data using Spark and Azure Databricks platforms.
Get started with data engineering on Azure
In most organizations, a data engineer is the primary role responsible for integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions. An Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints.
Data Ingestion with Kafka and Kafka Streaming
Learn how to build real-time data ingestion pipelines using Apache Kafka.
There are no reviews yet.