Enforcing Data Contracts with Kafka Schema Registry
|
Schema Registry is the easiest solution to introduce data governance to your Kafka topics. This course will teach you how Schema Registry can be used to enforce and manage data contracts in your Apache Kafka-powered system.
In a world of data, governance can become chaotic very quickly. In this course, Enforcing Data Contracts with Kafka Schema Registry, you’ll learn to enforce and manage data contracts in your Apache Kafka-powered system. First, you’ll explore how the serialization process takes place and why AVRO makes such a great option. Next, you’ll discover how to manage data contracts using Schema Registry. Finally, you’ll learn how to use other serialization formats while using Apache Kafka. When you’re finished with this course, you’ll have the skills and knowledge of data governance with Schema Registry needed to enforce and manage data contracts in your Apache Kafka setup.
Author Name: Bogdan Sucaciu
Author Description:
Software Engineer by day, Pluralsight author by night, Bogdan likes to experiment with cutting-edge technologies and teach about them. His favorite talking subjects are streaming data, event-driven architectures, distributed systems, and cloud technologies. He has several years of experience “cooking” software with JVM based languages, some flavors of web technologies, and garnishing with automated testing. He holds a BS in Robotics where he spent countless hours programming microcontrollers an… more
Table of Contents
- Course Overview
1min - Serializing Data in Messaging Systems
25mins - Exploring AVRO
26mins - Managing Schemas
31mins - Handling Schema Evolution
38mins - Using Other Serialization Formats
26mins
User Reviews
Be the first to review “Enforcing Data Contracts with Kafka Schema Registry”
Related Products
Get started with data engineering on Azure
In most organizations, a data engineer is the primary role responsible for integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions. An Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints.
Explore fundamentals of large-scale analytics
Organizations use analytics platforms to build large scale data analytics solutions that generate insights and drive success. Microsoft provides multiple technologies that you can combine to build a large scale data analytics solution.
Data Engineering
Learn how to build, optimize, and maintain data pipelines for data processing and storage.
Transform data with Spark in Azure Synapse Analytics
Data engineers commonly need to transform large volumes of data. Apache Spark pools in Azure Synapse Analytics provide a distributed processing platform that they can use to accomplish this goal.
Transfer and transform data with Azure Synapse Analytics pipelines
Azure Synapse Analytics enables data integration through the use of pipelines, which you can use to automate and orchestrate data transfer and transformation activities.
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
There are no reviews yet.