As data warehousing and analytics become more and more integrated into the business models of companies, the need for real-time analytics and data processing has grown. Stream processing has quickly gone from being nice-to-have to must-have. In this course, Architecting Stream Processing Solutions Using Google Cloud Pub/Sub, you will gain the ability to ingest and process streaming data on the Google Cloud Platform, including the ability to take snapshots and replay messages. First, you will learn the basics of a Publisher-Subscriber architecture. Publishers are apps that send out messages, these messages are organized into Topics. Topics are associated with Subscriptions, and Subscribers need to listen in on subscriptions. Each subscription is a message queue, and messages are held in that queue until at least one subscriber per subscription has acknowledged the message. This is why Pub/Sub is said to be a reliable messaging system. Next, you will discover how to create topics, as well as how to push and pull subscriptions. As their names would suggest, push and pull subscriptions differ in who controls the delivery of messages to the subscriber. Finally, you will explore how to leverage advanced features of Pub/Sub such as creating snapshots, and seeking to a specific timestamp, either in the past or in the future. You will also learn the precise semantics of creating snapshots and the implications of turning on the “retain acknowledged messages” option on a subscription. When you’re finished with this course, you will have the skills and knowledge of Google Cloud Pub/Sub needed to effectively and reliably process streaming data on the GCP.
Author Name: Vitthal Srinivasan
Author Description:
Vitthal has spent a lot of his life studying – he holds Masters Degrees in Math and Electrical Engineering from Stanford, an MBA from INSEAD, and a Bachelors Degree in Computer Engineering from Mumbai. He has also spent a lot of his life working – as a derivatives quant at Credit Suisse in New York, then as a quant trader, first with a hedge fund in Greenwich and then on his own, and finally at Google in Singapore and Flipkart in Bangalore. In all these roles, he has written a lot of code, and b… more

Table of Contents

• Course Overview
  2mins
• Getting Started with Cloud Pub/Sub
  29mins
• Configuring Publishers, Subscribers, and Topics
  38mins
• Using the Cloud Pub/Sub Client Library
  33mins