Building Resilient Streaming Analytics Systems on Google Cloud

This course is part of multiple programs.

Instructor: Google Cloud Training

What you'll learn

Interpret use-cases for real-time streaming analytics.
Manage data events using the Pub/Sub asynchronous messaging service.
Write streaming pipelines and run transformations where necessary.
Interoperate Dataflow, BigQuery and Pub/Sub for real-time streaming and analysis

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

6 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

Build your subject-matter expertise

This course is available as part of

When you enroll in this course, you'll also be asked to select a specific program.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

There are 7 modules in this course

Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. This course covers how to build streaming data pipelines on Google Cloud. Pub/Sub is described for handling incoming streaming data. The course also covers how to apply aggregations and transformations to streaming data using Dataflow, and how to store processed records to BigQuery or Bigtable for analysis. Learners get hands-on experience building streaming data pipeline components on Google Cloud by using Google Cloud Skills Boost.

This module introduces the course and agenda

What's included

1 video

This modules talks about challenges with processing streaming data

What's included

1 video1 assignment

This module talks about using Pub/Sub to ingest incoming streaming data

What's included

7 videos1 assignment1 app item

7 videosTotal 27 minutes

Module introduction0 minutesPreview module
Introduction to Pub/Sub7 minutes
Pub/Sub Push versus Pull5 minutes
Publishing with Pub/Sub code7 minutes
Summary1 minute
Lab Intro: Publish Streaming Data into Pub/Sub0 minutes
Getting Started with Google Cloud Platform and Qwiklabs4 minutes

1 assignmentTotal 8 minutes

Serverless Messaging with Pub/Sub8 minutes

1 app itemTotal 60 minutes

Lab: Streaming Data Processing: Publish Streaming Data into Pub/Sub60 minutes

This module revisits Dataflow and focuses on its streaming data processing capabilities

What's included

4 videos1 assignment1 app item

This modules covers BigQuery and Bigtable for streaming data

What's included

6 videos2 assignments3 app items

6 videosTotal 27 minutes

Module introduction0 minutesPreview module
Streaming into BigQuery and visualizing results5 minutes
Lab intro: Streaming Data Processing: Streaming Analytics and Dashboards0 minutes
High-throughput streaming with Bigtable14 minutes
Optimizing Bigtable performance6 minutes
Lab intro: Streaming Data Processing: Streaming Data Pipelines into Bigtable0 minutes

2 assignmentsTotal 10 minutes

Streaming Analytics and Dashboards4 minutes
High-Throughput Streaming with Bigtable6 minutes

3 app itemsTotal 210 minutes

Lab: Streaming Data Processing: Streaming Analytics and Dashboards60 minutes
Lab: Streaming Data Processing: Streaming Data Pipelines into Bigtable60 minutes
Lab: Generate Personalized Email Content with BigQuery Continuous Queries and Gemini90 minutes

This module dives into more advanced features of BigQuery

What's included

7 videos1 assignment1 app item

7 videosTotal 33 minutes

Module introduction0 minutesPreview module
Analytic window functions1 minute
GIS functions2 minutes
Demo: GIS Functions and Mapping with BigQuery16 minutes
Performance considerations6 minutes
Lab Intro: Optimizing your BigQuery Queries for Performance0 minutes
Cost considerations5 minutes

1 assignmentTotal 2 minutes

BigQuery advanced functionality and performance considerations2 minutes

1 app itemTotal 60 minutes

Optimizing your BigQuery Queries for Performance60 minutes

This module recaps the topics covered in course

What's included

1 video

Instructor

Instructor ratings

4.6 (151 ratings)

Google Cloud Training

Google Cloud

1,724 Courses2,906,649 learners

Offered by

Google Cloud

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

4.6

1,253 reviews

5 stars
68.18%
4 stars
25.03%
3 stars
5.26%
2 stars
1.27%
1 star
0.23%

Showing 3 of 1253

Reviewed on Aug 12, 2020

I really enjoyed this course. There is ample time in the labs to experiment and get familiar with the concepts and techniques being taught in this course.

Reviewed on Mar 14, 2021

This course has the most important technique for building streaming data and building efficient big queries.

Reviewed on Jun 28, 2020

An excellent course. A great way to teach building streaming data pipelines and optimizing queries on BigQuery and BigTable (by , inter alia, partitioning data sets )through hands-on labs.

View more reviews