Building Data Lakes on AWS

Building Data Lakes on AWS

This course is part of AWS Cloud Solutions Architect Professional Certificate

Taught in English

Some content may not be translated

Instructors: Rafael Lopes

Course

Gain insight into a topic and learn the fundamentals

4.8

(246 reviews)

96%

Beginner level

Recommended experience

11 hours (approximately)

Flexible schedule

Learn at your own pace

View course modules

What you'll learn

Apply data lake methodologies in planning and designing a data lake.
Describe the components and services required for building an AWS data lake.
Compare the ways data can be ingested, stored, and transformed in a data lake.
Explain how to secure a data lake with appropriate permissions.

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

10 assignments

Course

Gain insight into a topic and learn the fundamentals

4.8

(246 reviews)

96%

Beginner level

Recommended experience

11 hours (approximately)

Flexible schedule

Learn at your own pace

View course modules

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

Build your Data Analysis expertise

This course is part of the AWS Cloud Solutions Architect Professional Certificate

When you enroll in this course, you'll also be enrolled in this Professional Certificate.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate from Amazon Web Services

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

There are 6 modules in this course

The fundamental-level course is typically designed for individuals with a basic understanding of data storage and processing concepts but little to no prior experience with building data lakes on AWS specifically. After a brief introduction to Data Lakes, we'll introduce data ingestion, cataloging and preparation, concluding with an overview of querying data with Amazon Athena. The course will continue with an AWS Lake Formation overview, including a hands-on lab where you'll build a data lake. We'll then introduce data processing and analytics leveraing AWS Glue before diving into automated data lake creatiokn using Lake Formation blueprints. Finally, we'll close with Modern Data Architectures on AWS with a lab that covers publishing and consuming data products as a service.

This module provides an overview of data lakes, their purpose, and how they differ from data warehouses. It also covers the components and architectures involved in data lakes.

What's included

5 videos1 reading2 assignments1 plugin

5 videosTotal 19 minutes

Course Introduction and Overview3 minutesPreview module
Module Objectives0 minutes
Why Data Lakes?4 minutes
Data Lake vs Data Warehouse5 minutes
Components and Architectures6 minutes

1 readingTotal 2 minutes

Pre-Course Survey2 minutes

2 assignmentsTotal 60 minutes

Knowledge Check30 minutes
Pre-Assessment30 minutes

1 pluginTotal 15 minutes

Pre-Course Survey15 minutes

This module focuses on the processes of ingesting data into a data lake, cataloging the data, and preparing it for analysis. It covers topics such as data lake storage, data ingestion methods, crawling and cataloging data, data formatting, partitioning, compression, and querying data with Amazon Athena.

What's included

10 videos1 reading1 assignment1 plugin

10 videosTotal 46 minutes

Module Objectives1 minutePreview module
Data Lake Storage4 minutes
Data Ingestion6 minutes
Crawl and Catalog Data3 minutes
Demo: Creating and Running a Glue Crawler8 minutes
Formatting the Data in the Lake3 minutes
Partitioning, Compressing, and Compacting the Data in the Lake4 minutes
Query Data with Amazon Athena3 minutes
Demo: Querying CSV data with Amazon Athena2 minutes
Demo: Columnar data formats with Amazon Athena - a performance and cost comparison6 minutes

1 readingTotal 2 minutes

Mid-Course Survey2 minutes

1 assignmentTotal 30 minutes

Knowledge Check30 minutes

1 pluginTotal 15 minutes

Mid-Course Survey15 minutes

This module introduces AWS Lake Formation, a service that helps build and manage data lakes on AWS. It covers the basic permission model, and provides an overview of the service’s features and capabilities.

What's included

3 videos1 reading2 assignments1 app item

3 videosTotal 8 minutes

Moule Objectives0 minutesPreview module
AWS Lake Formation Overview2 minutes
AWS Lake Formation Basic Permission Model5 minutes

1 readingTotal 15 minutes

Reading: AWS Lake Formation Basics15 minutes

2 assignmentsTotal 32 minutes

Are you ready for the lab?2 minutes
Knowledge Check30 minutes

1 app itemTotal 60 minutes

Lab 1: Building a Data Lake using AWS Lake Formation60 minutes

This module covers data transformation techniques and tools like AWS Glue for processing and analyzing data in the data lake. It includes hands-on demos and a technical talk on Glue and Athena Federated Queries.

What's included

7 videos1 assignment1 discussion prompt

7 videosTotal 37 minutes

Module Objectives0 minutesPreview module
Data Transformation3 minutes
Data Processing with AWS Glue4 minutes
AWS Glue Jobs and Workflows2 minutes
Demo - Glue Databrew9 minutes
Demo - Glue Studio8 minutes
Tech Talk - Glue / Athena Federated Queries6 minutes

1 assignmentTotal 30 minutes

Knowledge Check 30 minutes

1 discussion promptTotal 10 minutes

AWS Glue10 minutes

This module explores advanced features and configurations of AWS Lake Formation, including blueprints, workflows, and fine-grained access control. It also covers data visualization with Amazon QuickSight.

What's included

5 videos2 assignments1 app item

5 videosTotal 20 minutes

Module Objectives1 minutePreview module
Using Blueprints and Workflows2 minutes
Fine-grained Access Control5 minutes
Demo - LF-Tags6 minutes
Visualizing Data with QuickSight - Demo4 minutes

2 assignmentsTotal 32 minutes

Are you ready for the lab?2 minutes
Knowledge Check30 minutes

1 app itemTotal 60 minutes

Lab 2: Automate Data Lake Creation Using AWS Lake Formation Blueprints60 minutes

This module introduces the concept of modern data architecture and its implementation on AWS. It covers data movement scenarios, data sharing models, and relevant readings.