Back to ETL and Data Pipelines with Shell, Airflow and Kafka

Learner Reviews & Feedback for ETL and Data Pipelines with Shell, Airflow and Kafka by IBM

4.5

stars

335 ratings

About the Course

Delve into the two different approaches to converting raw data into analytics-ready data. One approach is the Extract, Transform, Load (ETL) process. The other contrasting approach is the Extract, Load, and Transform (ELT) process. ETL processes apply to data warehouses and data marts. ELT processes apply to data lakes, where the data is transformed on demand by the requesting/calling application. In this course, you will learn about the different tools and techniques that are used with ETL and Data pipelines. Both ETL and ELT extract data from source systems, move the data through the data pipeline, and store the data in destination systems. During this course, you will experience how ELT and ETL processing differ and identify use cases for both. You will identify methods and tools used for extracting the data, merging extracted data either logically or physically, and for loading data into data repositories. You will also define transformations to apply to source data to make the data credible, contextual, and accessible to data users. You will be able to outline some of the multiple methods for loading data into the destination system, verifying data quality, monitoring load failures, and the use of recovery mechanisms in case of failure. By the end of this course, you will also know how to use Apache Airflow to build data pipelines as well be knowledgeable about the advantages of using this approach. You will also learn how to use Apache Kafka to build streaming pipelines as well as the core components of Kafka which include: brokers, topics, partitions, replications, producers, and consumers. Finally, you will complete a shareable final project that enables you to demonstrate the skills you acquired in each module....

Top reviews

Invalid date

It's one of the most challenging courses I've been enrolled!

Invalid date

Overall it's a good course. I wish I could use dos2unix, tr, or sed for removing ^M from the toll_data.tsv. The Final Assignment Instructions could have been clearer.

Filter by:

51 - 75 of 84 Reviews for ETL and Data Pipelines with Shell, Airflow and Kafka

By Md N S

•

Jul 21, 2024

Excellent course

By Thọ L

•

Aug 7, 2024

Great course!

By Burhanudin B

•

Aug 9, 2023

Best tutorial

By Olabode A

•

Oct 20, 2022

Nice course.

By Swati P

•

Jul 11, 2024

Great Course

By Sai T Z

•

Aug 7, 2023

Great course

By Sabeur M

•

Jan 20, 2024

Great Cours

By Tasic D

•

Mar 31, 2023

Top Course

By Yitagesu S

•

Jun 24, 2024

I CANT PAY

By Mohib A

•

Mar 24, 2023

great

By FREDERICK G

•

Aug 17, 2023

4.5

By Vishal S

•

Nov 5, 2023

I got to learn in the most practical way. I loved the course and how they connected the learnings of different tech stacks in one. One thing they can improve is by providing more reading materials which can help us learn the advances since the course covers more of basic aspect of the technologies.

By Markus Z

•

Mar 28, 2022

Good compact summary of the topics.

Regarding the assignment: Good to have an environment for testing your code directly. Unfortunatly it was a bit unstable. Final assignment was a bit to much screenshots and lesser coding.

By prahal m

•

Mar 24, 2023

it was good course should have also given an information on industry related solution and they can implement the same.

By Hector T

•

Apr 1, 2023

Course offers valuable conceptual content but labs could be improved. Coursera assessment system is really poor.

By David R

•

Jun 4, 2022

Good introduction to Airflow and Kafka however only one airflow operator is explored

By MESSOLO O

•

Mar 30, 2023

Very good , Ilearn may thing and very good redaction and explains

By Otto Z g

•

Jun 22, 2022

It takes 1 hour to connect the lab and start the service.

By Rafael M S

•

Aug 24, 2023

Very helpful course!

By Mbaye B

•

May 14, 2022

interesting

By Juan D G B

•

Jan 15, 2023

good course

By Krishna k K

•

Apr 12, 2022

good

By Mimi Z

•

Oct 28, 2022

The course material was basic so make sure do to a lot of your own additional learning outside of the coureswork. The discussion staff are not helpful/don't understand or even read your questions before replying. The labs don't always work and the instructions don't always line up with current software upgrades. Just be prepared to do a lot of troubleshooting with not much help. I wish the course would tell you what to do when certain errors occur/are more thorough with their instructions.

By Yao G A

•

Feb 25, 2022

Cette note est du au fait du probleme de notation des examens. Le fait de laisser à l'appréciation des étudiants de juger de la bonne réponse basé sur uniquement que des indices... par exemple pour le Task 1.2 à 1.8 je crois avoir eu 2 presque partout maison ne m'en a donné que 1. Ce que je ne trouve pas vraiment juste

By Kasra A

•

Jan 14, 2024

The final exam experience was so poor. I have got disconnected many times and my correct answers were shown incorrect due to time exceeded error. Although, labs project were good and a little bit challenging which I liked it.