Building Batch Data Pipelines on Google Cloud - 한국어

Cultivate your career with expert-led programs, job-ready certificates, and 10,000 ways to grow. All for $25/month, billed annually. Save now

Building Batch Data Pipelines on Google Cloud - 한국어

Instructor: Google Cloud Training

Included with Coursera Plus

Learn more

7 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Some related experience required

17 hours to complete

3 weeks at 5 hours a week

Flexible schedule

Learn at your own pace

7 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Some related experience required

17 hours to complete

3 weeks at 5 hours a week

Flexible schedule

Learn at your own pace

What you'll learn

데이터를 로드하는 다양한 방법인 EL, ELT, ETL을 살펴보고 언제 어떤 방식을 사용해야 하는지 알아봅니다.
Dataproc에서 Hadoop을 실행하고, Cloud Storage를 활용하며, Dataproc 작업을 최적화합니다.
Dataflow를 사용하여 데이터 처리 파이프라인을 빌드합니다.
Data Fusion 및 Cloud Composer를 사용해 데이터 파이프라인을 관리합니다.

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

4 assignments

Taught in Korean

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

There are 7 modules in this course

Data pipelines typically fall under one of the Extract and Load (EL), Extract, Load and Transform (ELT) or Extract, Transform and Load (ETL) paradigms. This course describes which paradigm should be used and when for batch data. Furthermore, this course covers several technologies on Google Cloud for data transformation including BigQuery, executing Spark on Dataproc, pipeline graphs in Cloud Data Fusion and serverless data processing with Dataflow. Learners get hands-on experience building data pipeline components on Google Cloud using Qwiklabs.

이 모듈에서는 과정과 주제를 소개합니다.

What's included

1 video

이 모듈에서는 데이터를 로드하는 다양한 방법인 EL, ELT, ETL을 살펴보고 언제 어떤 방식을 사용해야 하는지 알아봅니다.

What's included

6 videos1 assignment

이 모듈에서는 Dataproc에서 Hadoop을 실행하는 방법, Cloud Storage를 활용하는 방법, Dataproc 작업을 최적화하는 방법을 알아봅니다.

What's included

11 videos1 assignment1 app item

11 videosTotal 48 minutes

모듈 소개0 minutesPreview module
Hadoop 생태계4 minutes
Dataproc에서 Hadoop 실행하기11 minutes
HDFS 대신 Cloud Storage 사용하기6 minutes
Dataproc 최적화하기2 minutes
Dataproc 스토리지 최적화하기9 minutes
Dataproc 템플릿 최적화 및 자동 확장4 minutes
Dataproc 모니터링 최적화하기3 minutes
실습 소개: Dataproc에서 Apache Spark 작업 실행0 minutes
Coursera: Getting Started with Google Cloud Platform and Qwiklabs4 minutes
요약0 minutes

1 assignmentTotal 6 minutes

Dataproc에서 Spark 실행6 minutes

1 app itemTotal 90 minutes

실습: Dataproc에서 Apache Spark 작업 실행90 minutes

이 모듈에서는 Dataflow를 사용해 데이터 처리 파이프라인을 빌드하는 과정을 다룹니다.

What's included

13 videos1 assignment6 app items

13 videosTotal 34 minutes

모듈 소개0 minutesPreview module
Dataflow 소개5 minutes
고객이 Dataflow를 선호하는 이유2 minutes
코드로 Dataflow 파이프라인 빌드하기3 minutes
파이프라인 설계 시 주요 고려사항2 minutes
PTransforms로 데이터 변환3 minutes
실습 소개: 간단한 Dataflow 파이프라인 빌드하기0 minutes
GroupByKey로 집계하고 조합하기5 minutes
실습 소개: Beam의 맵리듀스0 minutes
데이터의 부 입력 및 Windows4 minutes
실습 소개: Dataflow를 사용한 서버리스 데이터 분석: 부 입력0 minutes
파이프라인 템플릿 만들기 및 재사용하기3 minutes
요약2 minutes

1 assignmentTotal 4 minutes

Dataflow를 사용한 서버리스 데이터 처리4 minutes

6 app itemsTotal 540 minutes

간단한 Dataflow 파이프라인(Python)90 minutes
Dataflow를 사용한 서버리스 데이터 분석: 간단한 Dataflow 파이프라인(자바)90 minutes
Beam의 맵리듀스(Python)90 minutes
Beam을 사용한 서버리스 데이터 분석: Beam의 맵리듀스(Java)90 minutes
Dataflow를 사용한 서버리스 데이터 분석: 부 입력(Python)90 minutes
Dataflow를 사용한 서버리스 데이터 분석: 부 입력(자바)90 minutes

이 모듈에서는 Cloud Data Fusion 및 Cloud Composer를 사용해 데이터 파이프라인을 관리하는 방법을 알아봅니다.

What's included

13 videos1 assignment2 app items

13 videosTotal 29 minutes

모듈 소개0 minutesPreview module
Cloud Data Fusion 소개3 minutes
Cloud Data Fusion의 구성요소1 minute
Cloud Data Fusion UI1 minute
파이프라인 구축4 minutes
랭글러를 사용해 데이터 살펴보기1 minute
실습 소개: Cloud Data Fusion을 사용한 파이프라인 그래프 빌드 및 실행0 minutes
Cloud Composer를 사용해 Google Cloud 서비스 간 작업 조정하기1 minute
Apache Airflow 환경1 minute
DAG 및 연산자4 minutes
워크플로 예약5 minutes
모니터링 및 로깅3 minutes
실습 소개: Cloud Composer 소개0 minutes

1 assignmentTotal 2 minutes

Cloud Data Fusion 및 Cloud Composer를 사용한 데이터 파이프라인 관리2 minutes

2 app itemsTotal 240 minutes

실습: Cloud Data Fusion을 사용한 파이프라인 그래프 빌드 및 실행150 minutes
실습: Cloud Composer 소개90 minutes

과정 요약

What's included

1 video

모든 모듈의 PDF 링크

What's included

1 reading

Instructor

Google Cloud Training

Google Cloud

1,774 Courses3,161,524 learners

Offered by

Google Cloud

Recommended if you're interested in Cloud Computing

Google Cloud
Building Batch Data Pipelines on Google Cloud
Course
Google Cloud
ML Pipelines on Google Cloud - 한국어
Course
Google Cloud
Building Batch Data Pipelines on GCP en Français
Course
Google Cloud
Building Batch Pipelines in Cloud Data Fusion
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Cloud Computing? Start here.

Guide to Health Care Administration Careers

March 13, 2025

Article

What Is Shopify and How Does It Work?

October 7, 2024

Article

What Does a Consultant Do?

September 30, 2024

Article

How to Become a Certified Personal Trainer: 8 Steps to Take

March 14, 2025

Article

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.

If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.

Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.

Building Batch Data Pipelines on Google Cloud - 한국어

What you'll learn

Details to know

See how employees at top companies are mastering in-demand skills

Earn a career certificate

There are 7 modules in this course

소개

What's included

일괄 데이터 파이프라인 빌드 소개

What's included

Dataproc에서 Spark 실행

What's included

Dataflow를 사용한 서버리스 데이터 처리

What's included

Cloud Data Fusion 및 Cloud Composer를 사용한 데이터 파이프라인 관리

What's included

과정 요약

What's included

과정 리소스

What's included

Instructor

Offered by

Recommended if you're interested in Cloud Computing