What Is Data Communication? Basics to Know
November 22, 2024
Article
Learn the principles of effective data engineering. Build your skills in the high-demand field of data engineering and learn how you can deliver real business value by applying a core set of principles and strategies for developing data systems.
Instructor: Joe Reis
Top Instructor
15,092 already enrolled
(331 reviews)
Recommended experience
Intermediate level
This program is for beginners in the field of data engineering. The only prerequisite knowledge is intermediate Python programming skills.
(331 reviews)
Recommended experience
Intermediate level
This program is for beginners in the field of data engineering. The only prerequisite knowledge is intermediate Python programming skills.
Develop a mental model for the field of data engineering as a whole, including the data engineering lifecycle and its undercurrents.
Learn a framework for approaching any data engineering project you work on so you can effectively create business value with data.
Build your skill in the five stages of the data engineering lifecycle; including generating, ingesting, storing, transforming, and serving data.
Learn the principles of good data architecture and apply them to build data systems on the AWS cloud.
Add to your LinkedIn profile
September 2024
The DeepLearning.AI Data Engineering Professional Certificate is a comprehensive online program for data engineers and practitioners looking to start or grow their careers.
Organizations of all sizes and across all industries are capturing and generating data at an ever-increasing pace. Within these organizations, every team, from executives, sales and marketing, finance and operations, product and engineering, to customer service, can derive insights and value from organizational data. Whether the end use case is data science, machine learning, or analytics, data engineering is what allows raw data to be converted to value for the business. This is why the role of data engineer is one of the highest-demand jobs in tech today.
Throughout this program, you'll learn the foundations of data engineering while gaining hands-on experience designing and implementing data architectures using AWS and open-source tools.
Taught by industry expert Joe Reis, co-author of Fundamentals of Data Engineering, this certificate equips you with the skills and knowledge to excel in a high-demand field, focusing on ingesting, processing, transforming, storing, and serving data to data stakeholders to drive organizational and business objectives. The practical labs were developed in partnership with AWS and Factored.AI to provide you with an authentic experience building data systems on the cloud.
With this certificate, you will have the tools to further your data engineering career.
Applied Learning Project
In this program, you'll:
Translate stakeholder needs into system requirements and choose the appropriate tools to build the system.
Build end-to-end batch and streaming pipelines on AWS for a product recommendation system.
Apply principles of good data architecture to assess the security, performance, reliability, and scalability of data systems on AWS.
Explore various types of source systems and troubleshoot common connectivity issues.
Use infrastructure and pipelines as code tools to orchestrate, automate, and monitor your data pipelines.
Design data lake and data lakehouse storage architectures for various use cases.
Explore the impact of data storage choices on query performance and cost.
Model and transform data for analytics and machine learning use cases and compare centralized processing frameworks such as Pandas with distributed processing frameworks like Spark.
Serve your data to downstream data stakeholders for business analytics and machine learning use cases.
Gain a comprehensive understanding of the data engineering lifecycle and its undercurrents
Gather stakeholder needs and translate them into system requirements
Design and implement batch and streaming data pipelines on AWS
Gather stakeholder needs and translate them into system requirements.
Implement a batch and a streaming ingestion process on AWS to ingest data from various source systems.
Integrate aspects of security, data management, DataOps and orchestration into the data systems you build.
Design storage architectures for various use cases, and select appropriate technologies to implement these architectures
Practice common query patters and identify ways to improve query performance and enhance the value of your data systems
Model and transform data based on stakeholder needs to deliver business value
Choose the appropriate data processing tools for your architecture design
Process data for batch analytics and machine learning data pipelines using distributed and non-distributed processing frameworks
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
DeepLearning.AI is an education technology company that develops a global community of AI talent. DeepLearning.AI's expert-led educational experiences provide AI practitioners and non-technical professionals with the necessary tools to go all the way from foundational basics to advanced application, empowering them to build an AI-powered future.
Since 2006, Amazon Web Services has been the world’s most comprehensive and broadly adopted cloud platform. AWS offers over 90 fully featured services for compute, storage, networking, database, analytics, application services, deployment, management, developer, mobile, Internet of Things (IoT), Artificial Intelligence, security, hybrid and enterprise applications, from 44 Availability Zones across 16 geographic regions. AWS services are trusted by millions of active customers around the world — including the fastest-growing startups, largest enterprises, and leading government agencies — to power their infrastructure, make them more agile, and lower costs. Coursera and AWS have been partners since 2017 providing learners and enterprises globally, the skills they need to succeed. Coursera builds on AWS servers to scale with student demand with confidence around capacity and elasticity and in partnership with AWS. In 2019, Coursera achieved Advanced Tier Partner status and further extended the partnership with AWS Educate, AWS EdStart and AWS Academy collaborations. Coursera's been able to make cloud skills more accessible with 8 AWS courses on the Coursera platform featuring top subject matter experts and the portfolio continues to grow. To learn more about AWS, visit https://aws.amazon.com.
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Earn a degree from world-class universities - 100% online
Upskill your employees to excel in the digital economy
The focus of this program is to provide foundational training in the field of data engineering that includes both conceptual knowledge and principles as well as practical skills for building data systems on the AWS cloud.
This course is ideal for aspiring or practicing data engineers, as well as data professionals in adjacent roles like software engineering, data science, or analytics looking to broaden and deepen their skills in data engineering. Other data stakeholders such as data team leads and technical business leaders will also find value in these courses as they think about data systems and structures at the organizational level.
You will learn about the stages of the data engineering lifecycle, including generation, ingestion, storage, transformation, and serving data, as well as the s undercurrents of the lifecycle including security, DataOps, Data Management, Data Architecture, Orchestration, and Software Engineering. You’ll also learn how to design good data architecture, choose tools and technologies, and build data pipelines on the AWS cloud.
The program takes approximately 15 weeks to complete.
Intermediate Python programming and some familiarity working with data are the only prerequisites. Basic SQL and AWS Cloud services skills may be helpful but are not required.
The instructor is Joe Reis, a data engineering leader and co-author of the best-selling book "Fundamentals of Data Engineering."
This program will equip you with practical skills and fundamental principles to start and build a career in the high-demand field of data engineering.
We recommend taking the courses in the prescribed order for a logical and consistent learning experience.
You will receive a certificate at the end of each course if you pay or receive financial aid for the courses and complete the assessments. There is a limit of 180 days of certificate eligibility, after which you must re-purchase the course to obtain a certificate. If you audit the course for free, you will not receive a certificate.
If you complete all 4 courses in the Professional Certificate, you will also receive an additional certificate showing that you completed the entire Professional Certificate.
Please use the Coursera Learner Help Center for questions about your subscription.
A Coursera subscription costs $49 / month.
You can only get the DeepLearning.AI Data Engineering Professional Certificate if you enroll in the DeepLearning.AI Data Engineering specialization and complete all four courses. If you enrolled in each individual course, you will get the course certificate on completion of each of the four courses but you will not receive the professional certificate.
You can audit the courses in the DeepLearning.AI Data Engineering Professional Certificate. Note that you will not have access to the assessments and you will not receive a certificate at the end of the course if you choose to audit it for free instead of purchasing the subscription.
Visit coursera.org/business for more information, to pick up a plan, and to contact Coursera. For each plan, you decide the number of courses every member can enroll in and the collection of courses they can choose from.
Go to your Coursera account. Click on My Purchases and find the relevant course or Specialization.
Click Email Receipt and wait up to 24 hours to receive the receipt. You can read more about it here.
This course is completely online, so there’s no need to show up to a classroom in person. You can access your lectures, readings and assignments anytime and anywhere via the web or your mobile device.
If you subscribed, you get a 7-day free trial during which you can cancel at no penalty. After that, we don’t give refunds, but you can cancel your subscription at any time. See our full refund policy.
Yes! To get started, click the course card that interests you and enroll. You can enroll and complete the course to earn a shareable certificate, or you can audit it to view the course materials for free. When you subscribe to a course that is part of a Certificate, you’re automatically subscribed to the full Certificate. Visit your learner dashboard to track your progress.
¹ Median salary and job opening data are sourced from Lightcast™ Job Postings Report. Data for job roles relevant to featured programs (2/1/2024 - 2/1/2025)
These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.
These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.
These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. If you do not allow these cookies we will not know when you have visited our site, and will not be able to monitor its performance.
These cookies enable the website to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.