What Does MVP Stand For? It’s Not What You Think.
October 7, 2024
Article
Instructor: Packt - Course Instructors
Included with
Recommended experience
Intermediate level
Professionals with foundational knowledge in SQL, data pipelines, and cloud platforms like AWS. Prior experience with Snowflake is beneficial.
Recommended experience
Intermediate level
Professionals with foundational knowledge in SQL, data pipelines, and cloud platforms like AWS. Prior experience with Snowflake is beneficial.
Architect and optimize scalable data pipelines with Snowflake and AWS.
Implement ingestion, transformation, and extraction workflows with best practices.
Deploy machine learning pipelines using Snowpark and real-time streaming with Kafka.
Ensure data governance with advanced security and compliance features.
Add to your LinkedIn profile
February 2025
13 assignments
Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review
Unlock the power of Snowflake and AWS to build robust, scalable data pipelines that integrate seamlessly with your data ecosystem. This course equips you with the tools to design, optimize, and maintain efficient data pipelines, empowering you to master modern data engineering practices.
Start by understanding Snowflake's architecture, virtual warehouses, and billing components, and then delve into creating and managing tables, views, and partitions. Explore advanced concepts such as clustering, performance optimization, and query caching while gaining hands-on experience through practical labs. With these foundations, you'll progress to data ingestion, extraction workflows, and continuous data pipelines using Snowflake and AWS S3. Expand your expertise with advanced topics like user-defined functions, external functions, and Snowflake's integration with Python, Spark, and Airflow. Learn to handle real-time data streaming with Kafka and Snowflake, implement governance features like row-level security, and deploy Snowpark for machine learning pipelines. The course culminates in real-world projects that reinforce your knowledge through practice. This course is ideal for data engineers, architects, and cloud professionals seeking to build enterprise-grade pipelines. A foundational understanding of SQL and cloud platforms like AWS is recommended. With its intermediate difficulty, this course bridges the gap between foundational knowledge and advanced data engineering skills.
In this module, we will set the stage for the entire course by outlining the roadmap, discussing the prerequisites, and sharing success strategies. These foundational insights will ensure you're well-prepared to navigate and excel in the upcoming material.
2 videos1 reading
In this module, we will explore the foundational concepts of data warehousing and its significance within a data ecosystem. We’ll take a closer look at Snowflake’s architecture, object hierarchy, and virtual warehouses. Additionally, you’ll learn about Snowflake’s billing components, tracking consumption, and setting up resource monitors, ensuring you’re equipped to manage resources effectively.
9 videos1 assignment
In this module, we will delve into the various table types available in Snowflake, providing a comprehensive introduction to their structures and purposes. You’ll gain hands-on experience through labs focused on creating tables, views, and secure views. We’ll also explore the nuances of views, including materialized and secure views, to enhance your understanding of Snowflake's data presentation capabilities.
6 videos1 assignment
In this module, we will examine Snowflake’s advanced data organization features, focusing on micro-partitions and clustering keys. Through hands-on labs, you’ll learn to select and configure clustering keys, analyze query profiles, and leverage caching mechanisms to enhance performance. Additionally, we’ll explore the benefits of search optimization to further streamline data retrieval and processing efficiency.
9 videos1 assignment
In this module, we will explore the end-to-end processes for loading and extracting data in Snowflake. You'll learn how to connect Snowflake with AWS S3, ingest structured and semi-structured data, and implement continuous ingestion using Snowpipe. Additionally, we'll cover critical aspects such as billing estimation and key considerations to ensure efficient data operations. Hands-on labs will solidify your understanding of these concepts.
9 videos1 assignment
In this module, we will delve into Snowflake's task management and query scheduling features. You'll learn how to create and manage tasks, build complex task trees for dependent workflows, and monitor their execution. We'll also explore billing insights and query history to ensure efficient and cost-effective operations. Through hands-on labs, you’ll gain practical skills in implementing and optimizing tasks in Snowflake.
4 videos1 assignment
In this module, we will uncover the power of streams in Snowflake for implementing Change Data Capture (CDC) workflows. You'll learn how to use standard and append-only streams, manage data retention, and handle stream staleness. Through a series of labs and a project, you’ll create and implement end-to-end pipelines that leverage streams to track and process data changes efficiently. This hands-on experience will solidify your understanding of CDC in modern data architectures.
11 videos1 assignment
In this module, we will explore User-Defined Functions (UDFs) in Snowflake, a powerful feature for extending database functionality. You'll learn about different UDF types, including scalar, tabular, and JavaScript-based UDFs, and gain hands-on experience implementing them. Additionally, we'll discuss pushdown in UDFs and its impact, as well as best practices for writing secure UDFs to ensure data privacy and compliance.
7 videos1 assignment
In this module, we will explore the capabilities of external functions in Snowflake for interacting with external systems. You’ll learn how to deploy AWS Lambda functions, create and secure API Gateway, and integrate these components with Snowflake to build external functions. Through hands-on labs, you will gain practical skills in configuring and deploying these powerful integrations for extending Snowflake’s functionality.
7 videos1 assignment
In this module, we will explore how to integrate Snowflake with Python, Spark, and Airflow on AWS to build robust data engineering solutions. You’ll learn how to connect Snowflake with Python locally and on AWS Glue, parameterize scripts, and use Pandas for data manipulation. Additionally, we will dive into PySpark jobs, the pushdown optimization in Spark 3.1, and setting up Airflow for task orchestration. Hands-on labs will provide practical experience in deploying and automating workflows across these tools.
12 videos1 assignment
In this module, we will focus on real-time streaming using Kafka and Snowflake. You'll learn to set up Kafka on your local system, configure the Kafka-Snowflake connector, and enable secure connectivity with encryption keys. Through hands-on labs, you'll implement streaming pipelines to ingest real-time data into Snowflake, solidifying your understanding of integrating modern streaming platforms with Snowflake.
6 videos1 assignment
In this module, we will explore key features of Snowflake that ensure robust data protection and governance. You'll learn about Time Travel and Failsafe mechanisms for data recovery, and implement column-level dynamic data masking for safeguarding sensitive information. Additionally, we'll cover row-level security and guide you through hands-on labs to create and apply access policies, ensuring controlled and compliant data access.
6 videos1 assignment
In this module, we will dive into Snowpark, Snowflake's powerful framework for building advanced data pipelines and supporting data science use cases. You'll gain hands-on experience with deploying Python UDFs, creating stored procedures for ETL tasks, and preparing data for machine learning. Furthermore, you will build and deploy model training and prediction pipelines using Scikit-Learn, all powered by Snowpark. Additional learning resources and a coupon code for extended exploration will also be provided.
9 videos1 assignment
In this module, we will wrap up the course by reflecting on the key topics and skills covered. You’ll receive guidance on next steps, including updates on Snowflake's evolving features and additional learning opportunities. This final section will help you chart a path for continued growth and mastery of Snowflake and its ecosystem.
1 video1 assignment
Packt helps tech professionals put software to work by distilling and sharing the working knowledge of their peers. Packt is an established global technical learning content provider, founded in Birmingham, UK, with over twenty years of experience delivering premium, rich content from groundbreaking authors on a wide range of emerging and popular technologies.
Georgetown University
Earn a degree
Degree
University of North Texas
Earn a degree
Degree
University of North Texas
Earn a degree
Degree
University of Illinois Urbana-Champaign
Earn a degree
Degree
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Earn a degree from world-class universities - 100% online
Upskill your employees to excel in the digital economy
Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.
If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.
Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.
If you complete the course successfully, your electronic Course Certificate will be added to your Accomplishments page - from there, you can print your Course Certificate or add it to your LinkedIn profile.
This course is one of a few offered on Coursera that are currently available only to learners who have paid or received financial aid, when available.
You will be eligible for a full refund until two weeks after your payment date, or (for courses that have just launched) until two weeks after the first session of the course begins, whichever is later. You cannot receive a refund once you’ve earned a Course Certificate, even if you complete the course within the two-week refund period. See our full refund policy.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.
These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.
These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.
These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. If you do not allow these cookies we will not know when you have visited our site, and will not be able to monitor its performance.
These cookies enable the website to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.