DeepLearning.AI
Custom and Distributed Training with TensorFlow
DeepLearning.AI

Custom and Distributed Training with TensorFlow

Laurence Moroney
Eddy Shyu

Instructors: Laurence Moroney

23,558 already enrolled

Gain insight into a topic and learn the fundamentals.
4.8

(421 reviews)

Intermediate level

Recommended experience

Flexible schedule
Approx. 24 hours
Learn at your own pace
96%
Most learners liked this course
Gain insight into a topic and learn the fundamentals.
4.8

(421 reviews)

Intermediate level

Recommended experience

Flexible schedule
Approx. 24 hours
Learn at your own pace
96%
Most learners liked this course

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

4 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Placeholder

Build your subject-matter expertise

This course is part of the TensorFlow: Advanced Techniques Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 4 modules in this course

This week, you will get a detailed look at the fundamental building blocks of TensorFlow - tensor objects. For example, you will be able to describe the difference between eager mode and graph mode in TensorFlow, and explain why eager mode is very user friendly for you as a developer. You will also use TensorFlow tools to calculate gradients so that you don’t have to look for your old calculus textbooks next time you need to get a gradient!

What's included

12 videos3 readings1 assignment1 programming assignment2 ungraded labs

This week, you will build custom training loops using GradientTape and TensorFlow Datasets. Being able to write your own training loops will give you more flexibility and visibility with your model training. You will also use a function to calculate the derivatives of functions so that you don’t have to look to your old calculus textbooks to calculate gradients.

What's included

8 videos2 readings1 assignment1 programming assignment2 ungraded labs

This week, you’ll learn about the benefits of generating code that runs in “graph mode”. You’ll take a peek at what graph code looks like, and you’ll practice generating this more efficient code automatically with TensorFlow’s tools, so that you don’t have to write the graph code yourself!

What's included

6 videos2 readings1 assignment1 programming assignment2 ungraded labs

This week, you will harness the power of distributed training to process more data and train larger models, faster. You’ll get an overview of various distributed training strategies and then practice working with two strategies, one that trains on multiple GPU cores, and the other that trains on multiple TPU cores. Get your cape ready, because you’re going to get some superpowers this week!

What's included

9 videos5 readings1 assignment2 programming assignments4 ungraded labs

Instructors

Instructor ratings
4.9 (73 ratings)
Laurence Moroney
DeepLearning.AI
19 Courses531,442 learners

Offered by

DeepLearning.AI

Recommended if you're interested in Machine Learning

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

4.8

421 reviews

  • 5 stars

    83.45%

  • 4 stars

    12.76%

  • 3 stars

    2.36%

  • 2 stars

    0.94%

  • 1 star

    0.47%

Showing 3 of 421

AZ
5

Reviewed on Jan 7, 2021

RA
5

Reviewed on Jul 15, 2021

GJ
5

Reviewed on Dec 11, 2021

New to Machine Learning? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions