Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
62,958 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

NC

Invalid date

Just as great as the previous course. I feel like I have a much better chance at figuring out what to do to improve the performance of a neural network and TensorFlow makes much more sense to me now.

NC

Invalid date

Yet another excellent course by Professor Ng! Really helped me gain a detailed understanding of optimization techniques such as RMSprop and Adam, as well as the inner workings of batch normalization.

Filter by:

7051 - 7075 of 7,225 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Hamad U R Q

•

Sep 12, 2019

too easy.

One thing about Week 3 that I want to say, I had some confusions in the lectures but was hopeful that while going through the assignment I will clear out the concepts about tuning Hyper-parameters but instead, the assignment was ALL about tensorflow basics and nothing about tuning Hyper-parameters. I was really disappointed with that!

Other than that, course contents are great and worth the time and effort.

By Fermin B

•

Mar 7, 2021

The course it's very good, but the reason I didn't put 3 stars is because it was difficult. I had the impression that the course was going too fast and I wasn't able to fully understand all the contents that the teacher gave. I think the assignments should be more similar to the first course, where you go step by step, understanding everything about the code. More explanations about tensorflow would be appreciated.

By Younes A

•

Dec 7, 2017

Wouldn't recommend because of the very low quality of the assignments, but I don't regret taking them because the content is great. Seriously the quality of deeplearning.ai courses is the lowest I have ever seen! Glitches in videos, wrong assignments (both notebooks and MCQs), and no valuable discussions on the forums. Too bad Prof Ng couldn't get a competent team to curate his content for him.

By Christian M

•

May 15, 2022

The theoretical part was clearly understandable but the programming assignment was very poor in my opinion.

Did I miss the introduction to tensorflow somewhere? I could not find it in the cousre. It was possible to solve the assignments with guessing and reading some forum posts. But honestly I did not understand very much...

I'm a bit disappointed about the introduction to tensorflow.

By Gadiel S

•

Sep 21, 2018

The course is good. It covers important ideas, and they are well explained in the videos. However, the formulation of the assignments is sloppy. There are mistakes and inconsistencies, in some cases necessary explanations are missing, and in some cases the instructions are misleading (I suspect the assignment has changed over time, but the instructions have not been consistently updated).

By Ha S C

•

Oct 28, 2018

A much sloppier and poorer course than previously. Grading mishaps (on the fault of the grader), a few errors in the lectures (the variance in the normalization), and very basic and unhelpful feedback from staff made for a course that did not live up to the level of the previous one. If at any point you need further help, it is generally unavailable, or difficult to find at best.

By Ashkan R

•

Dec 23, 2020

I really like the course material, topics discussed, and neural networks in general. I also have a lot of respect and gratitude toward Andrew, but the way he organized quizzes and programming assignments are rather a monkey-see-monkey-do strategy. You rarely get challenged. Overall the course is worth taking, but I would not recommend this to more advanced practitioners.

By Siddharth D

•

Apr 24, 2020

I have written this before in the discussions. I feel, there should be assignments to implement everything from scratch. I feel, i can fill in the code, and understand ,most of the mathematical functions, and reasoning, but i am still not confident that i can "CODE" a new problem from scratch. I was really hoping this certification will give me practice to achieve this.

By Maysa M G d M

•

Mar 4, 2018

Some exercises were wrong , like Z3 em tensorflow model, you said z3=w*z2+b3, but it was A2 ,not Z2.

Several exercises did not check the result for each function, so when I arrived at the huge model function, it was hard to discover where I was wrong.

I think this third week could be two. I missed exercise with normalization, there were all with tensorflow.

By Dartois S

•

Aug 17, 2017

A bit less good than the previous course. It would have been good to have a chance to concretely implement Batch normalization. Then I think the tutorial on tensorflow needs more details and explanations of the what and why of the conventions. Anyway I was really happy to learn a bit about tensorflow, I hope I will use it more through the course.

By Ali I

•

Sep 4, 2021

this course provided me with very fair insight, however, i felt that the Tensorflow portion was covered ina hurry. I had no background of tensor flow, and I am believing that the way it is covered might be the right way and I will build up on it. Even while covering the last assignment i had not much familiarity with the syntax of tensorlfow....

By Amit C

•

Nov 20, 2019

The fact that the lectures are not available to keep is problematic. Also, the programming assignments leave too little to do. Only few lines of code, that in most cases are simply copied from the problem description. It would make sense to broaden the programming tasks, and let the students really cope with many of the real-world challenges.

By Volodymyr B

•

Sep 19, 2021

The last programming assignment in the course is a bit better than the rest, while lectures are of rather high quality. In Quizes some questions are confusing. E. g. Andrew Ng several times said that parameters should be revised from time to time, but there is a question that (in couple with correct answer) states the opposite:(

By Erick M A

•

Mar 27, 2022

Awesome content but one big flaw: After 2 months using numpy to build neural networks (since course 1 of the specialization), briefly touches TensorFlow for around 2 hours. I feel like we should at least do everything we did with numpy (l2 regularization, drop out, 2 layer nn, deep nn, etc) once again using TensorFlown

By Virgilio E

•

Nov 27, 2017

The course explains great tips for optimizing and tuning NN, bu I miss some more practical examples where observing and compare results when applying the different techniques studied.

Also I miss a general schema of all optimization and tuning tips in order to know when and where apply each depending on conditions, etc.

By Till R

•

Mar 2, 2019

Exercises are too easy, and lectures are kind of boring. The Jupyter / iPython system does not run smoothly. I ended up downloading everything on my local computer, completing the assignment there, and then pasting the code into the coursera notebook. That makes the assignments take 50% longer than necessary.

By bob n

•

Nov 15, 2020

Would have rated higher, lost 2 stars because uses Tensor version 1. Keeping courses current is very important to me. Rating 3 even that though I thoroughly enjoyed this course and learned what's under the covers in packages such as tensorflow. Not sure if there is an excuse for not updating the final lab.

By Tomer G

•

Nov 9, 2019

The content is 5 stars.

However, technicalities of assignments not getting submitted and then needing to investigate in the discussion board what others did to be able to submit an assignment..

Assignments not getting submitted&graded is a criticial bug, that's why the temporary 3 stars rating on my side.

By Alex B

•

Aug 7, 2022

Considering that this is a refresh from an earlier course, some more attention could have been given to correctness of formulas used; there seems to be a real disconnect between Tensorflow programming assignment and other programming assignments - the Tensorflow functions were not well introduced

By Irina R

•

Apr 25, 2020

Andrew is an excellent teacher, but the programming assignments are weak. Everything is already written for the learner, and the only things one needs to do is to fill few lines of code here and there. To fully understand the material, the learner should write the code by himself/herself.

By Vishnu V S

•

May 6, 2020

I wish the course material on Tensorflow was updated to Tensorflow 2, but it is also nice to know what happens under the hood. I also wish there was some programming assignments in which we could tune some hyperparameters and visualise the difference between selecting diferent values.

By Jacob J

•

Dec 13, 2022

While reviewing the mathematics is important, not having any formal lectures discussing the lines of code became frustrating at times. A brief overview relating the mathematics to how it should be formatting written would be beneficial (especially when introducing Tensorflow).

By akshaya r

•

Jan 12, 2020

Good explanation of hyperparameters and optimization in DNN. As a beginner to tensor flow, I felt it hard to debug the tensor flow assignment. It would have been easier if the assignment included validation of each function before building the complete model.

By Salim S I

•

Aug 12, 2018

Would have liked programming assignment in python to understand the various initializations and optimizations. Although tensorflow introduction was good, It felt like being left stranded without a python assignment to cement the things learnt in the class.

By Brian W

•

Oct 17, 2019

The lectures are good and informative. However, the programming assignments are hard to learn from - an unhelpful combination of too easy and too obscure, so that it's hard to believe I'm developing skills that will help me program such things myself.