Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,068 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

YL

Invalid date

very useful course, especially the last tensorflow assignment. the only reason i gave 4 stars is due to the lack of practice on batchnorm, which i believe is one of the most usefule techniques lately.

NC

Invalid date

Yet another excellent course by Professor Ng! Really helped me gain a detailed understanding of optimization techniques such as RMSprop and Adam, as well as the inner workings of batch normalization.

Filter by:

6226 - 6250 of 7,238 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Joao N

Nov 4, 2019

One again the course is a great follow up from the previous one. The only little detail I wish had been done was for the assignment to cover a scenario where we had to improve some hyperparameters by applying different approaches covered in class.

By 戚运动 B Q

Apr 14, 2018

The course itself is great, but something out of the course is not so good, e.g. I can't see the video easily in China, and also the pictures in the exam can't be shown always, so I must take some guess to pass the exams, which is really a regret!

By Hanan S

Dec 16, 2017

Not like the first course which was kind of "trying not to touch the details", this course is more organized and I felt I've learned something. Still I would improve TF training to get more into the details (what does reset global variables do?!)

By Davy C

Oct 2, 2017

Interesting, but the quality of the exercises in not so good. There are at least 3-4 mistakes in the expected output that make you loose time double verifying. Mentor only seems to reply it is know, sounding like it has been like this for long...

By Nacho C

Nov 9, 2017

It mixes a review of Neural Network tuning techniques, and brief intro to TensorFlow. Those are really two very different topics, but I guess it's just designed to fill about a month of the specialization.

NOT recommended as a standalone course!

By Joaquín T S

Mar 24, 2021

This well-structured course guides you in understanding the importance of tuning hyperparameters as well as some regularization basics. I would give it 5 stars but for coding with Tensorflow < 2.0, what is really outdated in my honest opinion.

By 杨鹏程

Jul 3, 2018

This is a very good course, but the content of the hyperparameter adjustment mostly stays in the theoretical analysis. The latter experimental course does not involve how to implement the program. I hope that it will be improved in the future.

By Martin K

Dec 13, 2017

Great course. I learnt a lot again. Perhaps the programming exercises can be a little harder. Some things were quite literally spelled out which meant that you could theoretically copy/paste them into your code with only trivial adjustments.

By Mihajlo

Feb 1, 2018

I liked the optimization lectures, and Andrew's style of teaching. Anyway, I feel that I didn't learn enough in this course, and that it is not on the same level of previous courses we got used to, like the original Machine Learning course.

By Stuart H

Oct 14, 2021

A good introduction to the important details that go into training a neural network and why they are important. I appreciate how they explain it all from first principles, but I'm going to need to do some more courses to learn tensorflow.

By Faisal A

Aug 11, 2018

This course was better than the first course in the specialization. The assignments were more sophisticated (though repetitive at times) and required more thought and work. The only down side is the monotone way of presenting the material.

By Prashant M

Oct 25, 2017

Some lectures seem to have inconsistent/unexplained differences in the math written. For example, I am a bit confused as to whether normalization is done as (x - mean)/variance or (x - mean)/std.dev. Otherwise, excellent content as always!

By K S

Jun 5, 2021

In some other courses there was a pdf document at the end of the courses which very good if you want revisit them but in these courses its not available. Please make them available here which will be a very time saving for quick revisions

By Tianyi L

Nov 19, 2017

In overall, the course content is helpful and inspiring as normal, and can be used to real life straight away. However there are several typos/mistakes in the assignment, especially in assignment 3 which I had bad time to experience with.

By Rahul K

Jul 24, 2018

The best course in deep learning: Hyperparameter tuning, regularization and Optimization. The course is best among all the available courses over internet but it lacks availability of study materials (or reference to reading materials).

By Jairo L D A

Apr 24, 2018

Very good content. Professor Ng covers a lot of material in a gentle and steady way. A few errors in the assignment and less clarity on some texts and quiz make me give 4 stars, but overall it's a very useful, important course, I think.

By Jason A B

Sep 30, 2017

Great course for in-dept understanding of parameter tuning and optimization, +tensorflow. I would recommend increasing the complexity of the programming assignments. At this point we should be controlling more of the basic python setup.

By Giordano S

Sep 28, 2017

Maybe not as exciting as the first course of this series (Neural Networks and Deep Learning) as this one delves more in the "technicalities" of NN. The presentation of the topics, however, is always very clear and easily understandable.

By srinivasan v

Jan 8, 2018

Struggled a bit to grasp the batch nomalization, Initially Regularization was also hard to grasp the first time, subsequent viewing made it clear though but batch norm still is a bit hazy. I am happy though we are in to Tensorflow now.

By P.C. C

Feb 27, 2021

The material was excellent for this class and so were the lectures. I think more programming assignments could have been optimal though. There are so many concepts, and I think there are several pieces we didn't implement in practice.

By Tristan C

Apr 4, 2020

There were still a few times where I felt some clever editing could have hidden math errors but I felt the second part was already more polished and accessible than the first. I hope the rest of the series continues in this direction.

By daniele r

Jul 15, 2019

One of the best and most technical course in this Specialization: I enjoyed learning a lot on optimization algorithms. Really good practical hints on tuning and on bias variance analysis, that are very difficult to find in textbooks

By Anwesh J

Jul 18, 2020

Indeed this is an awesome course for any beginners in deep learning.One suggestion could be is why you have selected Tensorflow framework.Will it be possible to get same assignment in Pytorch framework which out institiute follows.

By Charles S

Nov 24, 2017

This course was excellent, however the Tensor flow at the end feels a little bit like the ML field is quickly being overtaken by the frameworks, and the Tensor flow section is a little bit tacked onto this course, maybe in a hurry.

By Ashok T

Dec 31, 2019

Interesting practical suggestions regarding hyperparameter tuning and batch normalization, it could be more mathematical with more programming assignments with the effects of tuning. The TF framework was kind of surprise in Week 3