Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,224 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

AM

Oct 8, 2019

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

CM

Dec 23, 2017

Exceptional Course, the Hyper parameters explanations are excellent every tip and advice provided help me so much to build better models, I also really liked the introduction of Tensor Flow

Thanks.

Filter by:

6251 - 6275 of 7,258 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Martin K

•

Dec 13, 2017

Great course. I learnt a lot again. Perhaps the programming exercises can be a little harder. Some things were quite literally spelled out which meant that you could theoretically copy/paste them into your code with only trivial adjustments.

By Mihajlo

•

Feb 1, 2018

I liked the optimization lectures, and Andrew's style of teaching. Anyway, I feel that I didn't learn enough in this course, and that it is not on the same level of previous courses we got used to, like the original Machine Learning course.

By Stuart H

•

Oct 14, 2021

A good introduction to the important details that go into training a neural network and why they are important. I appreciate how they explain it all from first principles, but I'm going to need to do some more courses to learn tensorflow.

By Faisal A

•

Aug 11, 2018

This course was better than the first course in the specialization. The assignments were more sophisticated (though repetitive at times) and required more thought and work. The only down side is the monotone way of presenting the material.

By Prashant M

•

Oct 25, 2017

Some lectures seem to have inconsistent/unexplained differences in the math written. For example, I am a bit confused as to whether normalization is done as (x - mean)/variance or (x - mean)/std.dev. Otherwise, excellent content as always!

By K S

•

Jun 5, 2021

In some other courses there was a pdf document at the end of the courses which very good if you want revisit them but in these courses its not available. Please make them available here which will be a very time saving for quick revisions

By Tianyi L

•

Nov 19, 2017

In overall, the course content is helpful and inspiring as normal, and can be used to real life straight away. However there are several typos/mistakes in the assignment, especially in assignment 3 which I had bad time to experience with.

By Rahul K

•

Jul 24, 2018

The best course in deep learning: Hyperparameter tuning, regularization and Optimization. The course is best among all the available courses over internet but it lacks availability of study materials (or reference to reading materials).

By Jairo L D A

•

Apr 24, 2018

Very good content. Professor Ng covers a lot of material in a gentle and steady way. A few errors in the assignment and less clarity on some texts and quiz make me give 4 stars, but overall it's a very useful, important course, I think.

By Jason A B

•

Sep 30, 2017

Great course for in-dept understanding of parameter tuning and optimization, +tensorflow. I would recommend increasing the complexity of the programming assignments. At this point we should be controlling more of the basic python setup.

By Giordano S

•

Sep 28, 2017

Maybe not as exciting as the first course of this series (Neural Networks and Deep Learning) as this one delves more in the "technicalities" of NN. The presentation of the topics, however, is always very clear and easily understandable.

By srinivasan v

•

Jan 8, 2018

Struggled a bit to grasp the batch nomalization, Initially Regularization was also hard to grasp the first time, subsequent viewing made it clear though but batch norm still is a bit hazy. I am happy though we are in to Tensorflow now.

By P.C. C

•

Feb 27, 2021

The material was excellent for this class and so were the lectures. I think more programming assignments could have been optimal though. There are so many concepts, and I think there are several pieces we didn't implement in practice.

By Tristan C

•

Apr 4, 2020

There were still a few times where I felt some clever editing could have hidden math errors but I felt the second part was already more polished and accessible than the first. I hope the rest of the series continues in this direction.

By daniele r

•

Jul 15, 2019

One of the best and most technical course in this Specialization: I enjoyed learning a lot on optimization algorithms. Really good practical hints on tuning and on bias variance analysis, that are very difficult to find in textbooks

By Anwesh J

•

Jul 18, 2020

Indeed this is an awesome course for any beginners in deep learning.One suggestion could be is why you have selected Tensorflow framework.Will it be possible to get same assignment in Pytorch framework which out institiute follows.

By Charles S

•

Nov 24, 2017

This course was excellent, however the Tensor flow at the end feels a little bit like the ML field is quickly being overtaken by the frameworks, and the Tensor flow section is a little bit tacked onto this course, maybe in a hurry.

By Ashok T

•

Dec 31, 2019

Interesting practical suggestions regarding hyperparameter tuning and batch normalization, it could be more mathematical with more programming assignments with the effects of tuning. The TF framework was kind of surprise in Week 3

By il K

•

Mar 9, 2018

As always, great course from Andrew: easy to be understood, useful trainings and exercices. The lecture are explained slowly and repeating the important concept, always a good think.

Thanks! I will proceed with my Specialization :)

By Federico A

•

May 29, 2020

The content of the course is excelent and the practice exercises very interesting and helpful. I feel there is missing a written resume of the concepts after each video, or a hand-in of the powerpoint presentations would be nice.

By Shahar M

•

Apr 10, 2020

Pros: The course covers the basics for hyperparameters, tunning, regularization and optimization. The basics that it covers are well presented and explained.

Cons: A much more detailed and intense work with TensorFlow is needed.

By Paramjit S

•

Apr 13, 2019

The course is really good and the explanation by Dr Ng is exhaustive. But I think the assignments were meant for beginner level. You will not be implementing any function instead you be writing the underlying formulas. That' it.

By Hamza M K

•

Jun 26, 2018

This is another great introduction to Depp learning frameworks apart from all the neural network performance upgrading techniques taught. This is an excellent course for building a strong foundation of deep learning fundamentals

By Zahid S

•

Mar 16, 2019

This course was mostly well-designed especially for the first topics, but in my view, the Tensorflow part needs to be extended. It provided a brief understanding of the topics, but I do believe deeper examples might be helpful.

By Joris

•

Feb 10, 2018

better than the first course since it involved breaking into new stuff w.r.t the Stanford Machine Learning course.. However, altogether not yet challenging enough to give 5 stars

Really interested to go deeper into this matter..