Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,068 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

YL

Invalid date

very useful course, especially the last tensorflow assignment. the only reason i gave 4 stars is due to the lack of practice on batchnorm, which i believe is one of the most usefule techniques lately.

NC

Invalid date

Yet another excellent course by Professor Ng! Really helped me gain a detailed understanding of optimization techniques such as RMSprop and Adam, as well as the inner workings of batch normalization.

Filter by:

6276 - 6300 of 7,238 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Ralf S

•

Aug 28, 2019

Good course overall. but labs could be expanded. Don't know if the Coursera platform supports it, but labs between lectures about different topics would be nice instead of having all practical exercises at the end.

By Christoph D

•

Feb 3, 2018

Nice course, as always!

But I think the hyperparameter tuning methods are hopelessly outdated / missing the most promising current developments. A pity since this is such a central part of the actual work with DNNs!

By Yuvini S

•

Dec 10, 2019

You can get a better insight as to how to improve neural networks that go beyond the fundamentals. The quizzes and assignments helps you get a hands-on experience of the theoretical material covered in the course.

By Oriel B

•

Dec 5, 2019

Hi

I enjoy the course a lot!

for tensor flow - I am not sure if its me or the course - but I need much more training to start thinking the tensor flow way. maybe i will practice more on real work cases.

thanks !

Oriel

By Craig M

•

Oct 20, 2017

You've learned deep neural nets but on the first problem you apply them to they seem to not work or learn to slowly. Don't panic, all you may need is a little fine-tuning, that is what this course will teach you.

By Joakim P H

•

Sep 4, 2017

After this second course you will be able to start build things using Tensorflow. Really great to see how good this course is structured. Things from course one is comming back making it easy to grasp new content.

By Liuliu Q

•

Jan 28, 2019

Overall, the course is interesting and introduces systematically technical details. There are still some confusing part in the assignment. For example, the direction in the last assignment is kind of misleading.

By Amir H

•

Jun 25, 2019

The explanation and examples are very informative throughout the course. The quizzes and the assignments are highly related to the topics covered in the videos which provide a solid understanding of the course.

By Luca V

•

Jul 25, 2018

Some very interesting consideration, though I would have liked a section about reproducibility and randomisation (including for GPU trainining), though I understand that this is framework and language dependent

By Karl M

•

Nov 21, 2017

Some of the programming assignments are a bit confusing, and the grader seems to suffer from bugs at the moment. Nevertheless I found especially the part on optimization algorithms very helpful and interesting.

By Baris K

•

Jan 10, 2021

Maybe TF should be thought a little earlier with small exercises in the weeks 1 & 2. Also the final programming assignment should be improved. The seed initialisation at the Xavier initializer is ambiguous.

By William R

•

Oct 1, 2017

The insights and intuitions Andrew communicates are good, but as he starts to point out towards the end of this course, in practice one uses a DL Framework and you don't code these things from the ground up.

By Martijn v d G

•

Jan 5, 2021

The level of detail in this course really leads to a good understanding. A bit more programming exercises with TensorFlow (more than a single model) would be good to understand the intricacies a bit better.

By Armaan B

•

Aug 15, 2019

Extremely well designed course, the key reason for 4 stars is Andrew Ng's amazing leactures. The programming assignment though do quite a bit of handholding which can be reduced.

Amazing experience overall!

By Haiwen Z

•

Jun 16, 2019

The course is great for beginners, and I'll recommend watch the vid with Deep Learning on MIT Press. The only cons for me is that subtitle is toooo big, I wish I can change the font size on the vid setting.

By Gianluca M

•

Mar 14, 2018

Very short, but very interesting. Some more advanced topics are presented that students don't typically learn on coursera courses, such as improvements to gradient descent, batch normalization, and dropout.

By Philip D

•

Jan 15, 2020

Good course, not quite as intuitive as the first course in the specialisation 'Neural Networks and Deep Learning' but still very good. Its also great to have some exposure to Tensorflow through the course,

By Arsen K

•

Sep 11, 2017

Great course. One star was taken off, as I would like to see more in-depth info on Batch Norm and a bit more discussion on how to compute gradients in case that is used. But generally that's a minor detail

By Oliver K

•

Apr 9, 2021

The course is a good continuation of the first one. Only criticism is that it uses an out of date version of tensorflow as the final assignment. It has a completely different syntax to modern tensorflow.

By Avi v

•

Jan 3, 2021

This was a great course....but at some places I felt that the details have been hided a little....only in few videos.........but overall it was a great course.....best of the courses...I have ever seen ..

By Ashwin A R

•

Jan 27, 2020

This course helped in deepening knowledge about optimization techniques and how they could make ML/DL algorithms robust while training. This also provides a good introduction to the Tensor flow framework.

By Charles H

•

Nov 8, 2019

The lectures are all really good, but the programming assignments feel like they hold your hand too much. It's very easy to sort of slide through them without having a good understanding of the material.

By Aditya K

•

Mar 22, 2020

Everything till now was good, But I can't tell why my forward propagation method is rejected although it matches the expected output. So my marks were deducted for it without any reasonable explanation.

By Vu N M

•

Oct 25, 2018

A bit boring with this course at the first sight, but later when you work with the real system, this course can be a bible for you. The valuable experiences from Andrew Ng are shared through this course

By Gillian P

•

Mar 2, 2018

Though very good, his course might be a little less polished than the previous. One more week diving into frameworks would (maybe keras to see a more functional level of Framework) would be appreciated.