Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,068 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

YL

Invalid date

very useful course, especially the last tensorflow assignment. the only reason i gave 4 stars is due to the lack of practice on batchnorm, which i believe is one of the most usefule techniques lately.

NC

Invalid date

Yet another excellent course by Professor Ng! Really helped me gain a detailed understanding of optimization techniques such as RMSprop and Adam, as well as the inner workings of batch normalization.

Filter by:

6076 - 6100 of 7,238 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Konstantinos K

•

Aug 6, 2020

The course is great!

It really helps in understanding how the algorithms work, under the hood and the implementation tips

are very helpful! (This is visible in both the Optimization and Batch Normalization algorithms sections)

It is awesome that a programming framework is also introduced in the course, Tensorflow. But to be honest PyTorch could be also introduced, in order to select the framework in which the student could implement the last programming assignment.

By Joshua H

•

May 17, 2020

The content covers a wide variety of useful topics in deep learning. Andrew's explanations are sufficient, as are his use of both examples and analogies. I was only slightly disappointed to see that he has left the derivation of the equations governing back propagation along a batch normalized neural network as an exercise to his audience. The quizzes were sufficiently challenging, and the programming exercises were either informative or insightful, or both.

By dheeraj i

•

Sep 25, 2017

I felt this interesting but bit easier compared to the first course. Please don't provide the parameters of a method directly in the description above. I want to learn how this method can be executed by thinking and understanding the parameters I have to pass to this method. So, I felt the tensorflow assignment little straight forward. But overall a very good course. I need to practice a lot to actually understand and write the code from scratch. Thank you.

By Jian L (

•

Sep 4, 2018

I wish to give 4.5 instead. The only pitfall is the whole video series have a high frequent sound which keep distracting me when try to concentrate to the content.

content vise is very good. Coding practice is very helpful in understand the process. However there is only a basic level. With giving too much help on the background, it's very easy forget afterwards. May be a suggestion more practice would be better.

After all, it's the best course in DL for me.

By John C

•

Nov 6, 2020

The number of mathematical symbols grows quickly, and I started getting a little lost trying to remember which Latin or Greek symbol meant what and in which context. Still, I think that I've learned enough about overfitting (bias), underfitting (variance), regularization, adaptive learning rates, and normalization that I'll at least have the concepts in mind moving forward, even if I didn't memorize the equations and code necessary to do it from scratch.

By Bruce W

•

Jun 23, 2020

This was a good course to deal with some of the inner working of the machine learning and neural network models. It was good to see one of the existing frameworks (TensorFlow); although, I find it to be more difficult to configure than Torch (PyTorch). And it was unclear from the lab whether or not this framework was using GPU acceleration; although, this could probably be determined with a little research and experimentation in the lab environment.

By Steve I

•

Sep 26, 2019

This is a great overview for those wanting their neural networks to run more effectively and efficiently. Lots of ideas to improve your networks. The documentation and description of Tensorflow for the exercises is inadequate to be able to diagnose errors in the "expected" code without expert assistance. When debugging Tensorflow for these exercises, its almost a Trial and Error exercise instead of using first principles taught in the presentations.

By Mats K

•

Jan 29, 2021

The material is very interesting, but a little light on the mathematics, which I personally would enjoy seeing more of. I would like to see more elaborations and proofs, but they can be optional. A little too much hand-holding in the assignments. Learning to find relevant information is part of the training and as a programmer I find that the assignments consists of a lot of cutting and pasting snippets of code from the instructions in the notebooks.

By Robert S

•

Jun 15, 2021

A great follow-up to the first course in the specialization. Answers a lot of questions that might have occurred to you while taking the first course.

Compared to university courses I have taken, this one feels to me as if it is taught at about a second year level. As such, keep in mind that to fully absorb the material you will need to do more than just follow along, you will need to practice on your own by finding or creating your own problems.

By Marcello

•

Nov 29, 2023

The content of the course is very good and well explained, only this would be 5 stars. I gave only 4 stars because all the lessons are video lessons. Even though there is a transcript, the text is not well formatted and it does not underline core concepts, math formulas, code snippets, etc. So if you prefer a text lesson, it is hard to read, and you still rely on the video because the teacher writes many explanations on the whiteboard.

By Calvin K

•

Mar 4, 2018

Love the orthogonalization part and the explanation on why training deep neural networks is possible (local minimum is rare in hyperspace; for the most part there are saddle points). Tho I was hoping there would be some advice on how to design a neural network. Overall I think it's a bit too easy for those who have already known deep learning or taken Ng's Machine Learning course. It'd be great if the homework would be more challenging.

By Daniel R

•

Dec 18, 2019

Similar to my previous review in 'Neural Networks and Deep Learning', I found this course to be particularly good. It improved on the vanilla model introduced in Course 1, strengthening notions of tuning and regularization. I found it to be quite useful. My only complaint is that the assignments are similarly too much 'hand-holding' so I would advise those performing the assignments to try to develop some of the functions from scratch.

By Agustín D

•

Mar 17, 2018

You can learn a lot of topics related to deep learning algorithm optimization. All of them are explained in great detail, but the last assignment with TensorFlow was a bit confusing because of its own structure, not the instructor's fault. Also there was not an explicit motive why they chose to explain with TensorFlow.

Besides that, the course was very nutritious and I feel more confident about deep learning after completing the course.

By Kryštof C

•

Nov 7, 2018

In comparison with the first course of Deeplearning.ai , this course was a bit shallow in some topics. I would for example divide first and third week int two parts and add little bit deeper information. On the other hand, it was still very informative. The course provide very nice probe to optimization techniques of training DNNs. I would recommend this course to everyone, who wants to expand the basic knowledge of Neural Networks.

By Mike G

•

Mar 1, 2021

As someone new to deep learning I found this course to be a little more abstract than the first course. I did learn a lot about the subject matter and it puts me in a good spot to dig for more information on the subject. I really enjoyed getting exposed to TensorFlow and learning about all of the other frameworks available out there to make using DL techniques much more approachable for folks without advanced degrees.

Thank you!

By Ansgar G

•

Oct 17, 2019

Andrew Ng is great again. Also the assignments are good with very good explanations for each step in the notebooks. The TensorFlow programming assignment at the end could have gone a bit deeper, with more explanations for things that are used in the end like eval. And it had an error as the third parameter of tf.one_hot is not (anymore?) the shape. You have to explicitly pass it as tf.one_hot(indices, depth, shape=shape).

By RB

•

Jan 22, 2018

Good course, but the standard is not up to par compared to Course 1 and the ML course. The Week 3 Tensorflow assignment has a few mistakes and some of the code seems redundant (probably because the code was updated and the old ones were not removed), which makes it a bit hard to follow. Also the code could do better with the comments for elaboration, but nothing you can't figure out yourself using online resources. Regard

By Nikolai K

•

Feb 18, 2023

Lectures are really good.

Practical assignments are not challenging at all, the answers are given in problem formulations.

The last week dedicates 20 minutes to Tensorflow and is extremely superficial. I dont understand why tensorflow is even addressed in this course, given the miserable amount of information about it that is presented in the course. I hope tensorflow will be used in later courses of the specialization

By Tom A

•

May 8, 2022

First, I love these courses from Dr. Ng. They're great. I think this one was also very good and I learned a lot when we were working in numpy. Unfortunately, I really didn't feel like the Tensorflow exercise was helpful. I got through the exercise and feel like I did little more than cut and paste. I don't know what any of those functions really do even after reading the reference documentation.

By Samuel C

•

Oct 12, 2018

Great course, although I felt that introducing TensorFlow in week 3 was quite ambitious. I think it would have been better to have an additional week, during which we could have just learnt about TensorFlow. I found the third week challenge difficult, because I didn't know why we were using some of the functions, and it took me a while to figure it out - and I'm still not certain why what I did worked

By Farzeen H

•

Mar 25, 2018

I would love to give 5 stars but I have reduced one because of the typos in the assignments. I 'managed' to waste my time to check my code many times as my answer was not matching the expected output. Later I figured out that there was an error in the expected output.

As a course, it gives a thorough understanding of playing around with hyperparameters and fine tuning the NN to get better accuracy.

By Jerry H

•

Nov 27, 2017

As usual, the course material, videos and programming assignments were excellent. However, as I am currently not utilizing large datasets, the material on Batch Normalization and Hyper-parameter tuning is not useful to me ( now and in the foreseeable future). The introduction to TensorFlow and the tutorial was very useful, and has certainly whetted my appetite.

Look forward to the next course.

By Kamran K

•

Apr 11, 2021

Very good lecturer, but there have to be some ready-made slides also for those who can not take notes during lecture, because my self taking notes also, and can not carrying both listening to lecture and taking notes.

Please Andrew Ng sir!

Make some slides, with a few details for studying whenever facing problems and clearing doubts in the future. please sir

Thank You

Sincerely yours

Kamran Khan

By Ashwani S

•

May 6, 2020

Mentors don;t seem to collaborate, its been 3 days i posted a question in discussion forums but no reply has been received yet. It was a terrible experience. If you got stuck at a problem then only way is to get help from other students because mentors don't give a shit, about your course. I have given a rating of 4.0 only for the teacher Andrew Ng Sir. His teaching style is very impressive.

By Tim C

•

Jan 22, 2018

Good course that covers a lot of practical topics that are rarely given much consideration in an academic setting. Be careful in week 3 as there are a couple of mistakes that someone who has gotten to this point should catch, but it is possible that they will slip by. Overall though, another great class from deeplearning.ai where I learned a huge amount that has a very practical application.