Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,169 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

XG

Oct 30, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

HD

Dec 5, 2019

I enjoyed it, it is really helpful, id like to have the oportunity to implement all these deeply in a real example.

the only thing i didn't have completely clear is the barch norm, it is so confuse

Filter by:

151 - 175 of 7,253 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Jaime M

•

May 29, 2019

Very good course as well, although the exercises need some "debugging" there are some typos and errors. I found that the previous courses exercises where too guided, too easy in some points. In this case are more tricky, but not in the correct sense. I would orient a bit more the way of thinking or refer to external sources to get a bit more on track with TF before coding. Nonetheless, all in all, is a great course.

By Nancy H

•

Dec 26, 2022

Instructor Ng is great! The format(s) are wonderful. I appreciate the white board work and the follow up notes, pdf files for review.

Sometimes find quizzes are unecessarily tricky but it does make me review videos and pdf files, to my benefit.

Struggling with assignments, not bc of the theory but my limited knowledge of python. So hints for formats for new funactions very appreciated, like in assignment in week 3.

By Renzo B

•

Aug 27, 2019

It was a very insightful course. I learned the basic intuition behind the concepts that Andrew Ng explained. For my suggestions, maybe the deeper derivations and meanings behind the concepts could be discussed in video or just a reading material. For example with the maths behind regularization, batch normalization and etc. could be discussed more in depth in a reading material. All in all the course was excellent.

By Javier L M

•

Nov 15, 2023

It is a very interesting formation. I have rated 5-stars because I think that it is what it should get, but I have missed more examples during the formation. There is a huge difference in the level of understanding when an easy example is used to explain how a functionality works (for instance in the case of softmax) and when it is not used (which happens most of the time). Other than that, the formation is great.

By Mehedi H

•

Sep 23, 2017

Very good one. It was great pleasure to learn momentum , RMSProp and then coming to know how to combine them in Adam. Tensorflow example was great. In tensorflow exercise, using regularization can give a boost in the generalization of data which has been mentioned (and I tested it )-but this could have been a part of the exercise.

However, starting to audit the next course of this series. Best of Luck for me !! :D

By Mikhail G

•

Mar 7, 2020

Very nice course, worth taking for everyone who is interested in ML/Deep learning, including the very beginners and professionals. I work at the edge of Neuroscience/ML/AI, I have a strong theoretical ML background, but little practice. Even though I was familiar with many of the concepts before taking the course, it was still extremely useful to hear about it again and have way better understanding of the topic

By Artem V

•

Dec 22, 2022

The best course about deep learning and optimization I have found so far. Liked the explanations, Andrew Ng teaches you in such a way that you can implement all these concepts (such as gradient descent optimizations like Momentum or Adam, regularization techniques like L2 or dropout, etc.) yourself. If you want a clear understanding of how to improve your network learning, I would highly recommend this course.

By Chong O K

•

Oct 31, 2020

The course covers many regularization and optimization techniques of deep neural network. The instructor can explain the concept and theory of those techniques using easy-to-understand analogies and example. He also used visualisations like diagrams and charts to make the explanations intuitive. The assignments are very comprehensive and mimic real-world examples that let students build a very solid foundation.

By Ganesh S V M K

•

Aug 2, 2020

First of all, I would like to thank Coursera for providing the course. I would always be in debt to Coursera for providing me with financial aid. This website is one of the best online learning platforms. Love the way the assignments are provided. Even I have a bit of understanding and experience in deep learning, this course clears all the blue skies in between and makes deep learning looks simple to learn :)

By Lyle T

•

Sep 14, 2017

Very good in-depth coverage of mini-batch, ReLU, Adam, L2 and dropout regularization. Good overview of batch normalization. Brief but useful intro to Tensor Flow (including programming assignment). In general, the programming assignments are pretty easy, but a bit hard to debug in the Jupiter notebooks, though I was able to get things working by inspecting the code to locate typos.

Summary: Highly recommended

By Jonathan M

•

May 1, 2020

Builds upon the concepts that were explained in the first course in specialization and Andrew Ng's Machine Learning MOOC and really goes more into depth about regularization and optimization techniques. The introduction to frameworks at the end of the course does a great job of showing how this can apply to other concepts. The programming exercises and course material are great overall and very informative.

By Mich Z

•

Jul 15, 2019

This Course is really good for the beginner of NN and deep learning. It tells me what to consider and how to consider for model build-up. I also like the quiz which helps me to check my concepts understanding, the coding practice is easy to understand and I can logically learn how to practice my understanding of this session. I also love the interview session with DL Heroes. This course is really inspiring.

By Sakshar C

•

May 17, 2020

This course really helped me to get a proper hold on how to work with hyperparameter tuning in an organized and efficient way. I used to think of it as a "voodoo" magic, the way one can fall upon the exact set of values for hyperparameters. Now, I think that I have a better concrete idea of how to approach tuning for improving a neural network according to the available resources and also the applications.

By Marlon C

•

Sep 28, 2017

This course is AWESOME, a lot of new things related to Deep neural networks regularization techniques, initialization techniques and Tensorflow Neural Networks modeling. A step forward into mastering applied Artificial Neural Networks!! Course really recommended for ML/AI enthusiasts and begginer or promising researchers in the field. I recommend to take all the courses provided in this DL Specialization!!

By Kyle W

•

Aug 15, 2017

Great course. I'm particularly happy that they chose to teach TensorFlow. There were a number of typos/errata, which is to be expected with such a new course, but it looks like they are working quickly to address them. Overall, I feel more confident implementing neural nets than I did after the original ML course taught by Andrew Ng.

Watching Andrew try to draw a horse in one a the lectures is a huge bonus.

By Rohit K

•

Jul 6, 2019

Hello Andrew, I am a big fan of you. Learning from your every course. Very unfortunate that I can do that remotely only.

One thing that I want to mention - Can we have lecture notes on coursera, just like the way used to in CS229 that we can read before coming to next lecture. I found that that was very useful in understanding when things get harder.

Thanks hope we can improve coursera in that matter.

By Surya N

•

Jan 3, 2022

Provides practical insights on ways to go about tuning hyperparameters and techniques to address overfitting, speeding up the training process. Examples and break down of concepts are quite helpful in internalizing different approaches, along with the quizes and assignments. Emphasizes the importance of tooling as well in increasing our productivity, which we seldom find in a typical academic setting.

By Soham J

•

May 8, 2022

This course needs only knowledge of course-1 of this specialization (neural networks and deep learning), the mathematical background required is not too much, and the instructor does a very good job at providing intuitions behind hyperparameter tuning and various optimization methods. Overall, I would recommend this course to anyone interested in learning more about the refinement of neural networks

By Itsido C A

•

Dec 16, 2019

This is a must to really understand and master the art of machine learning. With this course I understood that building a model and training it is not even half of the story of being a machine learning engineer, without knowledge of how to tune the models parameters you might not be able to deliver product on schedule. Thanks for Dr Andrew and the team for an awesome content and learning experience.

By sunshineren

•

Aug 31, 2019

It is really a EXTREMELY GOOD course for a bad-basic student, according this course, not only I have know the theories, but also the pratical project.I do think now I know the BN, the Hyperparameter, and the Regularization and so on in Deep Learning field! It would be very helpful for me to step into the AI!

and both videos and lectures are very important for new comers in deep learning ! THANKS ALOT!

By Nouroz R A

•

Sep 13, 2017

This is one of the best MOOC I have ever come up to. Very informative, well explained and easily put. This course helped me to learn so many new things that I had missed in books and research papers. Thanks Andrew Ng, this was like a debt to me. As a wannabe deep learning researcher/Engineer, your contribution to help me catch the basic concepts will always be remembered. :-)

Yes, highly recommended.

By Jake K

•

Nov 21, 2022

Another great course presented by Andrew Ng! It is a fantastic follow-up for the Neural Networks and Deep Learning course in the Deep Learning Specialization. It's a notable step up in difficulty, especially the final programming assignment, with minimal hand-holding compared to the previous course. If you got through the first course easily enough, then I imagine you'll do fine with this one too.

By ali m

•

Dec 28, 2020

It was a joyful experience, I've learned some amazing new ideas like exponentially weighted averages and Adam optimizer. I think Dr. Andrew is an amazing teacher, he teaches us some of his experience in the field so we could explore his way of thinking and learn too much from him. After all this course is very helpful to everyone starting a new journey in The Deep learning world so THANKS A LOT.

By Rohit

•

Jul 6, 2018

This course has really helped me alot in gaining better insights about improving deep neural networks by tuning the required hyperparameters. It has also increased my understanding of the previous course and I would definitely recommend this course. I would like to express my gratitude from the bottom of my heart to the Coursera team and the specialization course team for such an amazing course.

By XiaoLong L

•

Aug 14, 2017

After reading the Deep Learning book wrote by Ian Goodfellow, it's much more easy for me to complete this course within two days. I've gotten a lot through this course and know more detail about the deep learning hyperparameter tuning, regularization and optimization methods now. Thanks so much for Prof. Andrew and TAs. I will keep learning the 3rd course in this specification of deep learning.