Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,169 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

XG

Oct 30, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

HD

Dec 5, 2019

I enjoyed it, it is really helpful, id like to have the oportunity to implement all these deeply in a real example.

the only thing i didn't have completely clear is the barch norm, it is so confuse

Filter by:

476 - 500 of 7,253 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Filipe C d L D

•

Jun 4, 2020

Excelente curso que explora o ajuste fino dos hiper-parâmetros, Regularização e Otimização dos modelos de Deep Learning. Recomendo fortemente este curso, pois o professor possui uma excelente didática e os exercícios são muito claros e objetivos.

By Jason M

•

May 28, 2020

The course material was very good. The only issue I had was that the system seemed to go down once in a while, and I would have to exit and sign back into Coursera. Restarting the kernel didn't help. This would sometimes cause me to lose work.

By ashu a

•

Apr 20, 2020

considering the topics that are covered those are very good and detailed and as a beginner those are required to be known to every individual , especially professor andrew has put a lot of efforts in designing the course it seems , it's very nice

By Geoff L

•

Aug 29, 2019

Thanks to the instructor and the team for creating an excellent and rigorous online course. I particularly enjoyed learning the ADAM optimizer from the ground up. The quizzes and programming assignments are also challenging and fun. Thanks again!

By Gilberto B

•

Jan 21, 2018

This course teaches how to organise training in a structured and systematic way without doing things so complicated. Also very good introduction to tensorflow a library that any data scientist that is serious about deep learning should now about.

By Mohamed E

•

Dec 29, 2017

Very useful course which helped me to organize my thoughts about how to select the model hyperparameters, how to extended the network for multiple outputs using the softmax function. Additionally the Tensorflow lab was very helpful as jump start.

By Umang R

•

Jun 9, 2020

After Completing this course I can now understand some of the secrets of Regularization, Batch Normalization, Learning Rate and many more thing related to Deep Learning.Assignments are very relatable to explore what you just learn in every week.

By Milton M

•

May 27, 2020

Legendary Andrew Ng strikes again! Great chapter of this Deep Learning Specialisation! Good balance of theory and must-know concepts for improving neural networks! I especially appreciated the optimization part and the tensorflow coding exercise

By Dareer A M

•

May 20, 2020

After completion of this course, I knew what I have to do to make my neural network to perform better and how to avoid over-fitting. And what range of values and techniques, I can use/check and how I will set my hyper-parameter more effectively.

By Kaveh H

•

May 18, 2018

This is awesome.

Andre Ng gives great lectures, the practical exams are easy to follow and no installation of software and other annoying bumps on the road as everything you need is running smoothly using Jupyer notebooks on preinstalled servers!

By Ankit S

•

Jun 19, 2020

This was the best course of this series as I have observed it was awesome to learn various normalization techniques and then implement them form the scratch and then the various optimizer. But in the last programming exercise the task was less.

By Lakshay

•

May 19, 2020

A important aspect of machine learning that is left untaught and ignored that is hyperparameter and optimization.This course cover them all and also the best practices .Deeplearning.ai specialization is really the best course I have ever taken.

By Gopinath

•

Dec 22, 2019

Contents are structured in a way that it is so easy to pick up. Programming exercises are exactly in the balance that is not too hard or it isn't too easy. Learned a lot in this course especially. Thank you so much for this excellent course !!!

By Vasileios I

•

Jun 18, 2019

A good summary of Hyperparameter tuning, Regularization and Optimization. One suggestion would be to extend this course for 1-2 weeks and emphasize more on the intuitions and mathematics behind the optimizers. But again, the videos are awesome.

By Fezan R

•

May 27, 2019

Simple and straight forward explanation of most helpful tools. Examples are well designed. However I feel that introduction to TensorFlow is very brief, it should have been more elaborative. Anyhow overall a well designed and well paced course.

By HEF

•

Mar 27, 2019

This course taught me a lot of things that I cannot usually find in a school curriculum, yet the content are extremely useful in helping me to accelerate my algorithms. This course is super important in handling deep learning projects, I think.

By srinath d

•

Dec 3, 2018

Another excellent course by Proffesor Ng. Lots of material to learn but neatly organized and extends the journey from the previous course. Lots of ML/DL terminology is clarified and their place and importance shown in this course. Very useful!!

By Michael D

•

Mar 21, 2018

Take this course if you want to know:

1). He Initialization

2). Adam Optimization

3). Batch Normalization

4). Softmax Activation (or regression)

5). Tensor-Flow for programming Deep-net.

It is an amazing course. It is well-structured and presented.

By Suvojeet D

•

Aug 25, 2021

Great course, learned a lot about hyperparamter tuning, different types of optimization methods, and regularization techniques. But, I felt more Tensorflow exercises are needed to get good grasp and use it smoothly to solve different problems.

By Diwakar P

•

Jul 6, 2020

This is just an amazing Courese in Deep Learning, about neural network optimisation by chosing optimum hyperparameter. I would recommend every boy who i really interested in learning the deep thought of deep learning to go through this course.

By TAN S Y

•

May 3, 2020

Understand well the fundamental and most of the hyper-parameters tuning mechanism and processes. The course has included some fundamental knowledge of using TensorFlow. It is well organized in the teaching processes and programming assignment.

By Teye B

•

Mar 27, 2018

Great Course. I especially like how the mathematics of Deep NNs are presented, taught and practiced, before the revelation of frameworks such as Tensorflow(in particular). This gives me a great understanding of what these frameworks are doing.

By Benny P

•

Feb 21, 2018

This course brings you all the details to make your neural network training works better (faster, more accurate, etc.). The materials are presented nicely (as usual), not only the formulas but also the intuition behind them as well. Very good.

By Azamat K

•

Aug 13, 2019

Really cool course, review what i knew already. In addition learn more common optimization algos (GD with momentum, RMSprop, Adam). Get the sense of approaching the most tricky part hyperparameters tuning. Nice and smooth intro to Tensorflow.

By Ganesh S

•

May 16, 2019

This course has been amazing. I have learning various interesting topics such as overfitting,techniques to avoid overfitting,Different optimizers and softmax regularization. Tensorflow framework is awesome. Looking forward to learn that too.