Chevron Left
Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

4.9
stars
63,169 ratings

About the Course

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow. The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

Top reviews

XG

Oct 30, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

HD

Dec 5, 2019

I enjoyed it, it is really helpful, id like to have the oportunity to implement all these deeply in a real example.

the only thing i didn't have completely clear is the barch norm, it is so confuse

Filter by:

251 - 275 of 7,253 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

By Virginia A

•

Apr 7, 2020

highly illuminating. Finally, with this second course, I could grab the deep concepts and consequences of many terms I heard so many times during talks between data scientists. I feel now I could easily use what learnt to participate actively to those meetings and practically try things out on my methods and make them perform better.

By Karan S

•

Apr 27, 2019

I'd been working on Neural network Models in my undergrad projects, but really couldn't answer much of the problems that I faced. The title isn't too appealing, because no new Network Architectures are taught, but in my opinion, this course is on par with the previous course on building Deep Networks from scratch. Highly Recommended.

By Anand K M

•

Feb 10, 2018

A very nice course providing intuitions and concepts for tuning the hyper parameters in a neural network.

Also, provides a taste of using Tensor Flow (Neural Network Framework) in a comprehensive manner.

I would give my deepest thanks to the instructor, Prof. Andrew Ng for his invaluable time for building the course for the learners.

By Senthil V V

•

Jun 25, 2020

Thank you so much Coursera for providing me such a good course. It was a great learning experience. The assignments and quizzes played an important role in improving my skills and giving me the confidence to implement deep NNs. I'll definitely recommend this course to others. Looking forward in doing more courses in deeplearning.ai

By OMAL P B

•

Feb 24, 2020

This is an wonderful course for people who want to learn about the ways to improve their models and make their best and more robust. Andrew Sir makes the math behind the scenes very easy to understand. The course is easy to follow as it gradually moves from the basics to more advanced topics, building gradually. Highly recommended.

By Tanveer M

•

Aug 27, 2019

Professor Ng's very clearly put a lot of thought into breaking down deep learning into the most understandable way for students around the world and it shows through the quality of this course. I cannot recommend this course enough to anybody who is looking to do machine learning, or simply understand the process from a high level.

By Murali T

•

Jan 14, 2021

As usual Andrew ng Course is Awesome.

A bit of more video expatiation is needed for Tensorflow.

Labs are really helpful.

It would be grateful if they had provided notes after each lesson like in the first course(probably 1st I guess) of Andrew ng Machine Learning .

That's it, overall it is really good and useful .Thank you Andrew Sir

By Satvik C

•

Sep 10, 2020

Andrew NG is such a fantastic teacher especially in this online mode. He provides crystal clear explanations and examples to understand why the methods work. As a learner I was only expecting to learn how to apply this to solve real problems and not to learn theoretical subtities, this is probably the best course in deep learning.

By Hari G S

•

May 13, 2020

Excellent course over all, but what I like the most is how the complex math behind all these techniques are carefully hid and instead, we're given an intuition about how these techniques work. Of course, for a deeper understanding much more mathematics is needed, but they make sure that everyone has an idea about why things work.

By Bernard O

•

Oct 23, 2018

The tips and great guidelines one gets from this course are gems in their own right. Practitioners in particular will get to appreciate all the usable advice to improve their neural networks and at the same time get to understand the principles behind the scenes on what truly drives those optimizations. Highly recommended course.

By Kristina S

•

Aug 15, 2018

The course material is detailed and comprehensive and presented in a very digestible way. I felt like the home works lack a few topics (e.g. learning rate decay implementation, which I would find to be a useful exercise), but they give you a good understanding of what is going on. All in all, I definitely recommend this course!

By Dinesh T

•

Feb 17, 2021

Improving DL Networks in fact improved my understanding of hyperparameter tuning, regularization and optimization. The quizzes helped me getting clarity and the assignment of tensor flow gave a good introduction using functions in the tensor flow. I really enjoy learning from Andrew and look forward deep diving farther into DL.

By Zhenwei Z

•

Mar 16, 2020

After learning the basic knowledge of the first course, this course deepened my understanding of deep learning, and explained how to optimize the model of deep learning from the perspectives of hyperparameter tuning, regularization and normalization, and finally provided the basic knowledge of the framework based on TensorFlow.

By Mahbubur R

•

Jun 6, 2018

From this course I have learnt several important hyper parameters, regularisation and optimization of deep neural network. Most importantly I got my first hand-on experience on Tensorflow framework by which creating deep net modes are quite easy if someone knows the elements of a deep net. I wish I will proceed for next course.

By Ian C

•

Oct 1, 2017

Learning about TensorFlow is brilliant. It's very hard to get a good understanding of what goes on in TensorFlow without fully understanding the neural network coding setup. This course beautifully combines the two. There were some minor frustrations with the final TensorFlow programming exercise, but overall this is excellent.

By Pawan S S

•

Jan 8, 2021

One of the rare courses teaching about structured hyperparameter tuning. All the subject matter are well taught and the flow of the module is very easy to follow and understand. Together with the programming assignments, I was able to quickly grab the essentials. I highly recommend this course for any deep learning enthusiast.

By Jeroen M

•

Jan 10, 2018

Great course, a few rough edges in the exercises and I also feel the exercise comments give away a bit too much (would be better if the student needed to figure out things by himself a little more). But these are minor details, I've learned a great deal in an amazingly short span of time, from one of the top minds in AI today!

By Jeff R

•

Oct 1, 2017

I appreciate the large amount of time that has gone into preparing this course. I note that there are a large number of corrections in the errata forum that have not been reviewed by staff. In particular there are some obvious errors in the programming assignments that could easily be corrected with a small investment in time.

By Pranshu A

•

Aug 22, 2020

Awesome, Amazing, Best, Fabulous course. Learnt a lot about Hyperparameter tuning and atlast got an intro about tensorflow framework which i wanted to start learning but earlier afraid from it's complexity which is explained so good in this course. Best course for Tensorflow Intro and Hyperparameter tuning in Neural Networks.

By Murat T

•

Dec 23, 2018

Topics cut in to sections are well defined and so clear. Programming assignments definitely gives you hands on experience. Also, math is demystified that you track with high school math. If you used framework like Keras and you want to know why and when you need to use that function,parameter etc., you would love this course.

By Gilles D

•

Sep 5, 2017

Eventually a clear and definitive explanation about Network initialization, regularization and optimization. Good insight share on hyper-parameters prioritization.

We learn the how and why and suddenly, it all becomes a little bit less mysterious. It is all clearly explained in a very accessible way.

Great value for my needs

By Xuefeng P

•

Aug 29, 2017

This course really gives you a fundamental and practical ideas about the hyper-parameters of DNN, and the way of tuning them. The part I liked most is the last programming assignment ---- play with Tensorflow!!! The assignment walks you through Tensorflow structure and basics in a very organized fashion.

Highly recommended!

By Akash K

•

Mar 20, 2021

Really enjoyed the course as it covered a lot of regularization and optimization techniques in depth. Programming assignments are really easy as it needed to write only few lines of code but serves its purpose and enforces the learnings from lectures. Highly recommended to get the exposure before starting your own journey.

By Ali n

•

Jul 7, 2020

Best course for learning Hyper parameter tuning, Regularization and Optimization topics further more the batch and other various optimization algos like momentum, Adam, Batch norm etc are much easier here. Please have a look on ground reality too, Take quiz before staring any course that this candidate is suitable or not

By Mihai L

•

Jan 21, 2018

This course is also interesting. The art of tuning hyper parameters and other optimization techniques are very interesting and nicely explained.

The introduction to Tensorflow and assignment is also interesting.Overall the difficulty is not high but the concepts are really powerful and important ,most scaffollding is done