• For Individuals
  • For Businesses
  • For Universities
  • For Governments
Coursera
  • Online DegreeExplore Bachelor’s & Master’s degrees
  • MasterTrack™Earn credit towards a Master’s degree
  • University CertificatesAdvance your career with graduate-level learning
Careers
  • Log In
  • Join for Free
    Coursera
    Chevron Left
    Back to Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

    Learner Reviews & Feedback for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization by DeepLearning.AI

    Filled StarFilled StarFilled StarFilled StarFilled Star
    4.9
    stars
    63,379 ratings

    About the Course

    In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive
    performance and generate good results systematically. By the end, you will learn the best practices to train and develop test sets and analyze
    bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout
    regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms,
    such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a ne...
    ...

    Top reviews

    XG

    Oct 31, 2017

    Filled StarFilled StarFilled StarFilled StarFilled Star

    Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

    AS

    Apr 19, 2020

    Filled StarFilled StarFilled StarFilled StarFilled Star

    Very good course to give you deep insight about how to enhance your algorithm and neural network and improve its accuracy. Also teaches you Tensorflow. Highly recommend especially after the 1st course

    Filter by:

    276 - 300 of 7,273 Reviews for Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Ferry v A

    •

    Mar 22, 2021

    This course provides a good overview of the optimalization techniques for neural networks. It refers to both the basics by providing an explanation of moving averages, and the advanced by providing references to academic literature. Finally, it provides the rules of thumb that a practitioner needs when iterating models.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Rahul G

    •

    Apr 9, 2024

    The way these core concepts are covered making it super simple and easy to understand for anyone beginning to learn deep learning concepts. Also, the programming exercises that are curated for each concept that is being covered in the video lectures really gives you a practical exposure on the theory taught in classes.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Vlad M

    •

    Sep 7, 2018

    The course part is overall good.

    The last assignment can be improved in two key ways:

    The comment # Z3 = np.dot(W3,Z2) + b3 should be # Z3 = np.dot(W3,A2) + b3 - figured this out by myself without help from forums. :)

    Also, the Adam optimization is not very apparent in the instructions - searched in the forums for issues.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Adam F

    •

    Nov 1, 2021

    I completed the entire specialization and having nothing but good things to say. Highly recommend it! Lectures are engaging, and Andrew does a fantastic job explaining some very complex topics. Programming assignments are challenging in a good way. You’ll really feel like you’ve learned a lot by the time you’re done.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Evandro R

    •

    Oct 22, 2020

    Another wonderful course of this amazing specialization. I could say a lot of things, maybe even pages on how Professor Andrew it's the right person to teach you about Deep Learning but I'll shorten in this review and recommend the whole specialization for you! It's worthy and there's a lot of knowledge to be shared!

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Brad M

    •

    Aug 22, 2019

    In my deep learning classes in academia, hyperparameter tuning was always "hand-waved" away - my questions were always deflected, or put off. This class answered every one of my questions, and made me more confident I'd be able to implement a DL system in industry, and be satisfied with the results. Very good course!

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Zeinab B

    •

    May 4, 2020

    This course will cover everything you need regarding your neural network performance. I always had questions on why and when you use Adam, SGD, etc. and after this course, I have a much better understanding of how to choose hyperparameters and optimization methods. I highly recommend this course to ML practitioners.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Toby K

    •

    Nov 1, 2019

    I am working through the DL specialisation. Consistently good teaching style and the programming assignments are suitably pitched for getting the learner to pick up methods quickly e.g. Tensorflow syntax for self-application later. Good course and looking forward to the next in the series. Well done Andrew and team.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Ankur T

    •

    Nov 21, 2018

    word is not sufficient signup and experience it. For a deep learning beginner who already have math background can easily understand concept behind it but for implementation you need to refer extra materials on internet and book too. Andrew Ng explain only concept and recipe but for practice you will struggle hard.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Nhut D

    •

    Jun 26, 2021

    Great course! Help understand the mathematics and intuition behind hyperparameters and regularization methods. I feel the material is well-prepared. However, the last lab is quite confusing because I think we are not prepared enough about tensorflow fundamental throughout the course to really apply it in practice

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By afshin m

    •

    Feb 5, 2018

    This course is continuation and a requirement of the first course. Really like the learning style of how first course and the first 2 weeks of the second course taught neural networks by doing all the math and calculations manually and finally introduced Tensorflow with parallels of what was taught in the class.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By arulvenugopal

    •

    Dec 17, 2017

    This is another excellent course in this specialization. I enjoyed the programming assignments. The instructions, tips made Tensor flow coding section to be easy . However, few blocks consumed more than few hours, due to placeholders. logic and the TF documentation is overwhelming. I am proceeding to next course.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Wei L

    •

    Aug 26, 2017

    This course is harder than the previous one. It teaches more details of tuning parameters and optimization in deep learning. In the end it also teaches tensorflow which is really helpful. It's like a programming course, nerally all the commands have been already provided, so it's not hard to get the code correct.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Muhammad T

    •

    May 26, 2020

    As usual, Andrew is a great instructor. He taught very complex concepts in very simple language and used notations that were easy to understand and were consistent throughout the length of the course. WOULD DEFINITELY RECOMMEND. I am hoping to complete the specialization in less than a month. 2 down, 3 to go!!!

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By 姜云鹏

    •

    Nov 21, 2017

    It is really good and teach me the basic understanding of DeepLearning back propagation and gradients optimization like Momentum, RMPS, Adam finally I learn how to use Tensorflow to train my model.

    But there are some mistakes in the assignments and also in the grade so that it costs me a lot of time but useless.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Mushfiqur R

    •

    May 3, 2020

    It was a good course on understanding various hyper-parameters, some regularization method, optimization of algorithms, various gradients and gradient checking, batch - mini batch, exponentially weighted average , some tuning algorithms and finally a small introduction to deep learning frameworks. RECOMMENDED!

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Vinodh R

    •

    Nov 12, 2017

    The course content was excellent. The only issue is that there were some glitches with the grading of the second week programming assignment, in that I could obtain the expected output, but with repeated submissions, there would be (different) sections which could not be graded due to unnamed technical issues.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Shubham S

    •

    May 8, 2021

    Amazing course by Andrew sir really helps understanding the mechanism of optimizing a machine learning model , the practices he taught will help me in speeding a better model with better accuracy .

    Thanks to Coursera and Andrew sir for sharing the knowledge and experience of various legends of machine learning

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Muhammad A k

    •

    Apr 6, 2020

    5/5.Thank you sir for helping me in my career.I recommend everyone to go through this course if you really want to learn detail about hyper parameter tuning , optimizers and regularization used to make neural network better. It helps to open black box of Neural network and know in detail about how all works.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Renato L

    •

    Jul 3, 2019

    Excellent content and very well explained. Thanks for this amazing course.

    The course cover the building blocks of a Neural network. Andrew (and his team) did a great job by organizing the content in an evolving way in which you have the chance to build the knowledge from each piece of a (deep) Neural Network.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Bryan H

    •

    May 29, 2018

    Practical programming lessons, and well-paced enjoyable lectures.

    Comments:

    Move tutorials on TensorFlow to Course 3, which was the most obscure part of the course. TensorFlow isn't as intuitive as other numerical toolboxes, so spending more time on the foundations of TensorFlow might reduce the learning curve.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Megha G

    •

    Oct 25, 2020

    Intuitive, in-depth (while not losing the big picture), engaging and well structured, with amazing assignments to revise and solidify everything you learn in the videos. These courses are awesome! Just one suggestion: It might have been nice to have more intuitions on BatchNorm in the assignments. Thank you!

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By LIUZHENTAO

    •

    Sep 5, 2020

    A wonderful AI course! In most Ai courses we could only learn some specific algorithms. In this course, however, we could learn beyond AI itself. There are many practical AI skills in this course like hyperparameter tuning, regularization method and optimization strategies! I benefit a lot from this course!

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By Mojtaba H

    •

    Feb 11, 2020

    It covers very good tips and tricks to build and enhance deep learning model.

    Andrew is the best teacher for ML and Deep Learning, he covers all theory and practice simultaneously.

    In this course you can understand all mathematical intuitions and implementation of neural network from scratch by your own codes.

    Filled StarFilled StarFilled StarFilled StarFilled Star

    By B G

    •

    Sep 14, 2020

    Another great class taught by the incredible Prof. Ng! I have to admit there were time I felt a bit overwhelmed but by the time the course came to an end, I felt like everything "clicked". Very much looking forward to the next course and can't wait to dive deeper in ML frameworks. TensorFlow, here I come :D

    • Chevron Left
    • 1
    • ...
    • 7
    • 8
    • 9
    • 10
    • 11
    • 12
    • 13
    • 14
    • 15
    • 16
    • ...
    • 291
    • Chevron Right

    Coursera Footer

    Technical Skills

    • ChatGPT
    • Coding
    • Computer Science
    • Cybersecurity
    • DevOps
    • Ethical Hacking
    • Generative AI
    • Java Programming
    • Python
    • Web Development

    Analytical Skills

    • Artificial Intelligence
    • Big Data
    • Business Analysis
    • Data Analytics
    • Data Science
    • Financial Modeling
    • Machine Learning
    • Microsoft Excel
    • Microsoft Power BI
    • SQL

    Business Skills

    • Accounting
    • Digital Marketing
    • E-commerce
    • Finance
    • Google
    • Graphic Design
    • IBM
    • Marketing
    • Project Management
    • Social Media Marketing

    Career Resources

    • Essential IT Certifications
    • High-Income Skills to Learn
    • How to Get a PMP Certification
    • How to Learn Artificial Intelligence
    • Popular Cybersecurity Certifications
    • Popular Data Analytics Certifications
    • What Does a Data Analyst Do?
    • Career Development Resources
    • Career Aptitude Test
    • Share your Coursera Learning Story

    Coursera

    • About
    • What We Offer
    • Leadership
    • Careers
    • Catalog
    • Coursera Plus
    • Professional Certificates
    • MasterTrack® Certificates
    • Degrees
    • For Enterprise
    • For Government
    • For Campus
    • Become a Partner
    • Social Impact
    • Free Courses
    • ECTS Credit Recommendations

    Community

    • Learners
    • Partners
    • Beta Testers
    • Blog
    • The Coursera Podcast
    • Tech Blog
    • Teaching Center

    More

    • Press
    • Investors
    • Terms
    • Privacy
    • Help
    • Accessibility
    • Contact
    • Articles
    • Directory
    • Affiliates
    • Modern Slavery Statement
    • Manage Cookie Preferences
    Learn Anywhere
    Download on the App Store
    Get it on Google Play
    Logo of Certified B Corporation
    © 2025 Coursera Inc. All rights reserved.
    • Coursera Facebook
    • Coursera Linkedin
    • Coursera Twitter
    • Coursera YouTube
    • Coursera Instagram
    • Coursera TikTok
    Coursera

    Sign up

    Learn on your own time from top universities and businesses.

    ​
    ​
    Between 8 and 72 characters
    Your password is hidden
    ​

    or

    Already on Coursera?


    I accept Coursera's Terms of Use and Privacy Notice. Having trouble logging in? Learner help center

    This site is protected by reCAPTCHA Enterprise and the Google Privacy Policy and Terms of Service apply.