This course is part of the Deep Learning Specialization

4.8
stars
29,172 ratings

Andrew Ng +2 more instructors

Top Instructors

360,111 already enrolled

Offered By

Deep Learning SpecializationDeepLearning.AI

About this Course

433,732 recent views

In the fifth course of the Deep Learning Specialization, you will become familiar with sequence models and their exciting applications such as speech recognition, music synthesis, chatbots, machine translation, natural language processing (NLP), and more. 
By the end, you will be able to build and train Recurrent Neural Networks (RNNs) and commonly-used variants such as GRUs and LSTMs; apply RNNs to Character-level Language Modeling; gain experience with natural language processing and Word Embeddings; and use HuggingFace tokenizers and transformer models to solve different NLP tasks such as NER and Question Answering.

The Deep Learning Specialization is a foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to take the definitive step in the world of AI by helping you gain the knowledge and skills to level up your career.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Coursera Labs

Includes hands on learning projects.

Learn more about Coursera Labs

Course 5 of 5 in the

Deep Learning Specialization

Intermediate Level

Intermediate Python skills: basic programming, understanding of for loops, if/else statements, data structures
A basic grasp of linear algebra & ML

Approx. 37 hours to complete

English

Skills you will gain

Natural Language Processing
Long Short Term Memory (LSTM)
Gated Recurrent Unit (GRU)
Recurrent Neural Network
Attention Models

Flexible deadlines

Reset deadlines in accordance to your schedule.

Shareable Certificate

Earn a Certificate upon completion

100% online

Start instantly and learn at your own schedule.

Coursera Labs

Includes hands on learning projects.

Learn more about Coursera Labs

Course 5 of 5 in the

Deep Learning Specialization

Intermediate Level

Intermediate Python skills: basic programming, understanding of for loops, if/else statements, data structures
A basic grasp of linear algebra & ML

Approx. 37 hours to complete

English

Instructors

Instructor rating

4.92/5 (2,315 Ratings)

Offered by

DeepLearning.AI

Syllabus - What you will learn from this course

Content Rating94%(40,446 ratings)

Week1

Week 1

12 hours to complete

Recurrent Neural Networks

12 hours to complete

12 videos (Total 112 min), 4 readings, 6 quizzes

12 videos

Why Sequence Models?2mNotation8mRecurrent Neural Network Model16mBackpropagation Through Time6mDifferent Types of RNNs9mLanguage Model and Sequence Generation12mSampling Novel Sequences8mVanishing Gradients with RNNs6mGated Recurrent Unit (GRU)16mLong Short Term Memory (LSTM)9mBidirectional RNN8mDeep RNNs5m

4 readings

Clarifications about Upcoming Gated Recurrent Unit (GRU) Video1mClarifications about Upcoming Long Short Term Memory (LSTM) Video1mHow to Download your Notebook2mHow to Refresh your Workspace5m

1 practice exercise

Recurrent Neural Networks 50m

Week2

Week 2

9 hours to complete

Natural Language Processing & Word Embeddings

9 hours to complete

10 videos (Total 99 min), 1 reading, 4 quizzes

Week3

Week 3

9 hours to complete

Sequence Models & Attention Mechanism

9 hours to complete

10 videos (Total 98 min), 2 readings, 4 quizzes

10 videos

Basic Models6mPicking the Most Likely Sentence8mBeam Search11mRefinements to Beam Search10mError Analysis in Beam Search9mBleu Score (Optional)15mAttention Model Intuition9mAttention Model12mSpeech Recognition8mTrigger Word Detection4m

2 readings

Clarifications about Upcoming Attention Model Video 10mInstructions If You Are Unable to Open Your Notebook10m

1 practice exercise

Sequence Models & Attention Mechanism 50m

Week4

Week 4

8 hours to complete

Transformer Network

8 hours to complete

5 videos (Total 42 min), 4 readings, 3 quizzes

Reviews

4.8

3537 reviews

5 stars
83.59%
4 stars
13.08%
3 stars
2.56%
2 stars
0.47%
1 star
0.28%

TOP REVIEWS FROM SEQUENCE MODELS

by SBFeb 18, 2018

Loved the course - it was very interesting. It is also pretty complex, so will probably go through it again to review the concepts and how the models work. Thank you for this wonderful course series!

by SDSep 27, 2018

Great hands on instruction on how RNNs work and how they are used to solve real problems. It was particularly useful to use Conv1D, Bidirectional and Attention layers into RNNs and see how they work.

by NMFeb 20, 2018

Hope can elaborate the backpropagation of RNN much more. BP through time is a bit tricky though we do not need to think about it during implementation using most of existing deep learning frameworks.

by SSDec 14, 2018

Please work on getting the notebooks to work properly. Also very bummed that after canceling my subscription, I won't have access to my homeworks. You guys should give us lifelong access - we paid!

View all reviews

About the Deep Learning Specialization

The Deep Learning Specialization is a foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology.

In this Specialization, you will build and train neural network architectures such as Convolutional Neural Networks, Recurrent Neural Networks, LSTMs, Transformers, and learn how to make them better with strategies such as Dropout, BatchNorm, Xavier/He initialization, and more. Get ready to master theoretical concepts and their industry applications using Python and TensorFlow and tackle real-world cases such as speech recognition, music synthesis, chatbots, machine translation, natural language processing, and more. AI is transforming many industries. The Deep Learning Specialization provides a pathway for you to take the definitive step in the world of AI by helping you gain the knowledge and skills to level up your career. Along the way, you will also get career advice from deep learning experts from industry and academia.

Frequently Asked Questions

When will I have access to the lectures and assignments?
Access to lectures and assignments depends on your type of enrollment. If you take a course in audit mode, you will be able to see most course materials for free. To access graded assignments and to earn a Certificate, you will need to purchase the Certificate experience, during or after your audit. If you don't see the audit option:
The course may not offer an audit option. You can try a Free Trial instead, or apply for Financial Aid.
The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

More questions? Visit the Learner Help Center.

Sequence Models

About this Course

Skills you will gain

Instructors

Andrew Ng
Top Instructor

Kian Katanforoosh
Top Instructor

Younes Bensouda Mourri
Top Instructor

Offered by

DeepLearning.AI

Syllabus - What you will learn from this course

Recurrent Neural Networks

Natural Language Processing & Word Embeddings

Sequence Models & Attention Mechanism

Transformer Network

Reviews

TOP REVIEWS FROM SEQUENCE MODELS

About the Deep Learning Specialization

Frequently Asked Questions

Learn Something New

Popular Data Science Courses

Popular Computer Science & IT Courses

Popular Business Courses

Coursera

Community

More

Sequence Models

About this Course

Skills you will gain

Instructors

Andrew NgTop Instructor

Kian KatanforooshTop Instructor

Younes Bensouda MourriTop Instructor

Offered by

DeepLearning.AI

Syllabus - What you will learn from this course

Recurrent Neural Networks

Natural Language Processing & Word Embeddings

Sequence Models & Attention Mechanism

Transformer Network

Reviews

TOP REVIEWS FROM SEQUENCE MODELS

About the Deep Learning Specialization

Frequently Asked Questions

Coursera Footer

Learn Something New

Popular Data Science Courses

Popular Computer Science & IT Courses

Popular Business Courses

Coursera

Community

More

Andrew Ng
Top Instructor

Kian Katanforoosh
Top Instructor

Younes Bensouda Mourri
Top Instructor