40 ratings
3,105 already enrolled
Clean and preprocess text data for modeling
Create datasets for large-scale language generation
Fine-tune large-scale language model on small and niche task of generating recipes
In this 2 hour long project, you will learn how to preprocess a text dataset comprising recipes, and split it into a training and validation set. You will learn how to use the HuggingFace library to fine-tune a deep, generative model, and specifically how to train such a model on Google Colab. Finally, you will learn how to use GPT-2 effectively to create realistic and unique recipes from lists of ingredients based on the aforementioned dataset. This project aims to teach you how to fine-tune a large-scale model, and the sheer magnitude of resources it takes for these models to learn. You will also learn about knowledge distillation and its efficacy in use cases such as this one. Note: This course works best for learners who are based in the North America region. We’re currently working on providing the same experience in other regions.
Python Programming
Machine Learning
Natural Language Processing
In a video that plays in a split-screen with your work area, your instructor will walk you through these steps:
Introduction to the task and demo
Exploratory data analysis and visualizations
Dataset preparation
GPT-2 theory and related machine learning concepts
Model training on Google Colab
Evaluating model performance empirically
Your workspace is a cloud desktop right in your browser, no download required
In a split-screen video, your instructor guides you step-by-step
by RM
Apr 20, 2022Really fun project with knowledgeable instructor. Highly recommended. :)
by RR
Aug 24, 2020Excellent hands-on experience on how to do use big Models like GPT-2
by DM
Aug 29, 2020Thank you for your efforts but resources of this course not available once the course have completed!!
By purchasing a Guided Project, you'll get everything you need to complete the Guided Project including access to a cloud desktop workspace through your web browser that contains the files and software you need to get started, plus step-by-step video instruction from a subject matter expert.
Because your workspace contains a cloud desktop that is sized for a laptop or desktop computer, Guided Projects are not available on your mobile device.
Guided Project instructors are subject matter experts who have experience in the skill, tool or domain of their project and are passionate about sharing their knowledge to impact millions of learners around the world.
You can download and keep any of your created files from the Guided Project. To do so, you can use the “File Browser” feature while you are accessing your cloud desktop.
Guided Projects are not eligible for refunds. See our full refund policy.
Financial aid is not available for Guided Projects.
Auditing is not available for Guided Projects.
At the top of the page, you can press on the experience level for this Guided Project to view any knowledge prerequisites. For every level of Guided Project, your instructor will walk you through step-by-step.
Yes, everything you need to complete your Guided Project will be available in a cloud desktop that is available in your browser.
You'll learn by doing through completing tasks in a split-screen environment directly in your browser. On the left side of the screen, you'll complete the task in your workspace. On the right side of the screen, you'll watch an instructor walk you through the project, step-by-step.
More questions? Visit the Learner Help Center.
