The demand for technical gen AI skills is exploding. Businesses are hunting hard for AI engineers who can work with large language models (LLMs). This Generative AI Engineering and Fine-Tuning Transformers course builds job-ready skills that will power your AI career forward.
Generative AI Engineering and Fine-Tuning Transformers
Generative AI Engineering and Fine-Tuning Transformers
This course is part of multiple programs.
Instructors: Joseph Santarcangelo +2 more
Included with 
Gain insight into a topic and learn the fundamentals.
Intermediate level
Recommended experience
7 hours to complete
3 weeks at 2 hours a week
Flexible schedule
Learn at your own pace
What you'll learn
Sought-after job-ready skills businesses need for working with transformer-based LLMs for generative AI engineering... in just 1 week.
How to perform parameter-efficient fine-tuning (PEFT) using LoRA and QLoRA
How to use pretrained transformers for language tasks and fine-tune them for specific tasks.
How to load models and their inferences and train models with Hugging Face.
Skills you'll gain
- Category: Fine-tuning LLMs
- Category: LoRA and QLoRA
- Category: Pretraining transformers
- Category: PyTorch
- Category: Hugging Face
Details to know
Shareable certificate
Add to your LinkedIn profile
Recently updated!
September 2024
Assessments
4 assignments
Taught in English
Build your subject-matter expertise
This course is available as part of
When you enroll in this course, you'll also be asked to select a specific program.
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review
There are 2 modules in this course
In this module, you will be introduced to Fine Tuning. You’ll get an overview of generative models and compare Hugging Face and PyTorch frameworks. You’ll also gain insights into model quantization and learn to use pre-trained transformers and then fine-tune them using Hugging Face and PyTorch.
What's included
5 videos4 readings2 assignments4 app items
In this module, you will gain knowledge about parameter efficient fine-tuning (PEFT) and also learn about adapters such as LoRA (Low-Rank Adaptation) and QLoRA (Quantized Low-Rank Adaptation). In hands-on labs you will train a base model and pre-train LLMs with Hugging Face.
What's included
4 videos4 readings2 assignments2 app items4 plugins
Instructors
Joseph Santarcangelo
IBM
33 Courses1,670,573 learners
Offered by
IBM
Why people choose Coursera for their career
Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Frequently asked questions
It takes about 8 hours to complete this course, so you can have the job-ready skills you need to impress an employer within just one week!
This course is intermediate level, so to get the most out of your learning, you must have basic knowledge of Python, PyTorch, and transformer architecture. You should also be familiar with machine learning and neural network concepts.
This course is part of the Generative AI Engineering with LLMs specialization. When you complete the specialization, you will have the skills and confidence to take on job roles such as AI engineer, NLP engineer, machine learning engineer, deep learning engineer, data scientist, or software developer who want to apply seeking to work with LLMs.