What you will learn

• In-demand generative AI engineering skills in fine-tuning LLMs that employers are actively seeking

• Instruction tuning and reward modeling using Hugging Face, plus understanding LLMs as policies and applying RLHF techniques

• Direct preference optimization (DPO) with partition function and Hugging Face, including how to define optimal solutions to DPO problems

• Using proximal policy optimization (PPO) with Hugging Face to build scoring functions and tokenize datasets for fine-tuning