The Fine-Tuning Image Models with Diffusion course is designed for developers, engineers, and technical product builders who are new to Generative AI but already have intermediate machine learning knowledge, basic Python proficiency, and familiarity with development environments such as VS Code, and who want to engineer, customize, and deploy open generative AI solutions while avoiding vendor lock-in.
The course gives learners hands-on experience adapting generative image models for custom styles and applications. The course begins with the foundations of diffusion models, explaining forward and reverse diffusion processes and exploring the key components of Stable Diffusion architectures, including U-Net, VAE, and text encoders. Learners then apply Low-Rank Adaptation (LoRA) techniques to train efficiently on consumer hardware, comparing performance and trade-offs with full fine-tuning. In the second module, learners implement DreamBooth, a methodology for training on limited datasets to personalize models with custom concepts and artistic styles. Learners practice dataset preparation, hyperparameter tuning, and checkpoint management while preserving model generalization.
The third module introduces ComfyUI, where learners design and execute node-based workflows that integrate fine-tuned models with advanced extensions like ControlNet. And, in the final module, learners will optimize fine-tuned diffusion models for production by systematically adjusting inference parameters to achieve optimal trade-offs between image quality, generation speed, and resource efficiency. By the end of the course, learners will have produced a custom fine-tuned diffusion model, integrated it into ComfyUI pipelines, and optimized it for production-quality image generation.
Learn the fundamentals of diffusion models and why they play such a critical role in modern image generation. You’ll explore the key architectural components of Stable Diffusion, U-Net, VAE, and text encoders, and see how LoRA adapts these models efficiently for fine-tuning. You’ll also analyze memory optimization techniques and compare LoRA with full fine-tuning approaches, giving you practical principles for deciding which method to use depending on your goals and constraints.
涵盖的内容
3个视频2篇阅读材料1个作业1个非评分实验室
显示有关单元内容的信息
3个视频•总计22分钟
Podcast: What Really Happens When You Fine-Tune a Diffusion Model •4分钟
How LoRA Connects to Stable Diffusion•7分钟
Training and Applying LoRA: Dataset Prep, Training Loop, and Inference•10分钟
2篇阅读材料•总计34分钟
Code Demonstration Transcripts•4分钟
How Stable Diffusion Works•30分钟
1个作业•总计30分钟
Diffusion & LoRA Basics•30分钟
1个非评分实验室•总计60分钟
Run Your First LoRA Adapter•60分钟
Fine-Tuning Custom Styles with DreamBooth
第 2 单元•小时 后完成
单元详情
Learn how to personalize diffusion models using the DreamBooth methodology. You’ll prepare small, targeted datasets for training custom concepts and styles, and understand how prior-preservation loss helps maintain model generalization. You’ll also apply hyperparameter strategies to balance creativity with stability and practice managing checkpoints and merging techniques. These skills give you the ability to adapt diffusion models to unique styles and use cases, making fine-tuning directly relevant to real-world creative and professional projects.
涵盖的内容
3个视频1篇阅读材料1个作业1个非评分实验室
显示有关单元内容的信息
3个视频•总计23分钟
Podcast - Personalizing Diffusion: DreamBooth in Action•3分钟
Prepping Your Dataset (and Avoiding Overfitting) in DreamBooth•9分钟
Merging & Managing Checkpoints •11分钟
1篇阅读材料•总计12分钟
How DreamBooth Works•12分钟
1个作业•总计30分钟
DreamBooth Troubleshooting•30分钟
1个非评分实验室•总计60分钟
Train a Style Concept with DreamBooth•60分钟
Workflow Design with ComfyUI
第 3 单元•小时 后完成
单元详情
Learn how to use ComfyUI to design and manage advanced workflows for diffusion models. You’ll set up the environment, navigate the node-based interface, and load custom fine-tuned models into your pipelines. You’ll also practice building complex generation workflows with extensions like ControlNet, giving you a flexible, visual way to experiment and produce consistent, high-quality results. These skills make workflow design more efficient and directly applicable to real-world creative and production settings.
涵盖的内容
3个视频2篇阅读材料1个作业
显示有关单元内容的信息
3个视频•总计26分钟
How ComfyUI Simplifies Diffusion Fine-Tuning•9分钟
Setting Up ComfyUI and Building Your First Workflow•6分钟
Adding ControlNet to Your ComfyUI Workflow•10分钟
2篇阅读材料•总计20分钟
The Must-Know Basics of ComfyUI•10分钟
Create a Workflow in ComfyUI•10分钟
1个作业•总计30分钟
ComfyUI Workflow Design•30分钟
Optimizing Diffusion Models for Production
第 4 单元•小时 后完成
单元详情
Learn how to optimize fine-tuned diffusion models so they’re reliable in real production environments. You’ll adjust inference settings like steps, CFG scale, and batch size to balance speed, quality, and resource use, and practice testing how small tweaks can dramatically improve results. You’ll also adapt workflows for deployment, gaining practical skills to deliver outputs that are both efficient and production-ready. These techniques give you the ability to make informed trade-offs that directly impact performance in real-world projects.
涵盖的内容
2个视频1篇阅读材料1个作业1个非评分实验室
显示有关单元内容的信息
2个视频•总计10分钟
Testing & Optimizing Outputs •8分钟
Podcast: Bringing It All Together: Fine-Tuning Diffusion Models That Work •3分钟
Coursera brings together a diverse network of subject matter experts who have demonstrated their expertise through professional industry experience or strong academic backgrounds. These instructors design and teach courses that make practical, career-relevant skills accessible to learners worldwide.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Certificate?
When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.