Coursera

End-to-End Multimodal AI: Fine-Tuning, Fusion, and MLOps

通过 Coursera Plus 提高技能,仅需 239 美元/年(原价 399 美元)。立即节省

Coursera

End-to-End Multimodal AI: Fine-Tuning, Fusion, and MLOps

包含在 Coursera Plus

深入了解一个主题并学习基础知识。
中级 等级

推荐体验

2 周 完成
在 10 小时 一周
灵活的计划
自行安排学习进度
深入了解一个主题并学习基础知识。
中级 等级

推荐体验

2 周 完成
在 10 小时 一周
灵活的计划
自行安排学习进度

您将学到什么

  • Fine-tune transformer-based multimodal models using transfer learning in PyTorch and TensorFlow.

  • Build cross-modal retrieval systems using FAISS and attention-based fusion of visual and text embeddings.

  • Automate ML pipelines with drift monitoring, hyperparameter tuning, and retraining using MLflow and Ray Tune.

  • Design and document versioned multimodal inference APIs with FastAPI, OAuth2, and OpenAPI specifications.

要了解的详细信息

可分享的证书

添加到您的领英档案

最近已更新!

March 2026

授课语言:英语(English)

了解顶级公司的员工如何掌握热门技能

Petrobras, TATA, Danone, Capgemini, P&G 和 L'Oreal 的徽标

积累 Algorithms 领域的专业知识

本课程是 Multimodal Intelligence - Vision, Audio & Language in Action 专业证书 专项课程的一部分
在注册此课程时,您还会同时注册此专业证书。
  • 向行业专家学习新概念
  • 获得对主题或工具的基础理解
  • 通过实践项目培养工作相关技能
  • 通过 Coursera 获得可共享的职业证书

该课程共有20个模块

You will build the foundational MLOps infrastructure for multimodal AI systems by designing modular data pipeline components and implementing your first multimodal transformer fine-tuning workflow using open source tools.

涵盖的内容

3个视频1篇阅读材料1个作业1个非评分实验室

You will accelerate multimodal model development using transfer learning techniques and implement the transformation and loading pipeline stages that deliver processed data and trained models reliably to downstream systems.

涵盖的内容

1个视频1篇阅读材料3个作业

You will identify and analyze training and validation metric patterns to diagnose overfitting and gradient stability issues using TensorBoard visualization tools.

涵盖的内容

2个视频1篇阅读材料1个作业1个非评分实验室

You will implement targeted interventions including gradient clipping and early stopping to stabilize training processes and prevent common neural network training failures.

涵盖的内容

1个视频1篇阅读材料3个作业

You will learn systematic image preprocessing techniques including normalization and color-space conversions to prepare raw visual data for computer vision applications.

涵盖的内容

3个视频1篇阅读材料1个作业1个非评分实验室

You will learn optical flow and frame differencing techniques to extract temporal motion features from video sequences for computer vision applications.

涵盖的内容

2个视频1篇阅读材料2个作业

You will establish foundational understanding of systematic error analysis approaches and learn to evaluate computer vision model performance beyond basic accuracy metrics.

涵盖的内容

2个视频1篇阅读材料1个作业1个非评分实验室

You will apply advanced techniques to identify systematic failure patterns in computer vision models and generate comprehensive quality reports for model improvement.

涵盖的内容

1个视频1篇阅读材料3个作业

You will build foundational understanding of cross-modal retrieval systems and implement approximate nearest-neighbor search algorithms using FAISS for production-scale similarity search across multimodal embeddings.

涵盖的内容

1个视频2篇阅读材料1个作业1个非评分实验室

You will design and implement sophisticated attention-based fusion algorithms that intelligently combine visual and textual embeddings, mastering the creation of multimodal neural architectures for advanced cross-modal AI applications.

涵盖的内容

2篇阅读材料3个作业

You will learn the foundational concepts of computational complexity analysis, learning to systematically evaluate fusion algorithms using Big O notation and profiling tools.

涵盖的内容

3个视频1篇阅读材料1个作业1个非评分实验室

You will apply complexity analysis skills to make strategic optimization decisions, evaluating trade-offs between performance, accuracy, and resource constraints in real-world deployment scenarios.

涵盖的内容

1个视频3个作业

You will learn the systematic evaluation of production ML models to identify performance degradation and implement drift detection systems that automatically trigger remediation actions.

涵盖的内容

1个视频1篇阅读材料1个作业1个非评分实验室

You will build comprehensive automated ML pipelines with integrated hyperparameter optimization and end-to-end automation that maintains model performance in production environments.

涵盖的内容

2个视频1篇阅读材料3个作业

You will build foundational skills for systematically analyzing multimodal AI model outputs, understanding cross-modal relationships, and preparing technical findings for stakeholder communication.

涵盖的内容

2个视频1篇阅读材料1个作业1个非评分实验室

You will learn the critical skills of translating complex multimodal AI analysis into compelling business narratives, creating executive-level presentations, and developing stakeholder communication frameworks that drive strategic decisions.

涵盖的内容

2个视频1篇阅读材料3个作业

You will design and implement versioned API endpoints specifically optimized for multimodal AI inference workloads

涵盖的内容

3个视频1篇阅读材料2个作业

You will implement comprehensive OAuth2 authentication systems and observability middleware for production API services

涵盖的内容

2个视频1篇阅读材料2个作业

You will create comprehensive OpenAPI specifications that enable automated testing, client generation, and seamless integration

涵盖的内容

2个视频1篇阅读材料2个作业1个非评分实验室

You will build a production-grade multimodal AI system that processes visual and textual data, integrating fine-tuning, cross-modal fusion, and deployment-ready inference services.This capstone synthesizes model optimization, data engineering, API design, and MLOps practices to deliver a deployable, monitored multimodal application.

涵盖的内容

4篇阅读材料1个作业

获得职业证书

将此证书添加到您的 LinkedIn 个人资料、简历或履历中。在社交媒体和绩效考核中分享。

位教师

Professionals from the Industry
366 门课程51,989 名学生

提供方

Coursera

从 Algorithms 浏览更多内容

人们为什么选择 Coursera 来帮助自己实现职业发展

Felipe M.

自 2018开始学习的学生
''能够按照自己的速度和节奏学习课程是一次很棒的经历。只要符合自己的时间表和心情,我就可以学习。'

Jennifer J.

自 2020开始学习的学生
''我直接将从课程中学到的概念和技能应用到一个令人兴奋的新工作项目中。'

Larry W.

自 2021开始学习的学生
''如果我的大学不提供我需要的主题课程,Coursera 便是最好的去处之一。'

Chaitanya A.

''学习不仅仅是在工作中做的更好:它远不止于此。Coursera 让我无限制地学习。'
Coursera Plus

通过 Coursera Plus 开启新生涯

无限制访问 10,000+ 世界一流的课程、实践项目和就业就绪证书课程 - 所有这些都包含在您的订阅中

通过在线学位推动您的职业生涯

获取世界一流大学的学位 - 100% 在线

加入超过 3400 家选择 Coursera for Business 的全球公司

提升员工的技能,使其在数字经济中脱颖而出

常见问题

¹ 本课程的部分作业采用 AI 评分。对于这些作业,将根据 Coursera 隐私声明使用您的数据。