Machine learning systems used in Clinical Decision Support Systems (CDSS) require further external validation, calibration analysis, assessment of bias and fairness. In this course, the main concepts of machine learning evaluation adopted in CDSS will be explained. Furthermore, decision curve analysis along with human-centred CDSS that need to be explainable will be discussed. Finally, privacy concerns of deep learning models and potential adversarial attacks will be presented along with the vision for a new generation of explainable and privacy-preserved CDSS.
Adopting a machine learning model in a Clinical Decision Support System (CDSS) requires several steps that involve external validation, bias assessment and calibration, 'fairness' assessment, clinical usefulness, ability to explain the model's decision and privacy-aware machine learning models. In this module, we are going to discuss these concepts and provide several examples from state-of-the-art research in the area. External validation and bias assessment have become the norm in clinical prediction models. Further work is required to assess and adopt deep learning models under these conditions. On the other hand, research in 'fairness', human-centred CDSS and privacy concerns of machine learning models are areas of active research. The first week is going to cover the ground around the difference between reproducibility and generalisability. Furthermore, calibration assessment in clinical prediction models will be explored while how different deep learning architectures affect calibration will be discussed.
涵盖的内容
4个视频3篇阅读材料1个作业1个讨论话题
显示有关单元内容的信息
4个视频•总计52分钟
Welcome: From machine learning models to clinical decision support systems•1分钟
From Reproducibility to Generalisability•18分钟
A Guide to Model Validation in Clinical Decision Support Systems•18分钟
Calibration of Deep Learning Models•15分钟
3篇阅读材料•总计30分钟
An ABCD guide for prediction model validation in clinical settings•10分钟
Calibration: the Achilles heel of predictive analytics•10分钟
Bias assessment in Deep Learning Models•10分钟
1个作业•总计30分钟
End of week 1 Quiz•30分钟
1个讨论话题•总计10分钟
Week 1 - Your experience•10分钟
'Fairness' in Machine Learning Models
第 2 单元•小时 后完成
单元详情
Naively, machine learning can be thought as a way to come to decisions that are free from prejudice and social biases. However, recent evidence show how machine learning models learn from biases in historic data and reproduce unfair decisions in similar ways. Detecting biases against subgroups in machine learning models is challenging also due to the fact that these models have not been designed or trained to discriminate deliberately. Defining 'fairness' metrics and investigating ways in ensuring that minority groups are not disadvantaged from machine learning models' decisions is an active research area.
涵盖的内容
3个视频3篇阅读材料1个作业1个讨论话题
显示有关单元内容的信息
3个视频•总计48分钟
Assessment of the Risk of Bias in EHR•15分钟
Fairness in Machine Learning for Healthcare Applications (Part 1)•17分钟
Fairness in Machine Learning for Healthcare Applications (Part 2)•16分钟
3篇阅读材料•总计30分钟
PROBAST: A Tool to Assess the Risk of Bias•10分钟
Big Data's Disparate Impact•10分钟
Ensuring Fairness in Machine Learning to Advance Health Equity•10分钟
1个作业•总计30分钟
End of week 2 Quiz•30分钟
1个讨论话题•总计10分钟
Week 2 - Your experience•10分钟
Decision Curve Analysis and Human-Centered CDSS
第 3 单元•小时 后完成
单元详情
Decision curve analysis is used to assess clinical usefulness of a prediction model by estimating the net benefit with is a trade-off of the precision and accuracy of the model. Based on this approach the strategy of ‘intervention for all’ and ‘intervention for none’ is compared to the model’s net benefit. Decision curve analysis is a human-centred approach of assessing clinical usefulness, since it requires experts’ opinion. Ethical Artificial Intelligence initiative indicate that a human-centred approach in clinical decision support systems is required to enable accountability, safety and oversight while the ensure ‘fairness’ and transparency.
涵盖的内容
3个视频3篇阅读材料1个作业1个讨论话题
显示有关单元内容的信息
3个视频•总计39分钟
Decision Curve Analysis•17分钟
Human-Centered Clinical Decision Support Systems•15分钟
Evaluation of Explainability Models•7分钟
3篇阅读材料•总计30分钟
A Guide to Interpreting Decision Curve Analysis•10分钟
A Roadmap Toward Transparent Expert Companions•10分钟
The role of explainability in creating trustworthy artificial intelligence for health care•10分钟
1个作业•总计30分钟
End of week 3 Quiz•30分钟
1个讨论话题•总计10分钟
Week 3 - Your experience•10分钟
Privacy Concerns in CDSS
第 4 单元•小时 后完成
单元详情
Deep learning models have remarkable ability to memorise data even when they do not overfit. In other words, the models themselves can expose information about the patients that compromise their privacy. This can results in unintentional data leakage in inference and also provide opportunities for malicious attacks. We will overview common privacy attacks and defences against them. Finally, we will discuss adversarial attacks against deep learning explanations.
涵盖的内容
3个视频3篇阅读材料2个作业1个讨论话题
显示有关单元内容的信息
3个视频•总计41分钟
Privacy Concerns in CDSS•14分钟
Defences Against Inference Attacks•15分钟
Adversarial Attacks - Explainability•12分钟
3篇阅读材料•总计30分钟
Leakage and Privacy at Inference Time•10分钟
Secure, privacy-preserving and federated machine learning•10分钟
The University of Glasgow has been changing the world since 1451. It is a world top 100 university (THE, QS) with one of the largest research bases in the UK.
We are a member of the prestigious Russell Group of leading UK Universities with annual research income of more than £179m.
The University’s #TeamUofG community is truly international with over 8000 staff and 28,0000 students from more than 140 countries.
A 2019 Time Out survey placed Glasgow in the top ten cities in the world. Ranked between Berlin and Paris, Glasgow was voted number one for both friendliness and affordability.
Right now our dedicated community of staff, students and alumni is working to address the challenges of Covid-19 and understand how we can make life safer for everyone.
When will I have access to the lectures and assignments?
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
What will I get if I subscribe to this Specialization?
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Is financial aid available?
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.