返回到 Data Manipulation at Scale: Systems and Algorithms
University of Washington

Data Manipulation at Scale: Systems and Algorithms

Data analysis has replaced data acquisition as the bottleneck to evidence-based decision making --- we are drowning in it. Extracting knowledge from large, heterogeneous, and noisy datasets requires not only powerful computing resources, but the programming abstractions to use them effectively. The abstractions that emerged in the last decade blend ideas from parallel databases, distributed systems, and programming languages to create a new class of scalable data analytics platforms that form the foundation for data science at realistic scales. In this course, you will learn the landscape of relevant systems, the principles on which they rely, their tradeoffs, and how to evaluate their utility against your requirements. You will learn how practical systems were derived from the frontier of research in computer science and what systems are coming on the horizon. Cloud computing, SQL and NoSQL databases, MapReduce and the ecosystem it spawned, Spark and its contemporaries, and specialized systems for graphs and arrays will be covered. You will also learn the history and context of data science, the skills, challenges, and methodologies the term implies, and how to structure a data science project. At the end of this course, you will be able to: Learning Goals: 1. Describe common patterns, challenges, and approaches associated with data science projects, and what makes them different from projects in related fields. 2. Identify and use the programming models associated with scalable data manipulation, including relational algebra, mapreduce, and other data flow models. 3. Use database technology adapted for large-scale analytics, including the concepts driving parallel databases, parallel query processing, and in-database analytics 4. Evaluate key-value stores and NoSQL systems, describe their tradeoffs with comparable systems, the details of important examples in the space, and future trends. 5. “Think” in MapReduce to effectively write algorithms for systems including Hadoop and Spark. You will understand their limitations, design details, their relationship to databases, and their associated ecosystem of algorithms, extensions, and languages. write programs in Spark 6. Describe the landscape of specialized Big Data systems for graphs, arrays, and streams

状态:Graph Theory
状态:Scalability
课程小时

精选评论

DK

5.0评论日期:Jan 23, 2016

Good! I like the final (optional) project on running on a large dataset through EC2. The lectures aren't as polished and compact as they could be but certainly a very valuable course.

MS

4.0评论日期:Jan 4, 2016

Very broad and instructive course with a good level of theory, many practical examples. Good teaching.Some nice assignments but a lake of assignement for the 4th week I recommand this course

DG

4.0评论日期:Jan 1, 2016

Last week of the course is too much information and without any assignments it kind of doesn't make much sense and it doesn't stick.

WE

4.0评论日期:Oct 3, 2016

Definitely need some background in R or Python and the lectures are a bit old. Seem to be from around 2013 when this first came out but most of the info is still relevant.

AD

4.0评论日期:Jul 19, 2020

Well structured and nice overview of data manipulation. But the assignments should really be updated in order to use python 3.x instead of 2.7, which is not maintained anymore...

SK

4.0评论日期:Jan 11, 2016

Its pretty decent. I liked the assignments. However there were some typos in the lecture slides and also the grader output is not very friendly.

MM

5.0评论日期:Jan 17, 2016

The course is very coherent and comprehensive. It covers only important aspects of the fields. Also, the exercises are very well prepared.

KO

5.0评论日期:Dec 21, 2019

Engaging problemset makes sure that you will get your hands dirty with data. And that is great! Definitely worth your time.

JQ

5.0评论日期:Aug 7, 2016

This is a quite wonderful course for large-scale data science. I believe I will have learned a lot via completing the courses.

HA

5.0评论日期:Jan 10, 2016

Great course that strikes a balance between teaching general principles and concepts, and providing hands-on technical skills and practice.The lessons are well designed and clearly conveyed.

RH

5.0评论日期:Jun 30, 2019

A great way to start, and become familiar with the nature, requirements & analytics of today's data.

AA

4.0评论日期:Dec 2, 2015

Very good course, but lectures could be more tuned onto the home assignments. A lot of independent work for me at least. Teacher is very good.

所有审阅

显示:20/170

Anne-Marie Tousch
1.0
评论日期:Jan 6, 2020
Toby Evans
5.0
评论日期:May 7, 2020
Max Ettelson
4.0
评论日期:Nov 12, 2018
Alon Mann
2.0
评论日期:May 15, 2017
anish chandran
5.0
评论日期:Jan 17, 2018
Cristian Meneses Arcos
2.0
评论日期:Oct 1, 2022
Benjamin Leuthold
2.0
评论日期:Jan 10, 2024
Jan Majewski
1.0
评论日期:Jun 17, 2019
Michael Rockhold
1.0
评论日期:Apr 24, 2022
Malina Rossow
1.0
评论日期:Oct 1, 2020
Chris Tessone
1.0
评论日期:May 19, 2022
Neil Erdman
1.0
评论日期:Oct 25, 2021
Alastair
1.0
评论日期:Jul 26, 2021
Daniel Wytrykus
5.0
评论日期:Apr 26, 2017
Christopher Alert
5.0
评论日期:Sep 29, 2015
5.0
评论日期:Jun 30, 2016
Valery Neira
5.0
评论日期:Sep 2, 2017
Sofia C
5.0
评论日期:Nov 14, 2016
Zahid P
5.0
评论日期:Nov 14, 2015
Korbinian Kuusisto
5.0
评论日期:Nov 7, 2016