Brief Introduction
Learn how to analyze large datasets using Jupyter notebooks, MapReduce and Spark as a platform.
Description
In data science, data is called "big" if it cannot fit into the memory of a single standard laptop or workstation.
The analysis of big datasets requires using a cluster of tens, hundreds or thousands of computers. Effectively using such clusters requires the use of distributed files systems, such as the Hadoop Distributed File System (HDFS) and corresponding computational models, such as Hadoop, MapReduce and Spark.
In this course, part of the Data Science MicroMasters program, you will learn what the bottlenecks are in massive parallel computation and how to use spark to minimize these bottlenecks.
You will learn how to perform supervised an unsupervised machine learning on massive datasets using the Machine Learning Library (MLlib).
In this course, as in the other ones in this MicroMasters program, you will gain hands-on experience using PySpark within the Jupyter notebooks environment.
Knowledge
- Programming Spark using Pyspark
- Identifying the computational tradeoffs in a Spark application
- Performing data loading and cleaning using Spark and Parquet
- Modeling data through statistical and machine learning methods
Learning Apache Cassandra
- 4.2
-
![]()
![]()
![]()
![]()
![]()
Build purpose-driven applications using Apache Cassandra Cassandra is a NoSQL database with decentralized, fault-tolerant, scalable, and low-cost features, making it a core component of cloud computing systems....
Serverless Microservices on AWS in 10 Hours
- 3.5
-
![]()
![]()
![]()
![]()
![]()
The perfect course to implementing cost-effective, and scalable Microservices and APIs using serverless computing on AWS Microservices are a popular new approach to building maintainable, scalable, cloud-based applications....
Building Interactive Data Visualizations with D3JS
- 3.6
-
![]()
![]()
![]()
![]()
![]()
Create engaging data-driven and interactive visualizations to display complex data using D3JS Users learn to combine data with visual elements on the page to create informative visualizations....
Infonomics I: Business Information Economics and Data Monetization
- 4.6
-
![]()
![]()
![]()
![]()
![]()
Thriving in the Information Age compels organizations to deploy information as an actual business asset, not as an IT asset or merely as a business byproduct....
