Brief Introduction
Learn how to apply data science techniques using parallel programming in Apache Spark to explore big data.Description
Organizations use their data to support and influence decisions and build data-intensive products and services, such as recommendation, prediction, and diagnostic systems. The collection of skills required by organizations to support these functions has been grouped under the term ‘data science’.
This statistics and data analysis course will attempt to articulate the expected output of data scientists and then teach students how to use PySpark (part of Spark) to deliver against these expectations. The course assignments include log mining, textual entity recognition, and collaborative filtering exercises that teach students how to manipulate data sets using parallel processing with PySpark.
This course covers advanced undergraduate-level material. It requires a programming background and experience with Python (or the ability to learn it quickly). All exercises will use PySpark (the Python API for Spark), and previous experience with Spark equivalent to Introduction to Apache Spark, is required.
Knowledge
- How to use Apache Spark to perform data analysis
- How to use parallel programming to explore data sets
- Apply log mining, textual entity recognition and collaborative filtering techniques to real-world data questions
Taming Big Data with MapReduce and Hadoop - Hands On!
- 4.6
-
![]()
![]()
![]()
![]()
![]()
Learn MapReduce fast by building over 10 real examples, using Python, MRJob, and Amazon's Elastic MapReduce Service. You'll learn those same techniques, using your own Windows system right at home....
Spark 3.0 & Big Data Essentials with Scala | Rock the JVM
- 4.8
-
![]()
![]()
![]()
![]()
![]()
Now with Spark 3. 0: Learn practical Big Data with Spark DataFrames, Datasets, RDDs and Spark SQL, hands-on UPDATED FOR SPARK 3. The course is not for advanced Spark engineers....
Apache Spark 2.0 + Java : DO Big Data Analytics & ML
- 4.3
-
![]()
![]()
![]()
![]()
![]()
Project Based, Hands-on Practices, Spark SQL, Spark Streaming, Java Setup and building real world applications Welcome to our course. Looking to learn Apache Spark 2....
Apache Spark 2.0 + Python : DO Big Data Analytics & ML
- 3.4
-
![]()
![]()
![]()
![]()
![]()
Project Based, Hands-on Practices, Spark SQL, Spark Streaming, Real life Full cycle Project Welcome to our course. Looking to learn Apache Spark 2....
