Explore

PySpark Essentials for Data Scientists (Big Data + Python)

16 hours on-demand video

$ 12.99

Save Course

Go to Course

Brief Introduction

Learn how to wrangle Big Data for Machine Learning using Python in PySpark taught by an industry expert!

Description

This course is for data scientists (or aspiring data scientists) who want to get PRACTICAL training in PySpark (Python for Apache Spark) using REAL WORLD datasets and APPLICABLE coding knowledge that you’ll use everyday as a data scientist! By enrolling in this course, you’ll gain access to over 100 lectures, hundreds of example problems and quizzes and over 100,000 lines of code!

I’m going to provide the essentials for what you need to know to be an expert in Pyspark by the end of this course, that I’ve designed based on my EXTENSIVE experience consulting as a data scientist for clients like the IRS, the US Department of Labor and United States Veterans Affairs.

I’ve structured the lectures and coding exercises for real world application, so you can understand how PySpark is actually used on the job. We are also going to dive into my custom functions that I wrote MYSELF to get you up and running in the MLlib API fast and make getting started building machine learning models a breeze! We will also touch on MLflow which will help us manage and track our model training and evaluation process in a custom user interface that will make you even more competitive on the job market!

Each section will have a concept review lecture as well as code along activities structured problem sets for you to work through to help you put what you have learned into action, as well as the solutions to each problem in case you get stuck. Additionally, real world consulting projects have been provided in every section with AUTHENTIC datasets to help you think through how to apply each of the concepts we have covered.

Lastly, I’ve written up some condensed review notebooks and handouts of all the course content to make it super easy for you to reference later on. This will be super helpful once you land your first job programming in PySpark!

I can’t wait to see you in the lectures! And I really hope you enjoy the course! I’ll see you in the first lecture!

Requirements

Requirements
Familiarity with Python is helpful but not required
Some background in data science is helpful but not required

Knowledge

Use Python with Big Data on a distributed framework (Apache Spark)
Work with REAL datasets on realistic consulting projects
Learn how to create a "Pandora Like" app that classifies songs into genres using machine learning
Flag suspicious job postings using Natural Language Processing
Use machine learning to predict optimal cement strength and the factors that affect it
Integrate a UI to monitor your model training and development process with MLflow
Theory and application of cutting edge data science algorithms
Manipulate, Join and Aggregate Dataframes in Spark with Python
Learn how to apply Spark's machine learning techniques on distributed Dataframes
Cross Validation & Hyperparameter Tuning
Frequent Pattern Mining Techniques
Classification & Regression Techniques
Data Wrangling for Natural Language Processing
How to write SQL Queries in Spark

Recommended for you

Big Data analytics with PySpark (Apache Spark and Python)

A course for leveraging the power of Python and putting it to use in the(Apache spark architecture) Spark ecosystem. PySpark is the Python package that makes the magic happen....

Save Course

Data Science & Deep Learning for Business™ 20 Case Studies

Use Python to solve problems in Retail, Marketing, Product Recommendation, Customer Clustering, NLP, Forecasting & more!   What student reviews of this course are saying,...

Save Course

Data Science, Analytics & AI for Business & the Real World™

Use Data Science & Statistics To Solve Business Problems & Gain Insights Into Everyday Problems With 35+ Case Studies   Our Complete 2020 Data Science Learning path includes:...

Save Course