Brief Introduction
Extract, Transform and Load data using Pig to harness the power of HadoopDescription
Prerequisites: Working with Pig requires some basic knowledge of the SQL query language, a brief understanding of the Hadoop eco-system and MapReduce
Taught by a team which includes 2 Stanford-educated, ex-Googlers and 2 ex-Flipkart Lead Analysts. This team has decades of practical experience in working with large-scale data processing jobs.
Pig is aptly named, it is omnivorous, will consume any data that you throw at it and bring home the bacon!
Let's parse that
omnivorous: Pig works with unstructured data. It has many operations which are very SQL-like but Pig can perform these operations on data sets which have no fixed schema. Pig is great at wrestling data into a form which is clean and can be stored in a data warehouse for reporting and analysis.
bring home the bacon: Pig allows you to transform data in a way that makes is structured, predictable and useful, ready for consumption.
What's Covered:
Pig Basics: Scalar and Complex data types (Bags, Maps, Tuples), basic transformations such as Filter, Foreach, Load, Dump, Store, Distinct, Limit, Order by and other built-in functions.
Advanced Data Transformations and Optimizations: The mind-bending Nested Foreach, Joins and their optimizations using "parallel", "merge", "replicated" and other keywords, Co-groups and Semi-joins, debugging using Explain and Illustrate commands
Real-world example: Clean up server logs using Pig
Requirements
- Requirements
- A basic understanding of SQL and working with data
- A basic understanding of the Hadoop eco-system and MapReduce tasks
Loony Corn
3.7 Raiting
Taming Big Data with Apache Spark and Python - Hands On!
- 4.5
-
![]()
![]()
![]()
![]()
![]()
Apache Spark tutorial with 20+ hands-on examples of analyzing large data sets on your desktop or on Hadoop with Python! It's easier than you might think....
PySpark Essentials for Data Scientists (Big Data + Python)
- 4.5
-
![]()
![]()
![]()
![]()
![]()
Learn how to wrangle Big Data for Machine Learning using Python in PySpark taught by an industry expert! Use Python with Big Data on a distributed framework (Apache Spark)...
Big Data Hadoop and Spark with Scala
- 4.6
-
![]()
![]()
![]()
![]()
![]()
Complete course (No Prerequisites) - Big Data Hadoop with Spark and Eco system This course will make you ready to switch career on big data hadoop and spark....
AWS Certified Data Analytics Specialty 2021 - Hands On!
- 4.5
-
![]()
![]()
![]()
![]()
![]()
Practice exam included! AWS DAS-C01 certification prep course with exercises. Kinesis, EMR, DynamoDB, Redshift and more! Happy learning! ] But, even experienced technologists need to prepare heavily for this exam....
