Brief Introduction
Amazon Web Services Elastic Map Reduce with Spark 2 using Scala as programming languageDescription
Learn AWS EMR and Spark 2 using Scala as programming language
Spark is in memory distributed computing framework in Big Data eco system and Scala is programming language. It is one of the hottest technologies in Big Data as of today.
Spark 2 have changed drastically from Spark 1. Spark SQL and DataFrames have become core module on which other modules like Structured Streaming and Machine Learning Pipe lines.
As part of this course, there will be lot of emphasis on lower level APIs called transformations and actions of Spark along with core module Spark SQL and DataFrames
EMR brings cloud capabilities to Big Data. EMR provides different options which include Spark 2 as well as one of the service on the cluster.
As part of this course, you will learn
- Basics of Amazon Web Services
- Security using IAM
- Setting up EMR clusters
- Basics of programming using Scala
- Spark 2 - Core Transformations and Actions
- Spark 2 - Spark SQL and Data Frames
- Spark 2 - Streaming and Structured Streaming
- Different File Formats and Compression algorithms
- Submitting Spark 2 jobs on EMR using step execution
- and many more
We will start with understanding basics of AWS, setting up EMR cluster with Spark and then jump into Spark 2 using Scala as programming language.
Requirements
- Requirements
- Computer with 4 GB RAM and 64 bit operating system is required
- If it is Windows, Windows 10 is highly recommended and supported. Other Windows versions are not supported
- For EMR clusters, you might have to pay charges to Amazon
Apache Spark with Scala - Hands On with Big Data!
- 4.6
-
![]()
![]()
![]()
![]()
![]()
Apache Spark tutorial with 20+ hands-on examples of analyzing large data sets, on your desktop or on Hadoop with Scala! Get a crash course in the Scala programming language...
AWS Data Architect Bootcamp - 43 Services 500 FAQs 20+ Tools
- 4.3
-
![]()
![]()
![]()
![]()
![]()
AWS Databases, EMR, SageMaker, IoT, Redshift, Glue, QuickSight, RDS, Aurora, DynamoDB, Kinesis, Rekognition & much more This is the most-comprehensive AWS course related to AWS data architecture on the market....
Snowflake Masterclass [Real time demos+Best practices+Labs]
- 4.5
-
![]()
![]()
![]()
![]()
![]()
Master snowflake cloud data-warehouse with hands on exercises from real time expert. Snowflake cloud database with ETL(Airflow+Python+Talend) Snowflake is a fantastic tool to handle huge volumes of data....
AWS EMR and Spark 2 using Scala
- 0.0
-
![]()
![]()
![]()
![]()
![]()
Amazon Web Services Elastic Map Reduce with Spark 2 using Scala as programming language Learn AWS EMR and Spark 2 using Scala as programming language...
