Real Time Streaming using Apache Spark Streaming
- 3.7
-
![]()
![]()
![]()
![]()
Brief Introduction
Analyze data in real-time using the Apache Spark Streaming APIDescription
Spark is the technology that allows us to perform big data processing in the MapReduce paradigm very rapidly, due to performing the processing in memory without the need for extensive I/O operations.
Recently, the streaming approach to processing events in near real time became more widely adopted and more necessary. In this course, you will learn how to handle big amount of unbounded infinite streams of data. You will analyze data and draw conclusions from it. Furthermore, we will look at common problems when processing event streams: sorting, watermarks, deduplication, and keeping state (for example, user sessions). You will also implement streaming processing using Spark Streaming and analyze traffic on a web page in real time.
About the Author :
Tomasz Lelek is a Software Engineer, programming mostly in Java, Scala. He is a fan of microservices architecture, and functional programming. He has dedicated considerable time and effort to be better every day. He recently dived into Big Data technologies such as Apache Spark and Hadoop. Tomasz is passionate about nearly everything associated with software development.Recently he was a speaker at conferences in Poland - Confitura and JDD (Java Developers Day) and also at Krakow Scala User Group. He has also conducted a live coding session at Geecon Conference.
Requirements
- Requirements
- A basic understanding and functional knowledge of Apache Spark, stream processing, and big data are required.
Packt Publishing
3.7 Raiting
The Ultimate Hands-On Hadoop: Tame your Big Data!
- 4.6
-
![]()
![]()
![]()
![]()
![]()
Hadoop tutorial with MapReduce, HDFS, Spark, Flink, Hive, HBase, MongoDB, Cassandra, Kafka + more! Over 25 technologies. Manage big data on a cluster with HDFS and MapReduce...
Fundamentals of Apache Flink
- 3.4
-
![]()
![]()
![]()
![]()
![]()
Use Apache Flink and its ecosystem to process real-time big data Have you used Flink, but want to learn how to set it up and use it properly?...
AWS Data Architect Bootcamp - 43 Services 500 FAQs 20+ Tools
- 4.3
-
![]()
![]()
![]()
![]()
![]()
AWS Databases, EMR, SageMaker, IoT, Redshift, Glue, QuickSight, RDS, Aurora, DynamoDB, Kinesis, Rekognition & much more This is the most-comprehensive AWS course related to AWS data architecture on the market....
Google Cloud Big Data and Machine Learning Fundamentals
- 4.7
-
![]()
![]()
![]()
![]()
![]()
This course introduces participants to the big data capabilities of Google Cloud. This course showcases the ease, flexibility, and power of big data solutions on Google Cloud....
