Unravel Apache Kafka - Thread 1 - Kafka Essentials
- 0.0
Brief Introduction
Kafka Architecture and Design ConceptsDescription
This course is Thread 1 in Unravel Apache Kafka Series
This course covers Kafka Basics and discusses about the core Architecture and Design of Kafka.
Section 1 - Getting Started
You will learn about setting up the Lab environment for this course. You will learn installing Oracle VirtualBox software and importing the Big Data Sandbox virtual machine used for Lab exercises in this course.
Section 2 - Messaging and Big Data
You will learn about characteristics of Bit Data and the cycle of a typical Big Data solution. You will understand why Messaging is required in Big Data solutions and some of the short comings of using Message Oriented Middleware for Big Data.
Section 3- Kafka Overview
You will learn about Kafka basics and understand the Kafka Message Flow. You will also explore the core use cases of Kafka the solutions where Kafka can be used. You will learn about setting up a single node Kafka broker.
Section 4 - Kafka Architecture
You will learn the logical architecture of Kafka and the core components. You will understand the role of ZooKeeper in Kafka architecture and it's core responsibilities. You will understand the concepts of a Broker, Producer, Consumer, Topic, Partition, Offset. You will setup a Pseduo-distributed cluster and understand how Consumer Group works.
Section 5 - Kafka Design
You will learn about the core Design Strategies applied in Kafka. You will understand how the physical storage design and message partitioning strategies. You will understand message retention and delivery semantics. You will also learn how Kafka supports High Availability using Replication and explore the fault tolerance strategies in Kafka. You will explore these concepts also in the lab.
Requirements
- Requirements
- Basic Networking concepts, Basics of LINUX would be beneficial