Course Outline
Introduction
- Overview of Apache Kafka
- Foundations of event streaming and real-time data processing
- Key features of Apache Kafka
- Benefits and use cases of Kafka in modern application development
Understanding Kafka Architecture and Core Concepts
- Kafka architecture: brokers, topics, partitions, and replicas
- Producers and consumers: message publishing and consumption
- The role of ZooKeeper in the Kafka ecosystem
Kafka Topics and Partitions
- Creating and configuring topics
- The impact of partitions on system behavior
- Replication and fault-tolerance mechanisms in Kafka
Kafka Producers
- Building Kafka producers in various programming languages
- Message serialization techniques
- Best practices for producer configuration
Kafka Consumers
- Building Kafka consumers in different programming languages
- Managing consumer groups and offsets
- Strategies for message processing and ensuring delivery guarantees
Integrating Kafka with External Systems using Kafka Connect
- An introduction to Kafka Connect and its connector framework
- Configuring and utilizing Kafka Connect for data integration
- Connecting Kafka to external systems
Writing Streaming Applications with Kafka Streams & ksqlDB
- Introduction to Kafka Streams and its stream processing capabilities
- Developing stream processing applications with Kafka Streams
- Utilizing ksqlDB for real-time data processing and analytics
Integrating a Kafka Client Application with Confluent Cloud
- Overview of Confluent Cloud features
- Connecting Kafka client applications to Confluent Cloud
Kafka Security
- Introduction to Kafka security features
- Implementing SSL/TLS for secure communication
- Authentication and authorization mechanisms in Kafka
Monitoring and Operations
- Monitoring Kafka using metrics and specialized tools
- Managing Kafka clusters and resources
- Troubleshooting common issues and optimizing performance
Best Practices and Real-world Use Cases
- Best practices for designing Kafka-based applications
- Case studies and examples of Kafka implementations across various industries
- Strategies for building scalable and fault-tolerant Kafka architectures
Summary and Next Steps
Requirements
- Fundamental programming knowledge
Target Audience
- Developers
- Programmers
Testimonials (2)
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
Georgi - BMW SA
Course - Apache Kafka for Developers
The labs and the slides combine well with Jorge's knowledge and love for Kafka.