Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Configuration
- The function of Kafka within contemporary data pipelines
- Distinguishing between Apache Kafka and Confluent Kafka
- Essential components: producers, consumers, brokers, topics, and partitions
- Deployment models for Kafka clusters and scaling strategies
Module 2: Configuring Zookeeper Quorums
- An introduction to Zookeeper
- The role of Zookeeper within a Kafka cluster
- Determining the optimal Zookeeper Quorum size
- Zookeeper configuration settings
- Setting up SSH on servers
- Practical session: Configuring Zookeeper (both as a team and as a service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical session: Setting up the Zookeeper Quorum
- The Zookeeper internal file system
- Performance factors that impact Zookeeper
- Demonstration of Zookeeper management tools and Zoonavigator
Module 3: Configuring Kafka Clusters
- Fundamental Kafka concepts
- General Kafka configuration
- Practical session: Configuring Kafka brokers
- Practical session: Running Kafka commands
- Practical session: Setting up a Kafka Multi-Broker Cluster
- Practical session: Testing Kafka clusters
- Verifying connectivity to the Kafka cluster
- Configuring Advertised.listeners: A critical setting
- Topic-specific configurations
- Settings for downloading and ingesting messages into topics
- Practical session: Demonstrating Kafka resilience
- Kafka performance: I/O
- Kafka performance: Network (RED)
- Kafka performance: RAM
- Kafka performance: CPU
- Kafka performance: Operating System (OS)
- Kafka performance: Other considerations
- Practical session: Modifying Kafka broker configurations
Module 4: Advanced Kafka Configuration
- Configuring the Landoop Kafka topic interface, Confluent REST Proxy, and Confluent Schema Registry
- Message transmission and reception (via CLI, Java, and the Spring framework)
- Monitoring metrics and utilizing tools (such as Confluent Control Center and Elasticsearch)
- Managing log files and offsets
- High availability and disaster recovery planning
- Achieving high availability through replication
- Optimizing producer and consumer performance
- Disaster recovery strategies
- Controlling failover and data recovery
- Connector configuration
- Implementing Kafka Connect
- Kafka security features
Summary and Next Steps
Requirements
- Knowledge of distributed systems and messaging principles
- Proficiency with the Linux command line
- Foundational understanding of networking and system administration
Target Audience
- System Administrators
- DevOps Engineers
- Platform and Infrastructure Teams
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)