Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The function of Kafka within contemporary data pipelines
  • Distinguishing between Apache Kafka and Confluent Kafka
  • Essential components: producers, consumers, brokers, topics, and partitions
  • Deployment models for Kafka clusters and scaling strategies

Module 2: Configuring Zookeeper Quorums

  • An introduction to Zookeeper
  • The role of Zookeeper within a Kafka cluster
  • Determining the optimal Zookeeper Quorum size
  • Zookeeper configuration settings
  • Setting up SSH on servers
  • Practical session: Configuring Zookeeper (both as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical session: Setting up the Zookeeper Quorum
  • The Zookeeper internal file system
  • Performance factors that impact Zookeeper
  • Demonstration of Zookeeper management tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Fundamental Kafka concepts
  • General Kafka configuration
  • Practical session: Configuring Kafka brokers
  • Practical session: Running Kafka commands
  • Practical session: Setting up a Kafka Multi-Broker Cluster
  • Practical session: Testing Kafka clusters
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: A critical setting
  • Topic-specific configurations
  • Settings for downloading and ingesting messages into topics
  • Practical session: Demonstrating Kafka resilience
  • Kafka performance: I/O
  • Kafka performance: Network (RED)
  • Kafka performance: RAM
  • Kafka performance: CPU
  • Kafka performance: Operating System (OS)
  • Kafka performance: Other considerations
  • Practical session: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring the Landoop Kafka topic interface, Confluent REST Proxy, and Confluent Schema Registry
  • Message transmission and reception (via CLI, Java, and the Spring framework)
  • Monitoring metrics and utilizing tools (such as Confluent Control Center and Elasticsearch)
  • Managing log files and offsets
  • High availability and disaster recovery planning
  • Achieving high availability through replication
  • Optimizing producer and consumer performance
  • Disaster recovery strategies
  • Controlling failover and data recovery
  • Connector configuration
  • Implementing Kafka Connect
  • Kafka security features

Summary and Next Steps

Requirements

  • Knowledge of distributed systems and messaging principles
  • Proficiency with the Linux command line
  • Foundational understanding of networking and system administration

Target Audience

  • System Administrators
  • DevOps Engineers
  • Platform and Infrastructure Teams

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories