DeveloperWeek 2020

Following the latest best practices for leveraging the powerful Apache Kafka data streaming platform can ensure that your deployment is far more effective, efficient, and simple to manage.

For example, Kafka’s low overhead and horizontal-scaling-friendly design enables the solution to be run successfully even on inexpensive commodity hardware – a significant advantage that developers should be well aware of when preparing their deployments.

At the same time, utilizing Apache ZooKeeper and providing it with ample bandwidth and powerful disks (while storing logs storing logs separately, isolating the ZooKeeper process, and
disabling swaps), will serve to minimize latency. Likewise, increasing Kafka’s default replication factor from two to three, using partitions correctly, and monitoring system metrics
will result in far smoother operations.

This session will provide developers with specific and actionable steps for optimizing Kafka deployments and realizing more of the open source technology’s potential, including:

-- Setting log configuration parameters to keep logs manageable
-- Knowing Kafka’s (low) hardware requirements
-- Leverage Apache ZooKeeper to its fullest
-- Setting up replication and redundancy the right way
-- Taking care with topic configurations
-- Using parallel processing
-- Configuring and isolating Kafka with security in mind
-- Avoiding outages by raising the Ulimit
-- Maintaining a low network latency
-- Utilizing effective monitoring and alerts