DeveloperWeek 2020 has ended
Back To Schedule
Thursday, February 13 • 3:00pm - 3:25pm
PRO SESSION: Maximizing Your Data Streaming Scale with Open Source Apache Kafka LIMITED

Log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Limited Capacity seats available

Following the latest best practices for leveraging the powerful Apache Kafka data streaming platform can ensure that your deployment is far more effective, efficient, and simple to manage.

For example, Kafka’s low overhead and horizontal-scaling-friendly design enables the solution to be run successfully even on inexpensive commodity hardware – a significant advantage that developers should be well aware of when preparing their deployments.

At the same time, utilizing Apache ZooKeeper and providing it with ample bandwidth and powerful disks (while storing logs storing logs separately, isolating the ZooKeeper process, and
disabling swaps), will serve to minimize latency. Likewise, increasing Kafka’s default replication factor from two to three, using partitions correctly, and monitoring system metrics
will result in far smoother operations.

This session will provide developers with specific and actionable steps for optimizing Kafka deployments and realizing more of the open source technology’s potential, including:

-- Setting log configuration parameters to keep logs manageable
-- Knowing Kafka’s (low) hardware requirements
-- Leverage Apache ZooKeeper to its fullest
-- Setting up replication and redundancy the right way
-- Taking care with topic configurations
-- Using parallel processing
-- Configuring and isolating Kafka with security in mind
-- Avoiding outages by raising the Ulimit
-- Maintaining a low network latency
-- Utilizing effective monitoring and alerts

DeveloperWeek Speakers
avatar for Zeke Dean

Zeke Dean

Senior Consultant, Instaclustr
Zeke Dean is a Senior Consultant at Instaclustr, which provides a managed service platform for open source technologies. He has numerous years of experience building big data systems for enterprises all over the world -- from banks in the Middle East to major publishing houses in... Read More →

Thursday February 13, 2020 3:00pm - 3:25pm PST
DeveloperWeek PRO Stage D (Room 208)