Introduction #

The Active-Active Kafka architecture enables data replication, high availability, and disaster recovery by maintaining two fully operational Kafka clusters across two geographically distributed data centers. Each cluster can independently process and serve data, while ensuring eventual consistency between clusters.

Key benefits of this setup include: • Fault tolerance with failover capabilities. • Load sharing between clusters. • Scalability and resilience.

Architecture Overview #

Key Components #

1.	Kafka Clusters
•	Two independent Kafka clusters deployed in separate data centers (e.g., DC1 and DC2).
•	Managed using the OpenShift Kafka Operator.

2.	Kafka MirrorMaker 2
•	Handles bidirectional replication between clusters.
•	Configured to ensure data consistency and prevent conflicts.


3.	TLS and Authentication
•	Security is enforced with TLS encryption and SASL authentication.

5.	Load Balancers
•	Used for directing client traffic to the appropriate cluster.