Hi,
Context:
Built a fraud detection kind of app.
Business logic is all fine, but when putting into production, Kafka cluster is becoming unstable.
The topic to which it wrote have approx 80 events/sec. post running for few hours Kafka broker indexes are getting corrupted.
Topic config: single partition, replication 3.
Which is making consumer on this broker to fail.
Haven’t find any issues with load testing on non prod environments.
Not sure what could cause an issue.
Kafka version - 2.3
Flink version - 1.11.2- scala-2.12
Using same version Kafka consumer, Kafka producer.
Any suggestions are welcomed, what can be the cause. What are certain are have to look at.
--
Sent from my iPhone
Locked
