Kafka Publish Issue:

Summary:

Our publish service occasionally fails to publish records to the Kafka topic, displaying the error message: “Failed to construct Kafka Producer.”

How we were fixing this issue:

Restarting the service from the Azure portal resolved the issue, allowing our publish service to resume publishing records successfully.

Additionally, our scheduler service was responsible for re-publishing any previously failed records, ensuring data integrity and consistent processing.

Fix at Service

The root cause of the intermittent failures in our publish service was traced back to the Kafka serializer, which was running on version 4.x.x. This outdated version led to compatibility issues that resulted in the error: “Failed to construct Kafka Producer.” After thorough investigation, it was determined that upgrading the Kafka serializer to version 7.x.x would address these failures and enhance stability. The upgrade is expected to improve producer reliability, ensure better performance, and align with the latest features and fixes provided in the newer Kafka client versions. We are planning to implement this upgrade and monitor the publish service for consistent behavior post-migration.