org.apache.kafka.common.errors.TimeoutException: AEMaaCS with External Kafka

[HeenaMadan]

Hi Team,

I have requirement to integrate kafka with AEM. On my local, it is working fine.(Using SDK) but on AEM cloud, getting below error while pushing records to kafka topic:

org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for my-topic-0:120000 ms has passed since batch creation.

where:

my-topic - kafka topic name

Kafka is installed on Azure kubernetes.

All requests are allowed right now.

All advance networking configurations are fine.

Installed kafka version and jars have same version(3.0.0)

kafka cluster id is also printing in logs but issue while sending data to producer.

Followed links for adv networking:

https://experienceleague.adobe.com/docs/experience-manager-cloud-service/content/security/configurin...

Please advise what is the issue here?

[Jörg_Hoh]

it still sounds like a networking problem.  From the documentation, even "Flexible Port Egress" should be sufficient to allow you to any remote system. 

How have you configured advanced networking and are you sure that Kafka allows you to connect from AEM CS?

[HeenaMadan]

Advance networking is correct but still getting above timeout error. No Network issue as per Adobe Support team. Now i am using kafka rest api ( kafka on AKS using Strimzi bridge) and able to push data to Kafka topic.