Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

org.apache.kafka.common.errors.TimeoutException: AEMaaCS with External Kafka

Avatar

Level 4

Hi Team,

 

I have requirement to integrate kafka with AEM. On my local, it is working fine.(Using SDK) but on AEM cloud, getting below error while pushing records to kafka topic:

org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for my-topic-0:120000 ms has passed since batch creation.

where:

my-topic - kafka topic name

Kafka is installed on Azure kubernetes.

All requests are allowed right now.

All advance networking configurations are fine.

Installed kafka version and jars have same version(3.0.0)

kafka cluster id is also printing in logs but issue while sending data to producer.

 

Followed links for adv networking:

https://experienceleague.adobe.com/docs/experience-manager-cloud-service/content/security/configurin...

 

Please advise what is the issue here?

0 Replies

Avatar

Employee Advisor

it still sounds like a networking problem.  From the documentation, even "Flexible Port Egress" should be sufficient to allow you to any remote system. 

How have you configured advanced networking and are you sure that Kafka allows you to connect from AEM CS?

Avatar

Level 4

Advance networking is correct but still getting above timeout error. No Network issue as per Adobe Support team. Now i am using kafka rest api ( kafka on AKS using Strimzi bridge) and able to push data to Kafka topic.