How can we connect Kafka with adobe app builder

[ShubhamAg2]

I have a requirement to integrate Kafka with the App Builder starter kit. Since Adobe Commerce event actions have a default execution time limit of 1 minute, I plan to use Kafka to store the event data temporarily. The idea is to publish the data to a specific Kafka topic and later consume it using a subscriber, as Kafka requires Docker to run locally.
Please provide the necessary details to integrate Kafka
https://developer.adobe.com/commerce/extensibility/events/tutorial/
Do we need an external service for Kafka to work with Adobe App Builder 

[tmj]

Hi, I think you don't need to integrate with Kafka. You can use Adobe I/O events custom events to store the event data temporarily. Please look at this guide. https://developer.adobe.com/app-builder/docs/resources/event-driven/ 

[ShubhamAg2]

Hi @tmj ,

Thanks for your response.

Yes, we do have alternative approaches available, such as using a custom event, triggering a webhook, or storing data in IO Files and processing it in smaller chunks. However, I mainly wanted to confirm whether Kafka can be integrated directly with Adobe App Builder. From what I understand, App Builder does not natively support running Kafka brokers or consumers within its runtime environment. If integration is possible, would it require an external service-such as a dedicated Kafka cluster or a middleware layer-to handle communication between Adobe App Builder and Kafka?