How can we connect Kafka with adobe app builder

Hi, I think you don't need to integrate with Kafka. You can use Adobe I/O events custom events to store the event data temporarily. Please look at this guide. https://developer.adobe.com/app-builder/docs/resources/event-driven/ 

Hi ​@ShubhamAg2 ,

1. External Kafka is required:  Yes App Builder does not host Kafka.

• Local dev: Run Kafka using Docker (docker-compose) and test with tools like kcat.
• Production: Use Confluent, AWS MSK, Azure Event Hubs, or your own Kafka cluster.
• App Builder only publishes events to Kafka, it doesn’t manage Kafka itself.

2. App Builder setup: 

• Create an App Builder project in Adobe Developer Console.
• Add required APIs:
  • I/O Management API
  • I/O Events
  • Adobe I/O Events for Adobe Commerce
• Configure Commerce Eventing using the official Adobe documentation.

3. Sending events from App Builder to Kafka:

• Expose Kafka via a REST endpoint (Confluent REST Proxy or custom gateway).
• App Builder runtime action simply sends HTTP requests to that endpoint.
• The action receives Commerce events and forwards them to Kafka.

4. Wiring Commerce events:

• In Developer Console:
  • Register Adobe Commerce Events
  • Route them to the App Builder runtime action
• In Commerce Admin:
  • Configure Adobe I/O connection
  • Enable Commerce Eventing
• Result: Commerce events => App Builder => Kafka

Example docker-compose.yml:

services:
  zookeeper:
    image: confluentinc/cp-zookeeper:7.5.0
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181

  kafka:
    image: confluentinc/cp-kafka:7.5.0
    depends_on: [zookeeper]
    ports:
      - "9092:9092"
    environment:
      KAFKA_ZOOKEEPER_CONNECT: "zookeeper:2181"
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1

Thanks,
Amit