Apache Kafka connector - Status changed to: Needs Info

[#1]

It's easy to create some libraries to communicate outside Adobe Campaign with the simplicity of Javascript and the HTTPClientRequest class, but as Kafka is not based on HTTP protocol, it's not possible to consume or produce over topics in Campaign. Apache Kafka needs specific libraries (Java, Python, NodeJS) to be used. It would be great to have a specific API into the Campaign javascript environment.

I'm sure that question is not new and the R&D team thought about it, and it's won't be technicaly easy, but this question is comming for several of my customers so I'm suggesting here.

Thanks

Cedric

[#2]

@CedricRey- interesting that you post this as we are looking at using Kafka to manage some enterprise-wide configuration changes.

Campaign Classic already uses Kafka for its Triggers / Pipelined implementation so you would expect it shouldn't be too difficult to expose those APIs internally for general Kafka use.

Cheers

Darren

[#3]

Hi @CedricRey,

As per teh product team's response - Campaign does use kafka topics internally. But what would really help is the business use case that you are trying to solve. This will help us drive and prioritze your request with the product team.

[#4]

Hello @Sukrity_Wadhwa ,

We would appreciate the opportunity to work directly on ACC with Kafka topics. Today we need a third party application to read / write datas for us and put it in Database.

But we are about to change the technical architecture and won't be able to expose database (soon hosted by Adobe).

I think this case is not particular to us and may be of  interess to many of other customers as Kafka is a common dataflow product, as you can see, @Darren_Bowers is also insterested.

Thank you.

Cedric

[#5]

Hi @CedricRey,

Internally we do use kafta containers. The product team is interested to know your specific business use case(s) for them to understand and eventually, better position and prioritize your request. 

Thanks!

[#6]

Hi @Sukrity_Wadhwa ,

Thank you for your response. At one of my clients, we've identified a crucial need for a Kafka connector since upgrading to Adobe Campaign V8. The hosted environment has posed challenges in maintaining real-time communication with our internal systems.

Our specific use case involves using Kafka to enhance data freshness and streamline the flow of information between Adobe Campaign and other internal IT systems. This would significantly improve the efficiency and relevance of our marketing campaigns.

I hope this helps in understanding our request. Any further assistance or guidance would be greatly appreciated.

Best regards,

Cedric