Hi
We are attempting to integrate Adobe with a Kafka stream.
I have created a custom connector that invokes xtk.session.WriteCollection function for every batch of kafka record.
It seems that our Kafka stream contains multiple versions of the same records. Basically, every time when one of record attribute has changed, the new record is published to the stream and these records can come really quick, with one or several consecutive batches. The latest record only needs to be recorded in Adobe DB and there is record sequence number to distinguish which of them are latest.
I cannot figure out how to create write request with a condition. What I want is to add a condition, something like in xtk.queryDef <condition exp={"@sequenceNumber < " + currentSequenceNumber }/>. Is something like that possible with xtk.session.WriteCollection and what should be an exact syntax for the XML document?
I have noticed another function like xtk.session.ImportCollection and xtk.queryDef.Update, but I cannot find any decent documentation or examples on them.
Is there any way to record collection with a condition except parsing schemas and generating raw SQL queries?