batch load history into streaming dataset for streaming evaluation

[DavidSlaw1]

Say I have a set of current profiles in and enterprise database.  I could load all those profiles as a batch job.  However, after that load, all the new profiles and updates are ingested via streaming processes.  I need the streaming because using AJO I need to enable streaming evaluation.  Now if I load the initial profiles as a batch load and ongoing changes (new or updates) as streaming, will AJO be able to use the profile attributes for streaming evaluation?

[DavidSlaw1 · Accepted solution]

Answer:  Data ingested via batch is associated with a batchID (as a batch load) which will prevent using any data loaded in that batch in a streaming evaluation.  Later data that arrives vis streaming will be tagged as streaming and can be used in streaming evaluation.  Thus, until all of the historical batch loaded profiles get updated via the streaming process, most of the profiles could never be evaluated as streaming.