Need guidance on Adobe I/O Journaling API

Hi @sdusane , valid questions when first time using the Journaling queue. I wrote an article how we leveraged Journaling with code examples at each layer. https://medium.com/@bsaravanaprakash/building-content-supply-chain-using-workfront-aio-journaling-appbuilder-runtime-actions-finally-4d7a6ca0fbf2

So lets breakdown,

1. Why Journaling batches just have 2-3 events at a time, I cant see full queue of events with Postman Get request?. - We dont do REST APIs over Event-Driven Architecture. We dont write single servlet or postman request to read all events and process immediate. Instead we build listeners/subscribers. The listener wakes up whenever events are available at Journaling. For AWS its lambda, for Azure its function, here in Adobe AIO its Action. You ll write a non-webaction, subscribe to the journaling queue and process the event. 
2. How can I pull maximum events from journaling queue? - You ll use RxJS observable. Per Step3 in my article, you ll write a function like this.async function fetchEventsUsingSDK(state, since = "") { logger.info("Checking events after index: " + since); const client = await sdk.init(imsOrgId, clientId, oauthToken); const baseURL = `https://api.adobe.io/events/organizations/${consumerOrgId}/integrations/${credId}/${registrationId}`; const journalOptions = since ? { since: since } : undefined; const journalObservable = await client.getEventsObservableFromJournal( baseURL, journalOptions ); journalObservable .pipe( filter((evt) => evt.position && evt.event.data), concatMap((evt) => { return of(evt).pipe( concatMap((event) => processEvent(event).then(() => event)) ); }) ) .subscribe( async (x) => await saveEventIndexToState(state, x), // any action onNext event (e) => logger.error("onError: " + e.message), // any action onError () => logger.log("onCompleted") //action onComplete ); }This will fetch all the events while the action is awake 
3. How this Journaling is working? detailed documentation. Idea is, its a Apache Kafka queue. First-in First-out. Different adobe products or custom event publishers push events into queue. Journal stores events upto 7 days. And different subscribers can listen and consume events. Same event can be consumed by multiple subscribers.  
4. What is the risk here to return whole events at that moment from Journaling queue? No risk in reading out and processing all events at same time. Journaling queue doesn't restrict. Usually its listner / subscriber problem. Say you are reading the event, downloading asset and writing into some 3rdparty DB. The listening end will have capacity problem. You might not be allowed to download more than a limit or simultaneous write too many records parallel. Due to which, you need to throttle. Process events one-by-one. Even simplest operation of logging event, will have its boundary. You might not be allowed to log million events into your splunk at same time. So its not risk of journal queue. Its risk of subscriber processing the event.

Hope this clarifies.