Collecting stat from Bulk Import | Community
Skip to main content
August 9, 2018
Question

Collecting stat from Bulk Import

  • August 9, 2018
  • 1 reply
  • 1827 views

Hi

I am sending multiple CSV file for Bulk Load and in the run window see the following information for the request:

[DEBUG]: org.talend.components.marketo.runtime.MarketoSourceOrSink - ClientService : Marketo REST API Client [XXX-XXX-XXX.mktorest.com/rest].

[DEBUG]: org.talend.components.marketo.runtime.client.MarketoBulkExecClient - bulkImport XXX-XXX-XXX..mktorest.com/bulk/v1/leads.json?access_token=xxxx-xxxxxxxxx-xxxxxxxx:ab&lookupField=email&format=csv.

And the response as:

[DEBUG]: org.talend.components.marketo.runtime.client.MarketoBulkExecClient - rs = BulkImportResult{requestId='5db2#1651ee022e4', success=true, errors=null, result=[BulkImport{batchId=1644, importTime='null', importId='1644', message='null', numOfRowsProcessed=null, numOfLeadsProcessed=null, numOfObjectsProcessed=null, numOfRowsFailed=null, numOfRowsWithWarning=null, objectApiName='null', operation='null', status='Queued', failuresLogFile='', warningsLogFile=''}], moreResult=false, nextPageToken=null}.

I am gathering the stats in a table for each load and filename is part of that column. I had assumed that since I am sending a filename as the parameter for Bulk Load, when I get back the response, I can capture the response data elements for the same filename. But I do not see the filename going as an parameter and when I update the response stats based on the filename, I am not necessarily updating  the same filename record (when there are multiple ones).

As part of my design, I will have to collect this stats to see how many records per file we are sending and how many loaded and how many had warning and failures.

Any insights will be appreciated. Wanted to know what information can tie back the response to the request.

Thanks in advance,

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

1 reply

SanfordWhiteman
Level 10
August 9, 2018

This is really a Talend question, not a Marketo question.  You won't be able to change the audit trail if you're using a fixed integration platform.  If you were building your own integration this would be possible.

August 9, 2018

What in the request parameter for Bulk Import is telling that the request is tied to a particular file.

I can check with Talend community, but this seems to me more like a parameters related Qs for Bulk Import - how do  I tie a request to the response.Need some direction.

Thanks

SanfordWhiteman
Level 10
August 9, 2018

The batchID.