Marketo CO data access issue | Community
Skip to main content
M
mlohot
Level 2
January 29, 2025
Solved

Marketo CO data access issue

  • January 29, 2025
  • 2 replies
  • 1292 views

We are loading more than 100 records per lead in CO since it is a business requirement. 

Marketo application have a limitation, It only allows to access 100 records on UI and in velocity script. 

Therefore, we want to load data in specific order so top 100 records as per their order amount can be accessible in velocity script and also displayed on UI.

We are retrieving data in descending order from database and then load it in Marketo.

We have custom field "Sequence" as a dedupe field and it get incremented for every record.

This is how we load records in Marketo via api.

Sequence    Order Amount          

1                    130

2                    120

3                    110

4                    100

....

120                10


However, we can only able to access records from sequence no. 21 to 120 in velocity script but we can retrieve all records from CO (from sequence no. 1 to 120 records) via api.

Any ideas why we can't access records with sequence no. from 1 to 20.

 

Best answer by Darshil_Shah1

You're right about the hard limit of being able to retrieve a maximum of 100 parent-level CO records at a time in the velocity script, which seems fair given that use-cases that need more than 100 records to build content/logic for email are very rare. As a workaround, why don't you coalesce data into a single (or possible multiple, but <100) CO records' field(s) instead of creating 100 CO individual records? It's clear that you need data (and not trigger campaigns for each individual CO record that is inserted in Marketo), which you'd be able to access and trigger your flow with fewer CO records as well.

2 replies

SanfordWhiteman
SanfordWhiteman
Level 10
January 29, 2025

Marketo application have a limitation, It only allows to access 100 records on UI and in velocity script. 

Therefore, we want to load data in specific order so top 100 records as per their order amount can be accessible in velocity script and also displayed on UI.

By “UI” you mean the Lead Detail » Custom Objects pane? Sounds like a nice-to-have but not sure why it would be hard requirement?

 

Anyway, can you tell us more about the actual shape of these objects? Their exact fields, datatypes, and example data. And how often new objects are created. This will help us think of alternate approaches, because trying to force which ones are the “last 100” over time is generally a doomed exercise.

    M
    mlohotAuthor
    Level 2
    January 30, 2025

    Hi Sanford,

    Thanks for response.

    Showing last 100 records in UI (Lead Detail » Custom Objects pane) is not a hard requirement.

    However, We do have a requirement to access all 100 records that have higher order amount value in velocity script to populate dynamic content in email. We delete old data and load new data in CO every week. 
    We tried loading data in CO by order amount value (In both ascending and descending order) but all 100 records with higher order amount value are not present in velocity script.
    Here is the CO details:

    Dedupe FieldsSequence
    Link FieldGlobal ID
    Linked Object NameLead
    Linked Field Name Global ID

     

    Field NameType
    Sequenceinteger
    Global IDstring
    Order Amountfloat

     

    Please let me know if you need more details

    Darshil_Shah1
    Community Advisor and Adobe Champion
    Darshil_Shah1Community Advisor and Adobe ChampionAccepted solution
    Community Advisor and Adobe Champion
    January 30, 2025

    You're right about the hard limit of being able to retrieve a maximum of 100 parent-level CO records at a time in the velocity script, which seems fair given that use-cases that need more than 100 records to build content/logic for email are very rare. As a workaround, why don't you coalesce data into a single (or possible multiple, but <100) CO records' field(s) instead of creating 100 CO individual records? It's clear that you need data (and not trigger campaigns for each individual CO record that is inserted in Marketo), which you'd be able to access and trigger your flow with fewer CO records as well.

      Darshil_Shah1
      Community Advisor and Adobe Champion
      Darshil_Shah1Community Advisor and Adobe Champion
      Community Advisor and Adobe Champion
      January 29, 2025

      I completely agree with Sandy here. If you wish to see more CO data than permissible by UI in a single view, you can always export the CO data using API. Also, once imported, you should consider sorting the CO based on a particular field and picking the record(s) you need to personalize the email content. We can discuss more on this once you share the fields, their data types, and other CO-related info, as suggested by Sandy.

        Terms & ConditionsAccessibility statement

        Loading footer...