Changes to Marketo Salesforce Sync – Under The Hood | Community
Skip to main content
Mike_Reynolds2
Level 10
August 5, 2016

Changes to Marketo Salesforce Sync – Under The Hood

  • August 5, 2016
  • 31 replies
  • 15398 views

Included in this article

Highlights

  • The MLM package in SFDC’s AppExchange is being retired.
  • The MLM package itself doesn’t do much, but was responsible for installing 16 custom fields (16 on the Lead object and 16 on the Contact object) that sync data from Marketo to SFDC like Lead Score and Acquisition program.
  • The configuration update will shut off the sync of data to the MLM package and these fields, so the data in those fields in SFDC will become stale and won’t update.
  • You can keep syncing this data to SFDC but it requires creating new custom fields. When the fields are re-created, a drip process will be triggered to backfill existing data from Marketo into the new fields in SFDC.

No Data Will Be Lost

Marketo is the source of this data, and the data inside of Marketo will not be touched. The data in Marketo will continue to stay current as it always has. The change being made is in how it is passed into SFDC. No matter what, the data will be preserved inside of Marketo.

What is the MLM Package?

The MLM package doesn’t actually do a lot on its own. It has been a prerequisite that had to be installed during the Marketo > SFDC integration setup before the MSI package could be installed but it’s a pretty safe bet that hardly anyone actually uses it. It’s the fields that were installed during its installation that get the most usage. 

The fields that the MLM package created are frequently used by sales teams inside of SFDC. Data from the Marketo fields passes into these fields in SFDC where it can be viewed on Lead and Contact records (if you’ve added it into the page layout).

Telling the Difference Between MLM and MSI in SFDC

MLM and MSI are two different tabs inside of SFDC. It’s important to know which is which.

  • The Sales Insight tab is the tab labeled “Marketo”.
  • The MLM tab is labeled as “Marketo Lead Management”

Fields Affected

When the configuration change happens, no data will be synced from these 16 fields in Marketo to the 32 corresponding SFDC fields (16 on the Lead object, 16 on the Contact object).

Lead Score

Acquisition Program

Acquisition Program Id

Acquisition Date

Original Search Phrase

Original Source Info

Original Source Type

Original Referrer

Original Search Engine

Inferred Company

Inferred Metropolitan Area

Inferred Phone Area Code

Inferred State Region

Inferred City

Inferred Postal Code

Inferred Country

The Changes Being Made

For most customers, the only fields commonly used are Lead Score and Acquisition Program. While these fields will stop updating in the Lead detail pages, it’s important to remember that the Lead Score data will still be available through Sales Insight without any changes being made.

Effects on Sales Insight

MSI will have very little change made. The Stars and Flames will still function the same way, and lead scores will still update and display current information. Only one change will affect MSI, and it will have a very limited scope.

Scoring Still Displays in MSI

The Sales Insight Score tab on Lead records in SFDC will continue to show up to date score information. This view will not be impacted in any way.

Stars and Flames Still Function the Same Way

MSI’s Stars and Flames will still update with data the same way that they did before, even if you have set them up to work with custom score fields on the Marketo side.

For more information about Sales Insight’s Stars and Flames, please check out the documentation here:

The Only Change Inside of MSI

There is only one small change to the MSI package. If you have "Debug Mode" enabled in Sales Insight Config (pretty rare), then inside of Sales Insight, if you mouse-over the Stars, you’ll see a label that gives the score.

This functionality relied on a dependency between MSI and MLM that has been patched and removed now. As a result of that change, the score can’t be displayed in the hover-over label. Again, this score only ever appeared if you had debug mode enabled, which is very uncommon.

Exceptions to MSI Patch

The MSI patch wasn’t able to upgrade every version of MSI. A very small number of customers who have an older version of MSI currently can’t be updated by the patch and will need to manually upgrade their MSI installation. If your company uses Marketo Sales Insight version 1.38 or below, you will be required to manually upgrade to the newest MSI package version.

Identifying Your MSI Version

To check what version of MSI you’re currently using, navigate to Admin > Sales Insight, then look for the Version info in the Status box in the middle of the page.

Manually Upgrading Your MSI Package

If you find that you are using MSI Version 1.38, you’ll need to manually upgrade your Sales Insight package. The directions on how to upgrade MSI can be found here: Upgrade Marketo Sales Insight for Salesforce1 - Marketo Docs - Product Docs

If you’d like help with this installation, please feel free to reach out to Marketo Support with the directions found here: Contact Marketo Support

Effect on Fields in Lead Layout Page

The change that will be noticed will be to the fields shown in the Lead detail pages in SFDC. If you have any of these fields like Lead Score added to the layout of your Lead detail page, these are the fields that will no longer update and will begin displaying stale data.

If your sales teams utilize any of this data, you’ll want to recreate the fields in SFDC to pull in the updated data from Marketo.

Keeping Field Data in SFDC

The sync of data into these 32 fields (16 on the Lead object, 16 on the Contact object) will be shut off. If you want to keep syncing data from these fields to use it in SFDC, that can be done. You’ll need to create new custom fields in SFDC for the Marketo data to sync into, using specific API names to match up to the original Marketo fields.

There are different versions of Salesforce, but don't worry, all of the details on how to recreate the affected fields as well as a video tutorial can all be found in the documentation here: Adding Marketo Fields to Salesforce

Cut Off Date

The MLM package will be officially deprecated as of January 31st, 2017. The data will stop syncing to the fields created by the MLM package after this date.

Backfilling Data

Creating the new custom fields will kick off a drip process to backfill the data from Marketo to SFDC. That takes all existing data for these fields from Marketo and pushes it back to SFDC into the new custom fields you’ve created. There are some important details to how this process works, so here they all are!

  • The data backfill process will only initiate if you recreate the old fields using the proper API names as specified.
  • The backfill process goes through a separate communication “pipeline” outside of the standard sync cycle.
  • The backfill process will push data at roughly the same rate as the “Push Updates” rate we get now in the regular sync—somewhere between 7k to 12k records per hour.
  • The total time it takes to update all records will vary depending on sync rate in the separate “pipeline” and the number of records being updated.
  • Once the backfill process is complete, an instance notification will be posted in the Marketo notification center.
  • The backfill process updates the new fields in SFDC records with the data that is in the 16 Marketo fields. When this update happens, it will create a SysModStamp on the record in SFDC. Any new SysModStamp will queue the record to resync back to Marketo.
  • If a lead record is in line waiting for the backfill process to pass updates to SFDC and that record gets resynced through the standard SFDC sync cycle before the backfill is done for that lead, that record will be taken out of the queue of records waiting for the backfill process. This is done intentionally to prevent race conditions where old data could potentially overwrite more current data.

SFDC Sync Backlog

  • Any time a large number of records are queued to resync between Marketo and SFDC, it could cause a sync backlog.
  • A sync backlog is only a possibility, not a certainty. Most customers will not have any problems. The rollout schedule has been staggered out over time specifically to address this issue and to prevent sync backlogs.
  • The backfill process passes data through a different channel, outside of the standard sync cycle, so it won’t cause a backlog in that process. It’s the resyncing of the records after the backfill that puts stress on the sync cycle. That standard sync cycle is where you may experience slowness if a backlog develops.
  • The resulting resync of leads will increase volume and put a heavier load on the sync. However, whether or not it actually creates a backlog in the sync cycle depends on many factors like your existing sync volume and if you have any other large number of updates being made.
  • If you think your sync cycle is experiencing a backlog, please reach out to Marketo Support. We can check the existing volume for both the standard sync cycle and the backfill process.

Cleaning Up SFDC

The MLM package and the 32 fields created by it (16 on the Lead object, 16 on the Contact object) will be orphaned and no data will continue to be synced to them, making them obsolete. Since they’ll be unusable, you may want to remove the MLM package and delete the fields. This process is optional, but can be done if you choose.

Uninstalling the MLM package deletes fields, data and workflows created by the package. Any dependencies like for reports or workflows inside of SFDC that you have created based off of these fields will need to be removed manually. If these other custom dependencies exist, they’ll need to be removed before uninstalling the MLM package.

For information on how to uninstall AppExchange packages from SFDC, please see their documentation here: Uninstalling a Package

For detailed information on how to avoid problems elsewhere in SFDC, please see our documentation here: Changes to Marketo Salesforce Sync – Preventative Troubleshooting

Preventing Problems in SFDC

Since the fields in SFDC are brand new fields that have just been created, everything in SFDC that references the original fields will need to be updated to point to the new fields instead. This includes all Workflows, Apex Triggers, AppExchange packages for 3rd party software and Reports.

As soon as the new fields are recreated in SFDC, the Marketo fields are remapped to those new fields. The backfill process begins and the sync is cut off to the older existing fields, so they immediately stop updating. This results in two important things to be aware of:

  1. Everything in SFDC referencing the older original fields will be referencing old data that is no longer updating.
  2. The backfilled values entered into the newly recreated fields will be seen by SFDC as brand new values, not the existing values that they are in Marketo.

This can cause your Workflows, Apex Triggers, AppExchange packages for 3rd party software and Reports to all behave differently. For full details on this, please see Changes to Marketo Salesforce Sync – Preventative Troubleshooting

Where to Go for More Information

  • Recap Summary

Now that the changes have been completed, and the deprecation date has passed, this doc will give you the overview of what has happened: Changes to Marketo Salesforce Sync - Recap Summary

  • Frequently Asked Questions

Check out our FAQ for the answers to the most commonly asked questions. Changes to Marketo Salesforce Sync – Frequently Asked Questions

  • Discussion thread

We've created this discussion thread in the community to address any questions you may have. This discussion thread will be monitored by the Marketo team to ensure you get answers to your questions. Changes to Marketo Salesforce Sync – Questions and Discussion

  • Overview Documentation

This doc will give you a high level overview of what the configuration changes are and what to expect moving forward: Changes to Marketo Salesforce Sync - Overview

  • Release Schedule

The release is being staggered over the course of 6 months. This doc will give you exact details so you can know precisely when your Marketo instance will be updated. Changes to Marketo Salesforce Sync – Release Schedule

  • Recreating Affected Fields

There are different versions of Salesforce, but don't worry, all of the details on how to recreate the affected fields as well as a video tutorial can all be found in the documentation here: Adding Marketo Fields to Salesforce

  • Preventing Problems In Salesforce

Recreating the new fields in Salesforce can cause your Workflows, Apex Triggers, Reports and AppExchange apps behave differently. They'll need to be updated and this doc will show you what to watch out for: Changes to Marketo Salesforce Sync – Preventative Troubleshooting

  • Contact Marketo Support

If you would prefer to talk to someone live, please contact Marketo Support over any of the channel listed here: Contact Marketo Support

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

31 replies

August 9, 2016

Mike, this is one of the better technical docs on a system change. Written in plain English. Thanks.

Mike_Reynolds2
Level 10
August 9, 2016

Thanks Jeff!

Level 2
August 9, 2016

Hopefully I'm wrong here, but if I wanted to run a Lead Score upon lead-contact conversion report in SFDC, I'd be SOL after this.

Let's say I go through the steps and create a new SFDC field to re-map Lead Score to - it wouldn't be able to backfill any lead data for already converted leads in SFDC, right? It would only be able to populate to the Contact record. I would have to do one of the following:

  • Maintain 2 fields: the obsolete, original Lead Score field and the new Lead Score field in my report and try to consolidate the data
  • Export all data from before the cutoff date and combine reports after
  • Only report on data after the cutoff date

Either way, I don't think it's going to be a very clean solution.

Mike_Reynolds2
Level 10
August 9, 2016

@Sam Chou​, As long as the new field that gets recreated is set up in SFDC with the correct API name, it will be remapped to the original Lead Score field in Marketo, and the backfill process will pull the data over from Marketo into SFDC into that new field.

As long as you recreate the new fields on both the Lead and Contact objects, the standard two-to-one mapping and backfill process will take care of the rest from there. The one Marketo Lead Score field will be mapped to the new Lead Score field on both Lead and Contact objects in SFDC. If the record is a Lead, the data from Marketo goes into the Lead Score field on the Lead object. If the record is a Contact, it would pass the data from Marketo to the Lead Score field on the Contact object.

The records in SFDC can only be a Lead or a Contact and can't be both. Whichever record type it is, the Lead Score data from Marketo will be pushed over to the Lead Score field for the record in SFDC

Level 2
August 9, 2016

Thanks Mike - so just to confirm - in my use case, if I wanted to run an SFDC report for Lead Score at time of lead-contact conversion, I would not be able to do it historically --> Only from the time the new field gets created and remapped.

Mike_Reynolds2
Level 10
August 9, 2016

We don't have much visibility into SFDC reporting since it's not our product so it gets a little difficult there. But, is this report one that would give you info on what the field value was at the time of the conversion? As in, previous historical values at the time of lead conversion?

If so, that would be an issue. If it's a new field, it will only have data as of the date when it was created. You'll still have that activity history from the original Lead Score field, so as long as it's still there, you wouldn't lose the information, but you'd have to pull it from the other field, not the new one.

All of the scores themselves will be retained, but if I'm understanding you correctly, it's the historical activity log of the field value changes within the field at the time of lead conversion you're looking for, which may not be available.

SFDC may have some advanced reporting capability to where if the Lead was converted prior to date X, search for the score value from the original Lead Score field, if after date X, search from the new score field. I don't know if they do since it's not our product, but it's worth checking into with SFDC

August 10, 2016

Well, Good Morning, Marketo. It's always fun to have my schedule hijacked by a problem requiring my immediate attention. And here I thought I was going to spend my day working on marketing automation projects.

"We don't have much visibility into SFDC reporting since" ... Marketo is not an appX partner. I am sure SFDC support is going to be inundated with many overlapping questions.

I can't believe I am saying this, but thank god we didn't install sales insight! This screenshot, however, is indicative of our Marketo experience to date:

And then there is this tab, it is a blank white page:

And these of which I had quite a few, at least I'm not still getting these sassy pictures to taunt me now, just emails that disappear and have to be recreated, and tech support doesn't know why because they can't recreate the exact conditions.

In our instance, I think since the lead scoring has not had any impact, my chief concern is with acquisition and source data.

And wondering what will be next.

Mike_Reynolds2
Level 10
August 10, 2016

@Marilyn Babb​ The troubles you're having are a main driving reason why Marketo continues to develop new ways to improve the product and design. It's not always an immaculate experience, which is why we always listen and try to improve as we go, just like other SaaS companies.

Your first screen shot is of the MLM package that is being deprecated. It never really did anything, which is why it's being retired, so that you won't get those error screens any more.

The second screen shot of the About Marketo tab is another one that needs to be updated as well. It's not in this particular release, but it's on the radar for the future. If you'd like to remove it, the first part of the directions here will show you how to change which tabs show up: Add Marketo Sales Insight Tab and Buttons to Salesforce - Marketo Docs - Product Docs

In terms of our Support team, duplicating a problem is one of the key troubleshooting steps we try in order to resolve an issue, but depending on the situation, there are usually other methods of troubleshooting we can try. If you ever have problems with your experience with Support, you can email SupportEscalations@marketo.com to get in touch with the management team. Just be sure to include your case number so they can track it down faster.

For the concern about Acquisition Program and the Source fields, recreating those fields will certainly pull the data back over so there won't be any loss there. Just as a tip, if you're interested in more information about tracking lead sources, try out this doc, it's gotten a lot of positive feedback: Tracking Lead Sources

For the last screenshot, the 500 errors come up when a Marketo page can't be located. There are a wide variety of reasons why that could happen, the most common being a malformed URL in the browser. But there's many other possibilities as well. Best recommendation is to reach out to Support and make sure you include the URL that's giving you the problem. Contact Marketo Support

Hope that helps

Michael_Langell
Level 4
August 11, 2016

Hi @Mike Reynolds​

So in order to keep these 16 fields I need to create new fields in SFDC and make sure the API name just has mkto71 appended to the API field name? The rest of the API field name should stay intact?  So if I wanted to continue syncing original referrer, I would create the following field below and then the backfill process would update that field with data from mkto2__Original_Referrer__c during my scheduled release time? 

New original referrer field: mkto71_Original_Referrer__c

Thanks,

Mike

Mike_Reynolds2
Level 10
August 11, 2016

UPDATED: Edited my comment here - Had a copy/paste mistake in the table. Please check the docs for exact procedures: Adding Marketo Fields to Salesforce

Hi Mike,

I'd be careful with trying to make it a pattern like just adding mkto71 to the end of the API names. The API names do need to be exactly correct in order for them to match up to the original Marketo fields and initiate the backfill process.

The details on creating the fields can be found here: Adding Marketo Fields to Salesforce Enterprise/Unlimited Edition

And a video tutorial on how to do it can be found here: Video Link : 1475

Hope that helps!