Merging duplicate records in bulk | Community
Skip to main content
J
jc49227835
Level 2
November 1, 2018

Merging duplicate records in bulk

  • November 1, 2018
  • 3 replies
  • 7449 views

Hi everyone.

We have a task of identifying and merging duplicate records into one record, we are having a hard time identifying how to do that in bulk.

Scenario

There are thousands of records that share the same email but different source ID,  we want to merge all records into one keeping the lowest sourceID. any ideas on how to tackle this are greatly appreciated it

Campaign Classic

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

    3 replies

    D
    DebTr
    Level 6
    November 1, 2018

    Hi jc49227835​,

    If you want to keep the record with lowest source id and delete the other ones and identify duplicates based on email, something like following can help.

    Deduplication activity.

    Regards,

    Deb

      J
      jc49227835Author
      Level 2
      November 1, 2018

      Thank you, one thing is we would like to keep/merge the delivery logs and tracking logs of all the other records on the one with the small source ID

        D
        DebTr
        Level 6
        November 1, 2018

        Hi jc49227835​,

        Do you mean to say that, you want to keep the broad log/tracking log only for the records related to lowest sourceId and delete the rest?

        Regards,

        Deb

          J
          jc49227835Author
          Level 2
          November 1, 2018

          Sorry, no. quite the opposite, we want to keep/merge the broadlogs/tracking of all the duplicates into the one with the lowest SourceID, then delete the duplicate records. hope that makes sense

            D
            DebTr
            Level 6
            November 1, 2018

            Hi jc49227835,

            In that case, you can update the duplicate sourceIDs with lowest sourceID in broadlog/tracking log tables using the same workflow. It is better not to play around much with the logs. Any way they gets purged depending on your settings.

            Regards,

            Deb

              J
              jc49227835Author
              Level 2
              November 15, 2018

              Thank you Deb,

              Sorry for the late reply, we had put this in the back burner for a while, I would not want to play around with the logs if there is a possibilty they get purged. would there be another way? or we are out of luck and should decide if we just want to keep/delete the duplicates even though they have deliveries associated with them?

              I know there is a merge action on the list (only processes 2 records at the time) could this not be repurposed to do in tn bulk?

              Thank you again

              Terms & ConditionsAccessibility statement

              Loading footer...