Disallow files in Design Studio to be crawled | Community
Skip to main content
Jean-Pascal_Mer
Jean-Pascal_Mer
Level 4
February 25, 2016
Solved

Disallow files in Design Studio to be crawled

  • February 25, 2016
  • 4 replies
  • 3777 views

Hi folks,

I'm looking for a way to disallow files uploaded in the Design Studio to be crawled.

We have an area of our website we are hiding from search engines, but because these pages link to PDF hosted in the Design Studio, robots still crawl the pages and result in some organic traffic hitting the pages.

Anyone know of a way to do this and keep the files in the design studio v. switching files to an in-house server.

Thanks

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Edward_Unthank_

Hey Jean-Pascal, you can call up Marketo Support and work with them to change your robots.txt file to disallow the Design Studio files (site folder, really) to be archived.

Cheers

Edward

4 replies

A
Anonymous
February 25, 2016

Hey @Jean-Pascal Mercier​, I believe you set your LPs to "no index/no follow" , that should do it. Referring to this post: "No Follow" on Landing Pages?

Edward_Unthank_
Edward_Unthank_Accepted solution
Level 7
February 25, 2016

Hey Jean-Pascal, you can call up Marketo Support and work with them to change your robots.txt file to disallow the Design Studio files (site folder, really) to be archived.

Cheers

Edward

    Jean-Pascal_Mer
    Jean-Pascal_MerAuthor
    Level 4
    February 26, 2016

    Magical!

    Thanks!!

    gkrajeski
    gkrajeski
    Level 10
    February 25, 2016

    @Edward Unthank is correct.  We just did this ourselves!

    Open a support case with Marketo

    Jamie-Carey
    Jamie-Carey
    Level 4
    March 28, 2017

    I'm actually shocked to find out this is the default that those files are indexed. For a business that is built on gated content for leads, this is a HUGE oversight.

    Terms & ConditionsAccessibility statement

    Loading footer...