MSN Ignoring Robots.txt Files
Posted: May 13, 2006
Is MSN ignoring robots.txt files?
Here’s a screenshot from the MSN search for ‘Marissa Meyer’:
Here’s a screenshot of Google.ca’s robots.txt file:
Seems there’s a discrepancy between Google’s robots.txt file disallowing search results to be indexed and MSN having indexed the Google file: www.google.ca/search?q=marissa+meyer+google.
Might be time to start checking MSN results to make sure certain files aren’t being indexed.
- Google’s Marissa Meyer
- Wordpress Help Files
- Q&A: How can I tell if Google’s Ads Bot can spider my landing page?
- Backing Up Microsoft Outlook
- Excel 2007 Supports Over 1 Million Rows
Comments
Google AdWords
Seminars for Success
Learn about Google AdWords from experts hand selected by Google.
These seminars will educate advertisers on the creation and management of successful AdWords campaigns.
Upcoming Seminars:
Los Angeles Seminar Monday, November 3rd
Seattle Seminar Wednesday, November 5th
Learn More about the Seminars:
Seminar Information
Official Google Seminar Page
Suggest a new city
Brad Geddes
Leslie Clark
Other Memberships
