Technology in terms you understand. Sign up for the Confident Computing newsletter for weekly solutions to make your life easier. Click here and get The Ask Leo! Guide to Staying Safe on the Internet — FREE Edition as my thank you for subscribing!

Can I remove a link from Google using robots.txt?

Google has informed me that a link can be removed from Google
if the webmaster of the site uses a robots.txt file. However,
Google can not confirm if other engines can do the same-MSN,
Yahoo etc. Should a webmaster be able to remove a link from
other search engines by using the robots.txt file described by Google?

First, let’s be clear – it won’t remove anything. I assume
that someday the link will disappear off of Google as it
loses relevance, or maybe Google does something more related
to cleaning dead links.

But robots.txt is still important for several reasons.

Become a Patron of Ask Leo! and go ad-free!

Robots.txt allows you to tell Google not to look at the
pages in the first place. Google doesn’t look, and the
contents don’t get added to its index.

All search engines are supposed to pay attention to
robots.txt. And most well behaved major engines do. MSN,
Yahoo, and so on are all major engines and do the right
thing.

However do know that there are other search engines
and crawlers that don’t
pay attention and will spider your site anyway.

Search Engine World has a good tutorial
on robots.txt
.

Update: my friend Paul Myers of TalkBiz News sent along this pointer to Google’s own page: Remove Content from Google’s Index which covers many of the points made here in more detail.

Subscribe to Confident Computing! Tech problem solving & safety tips & a weekly confidence boost in your inbox every week.

I'll see you there!

10 Reasons Your Computer is Slow

Slow Computer?

Speed up with my special report: 10 Reasons Your Computer is Slow, now updated for Windows 10.

NOW: name your own price! You decide how much to pay -- and yes, that means you can get this report completely free if you so choose. Get your copy now!

2 comments on “Can I remove a link from Google using robots.txt?”

  1. I post my CV to expatjobs.com. This site inturn posts my CV on google search engine.I really feel bad.My name is Habteleul.If you searched this name using google,you will get my CV.How can i remove it from this page.

    Thanks;

    The short answer is that you probably can’t. Once something is out on the internet it’s copied and mirrored and archived in so many places that removal next to impossible. Check out this article: How do I remove myself from the search engines?

    – Leo
    04-Oct-2008
    Reply

Leave a reply:

Before commenting please:

  • Read the article.
  • Comment on the article.
  • No personal information.
  • No spam.

Comments violating those rules will be removed. Comments that don't add value will be removed, including off-topic or content-free comments, or comments that look even a little bit like spam. All comments containing links and certain keywords will be moderated before publication.

I want comments to be valuable for everyone, including those who come later and take the time to read.