Question:

What should I do if I don’t want Alexa to crawl my site?

by Guest3476  |  12 years, 8 month(s) ago

0 LIKES UnLike

I don’t want Alexa to crawl my website. What I’m supposed to do, please guide me.

 Tags: Alexa, crawl, dont, site

   Report
Answer The Question I've Same Question Too

1 ANSWERS

Sort By: Date  |  Rating
  1. Guest7434
    Alexa does not wish to crawl anything you want to remain private. All you have to do is tell them. By using a simple robots.txt file you can do so. Robots.txt files are the most widely used standard on the Web for telling crawlers where they should and should not go on your site. All major crawlers respect these robots.txt files, including those from Google, MSN, Yahoo!, etc. There is extensive information about how to create a robots.txt file on Alexa on their Webmasters help page at http://www.alexa.com/help/webmasters.

Sign In or Sign Up now to answser this question!
You're reading: What should I do if I don’t want Alexa to crawl my site?

Question Stats

Latest activity: 13 years, 3 month(s) ago.
This question has 1 answers.

BECOME A GUIDE

Share your knowledge and help people by answering questions.
Register Now