Question:

How can I make sure my robots.txt file grants access to Google crawler?

by Guest3773  |  12 years, 8 month(s) ago

0 LIKES UnLike

I tend to know how I can make Google crawler to access my pages

 Tags: Access, crawler, File, Google, Grants, robots.txt

   Report
Answer The Question I've Same Question Too

1 ANSWERS

Sort By: Date  |  Rating
  1. Guest1584
    Simply add the following two lines of text to the top of your robots.txt file if you like to grant Google crawler to access your pages:
    • User-agent: Mediapartners - Google
    • Disallow:

Sign In or Sign Up now to answser this question!
You're reading: How can I make sure my robots.txt file grants access to Google crawler?

Question Stats

Latest activity: 13 years, 2 month(s) ago.
This question has 1 answers.

BECOME A GUIDE

Share your knowledge and help people by answering questions.
Register Now