Latest Announcemnent
New thread

Fetch as Googlebot Error?

Status
Not open for further replies.
J

jiefangjun

Banned
Banned
114
2011
5
0
when I use the google webmaster to Fetch as Googlebot.
It turns out Unreachable page.
But I do have robots.txt under my website root dir
I don't know why?
anyone can help me?
btw My site was down for about 10 days due to the bad webhosting.
Is that the reason?
 
10 comments
In webmastools when u click fetch it checks instantly there must be something wrong with the file are u sure u have allow permisions in the robot.txt ?
or is the robots.txt in the correct location ?
 
msk19994 said:
In webmastools when u click fetch it checks instantly there must be something wrong with the file are u sure u have allow permisions in the robot.txt ?
or is the robots.txt in the correct location ?
Click to expand...
I think it's robots.txt not robot.txt
Yes I do have it in public_html dir cos I m using shared webhosting
 
Mine says this:

[slide]http://screensnapr.com/e/n1Zgo6.png[/slide]

However:

[slide]http://screensnapr.com/e/dA4zyK.png[/slide]

It appears to still be finding it because it downloaded it 49 minutes ago.
Seems to be working for me.
I don't know if this is the same issues as your having or not ?

But I can definitely access

Code: 
[STRIKE][URL="http://www.wjunction.com/www.kengyea.com/robots.txt"]www.kengyea.com/robots.txt[/URL][/STRIKE]
edit: Ahh.. I was to slow with my comment, I see your correct URL above :)
 
msk19994 said:
who places a sitemap in robots.txt ???
u submit the sitemap to google directly

and it should be like
Click to expand...
I m using sitemap plugins in wp
I don't think that's the problem.
many sites put sitemap in robots.txt as far as I check.
In my webmaster tools it shows Unreachable page.:'(
 
Status
Not open for further replies.
Back
Top