How does Google view your site?

[Mr Happy]

Right this idea sorta came form my link checker and a previous post and idea of making a site more friendly for iphone users.

Then I thought 'How does Google view a site'? The results vary a lot.

I've made this script that allow's you to see your site exactly how Googlebot see's it. So what's the big deal? Well enter a random URL of any page from WJ into the box (eg this one) and see that no GFX, CSS, Javascript, Shoutbox or anything else of no use to googlebot is displayed. This mean's Googlebot can crawl the site a lot faster. Same for most other big site's I've checked like Digital Point, Warez Raid etc. Most high indexed sites (with the exception of a few such as Warezscene) generally have a spider skin.
Now look at eg. Warez-Centre and see that all GFX, CSS, and javascript are loaded and it takes much longer. Simillarly USAwarez, WarezLobby, etc show everything making them far slower to crawl.

I made a basic bot like Google's and found that on average site's with spider skin's were crawled 90% faster. That's a LOT and can only help your chances of a better page rank and less crawl errors and timeouts so it might be an idea to add a spider skin if you don't already have one. You can check your site here http://linkzbot.com/hiden-bot.php

 

[DEViANCE]

Nice work, and yeah i have uised spider skins on forums in the past and im sure it makes quite a big difference, you just need a decent/big bot-list so all are forced to use the skin.

 

[dyear20]

every link i try i get a moved permanently error

 

[Mr Happy]

every link i try i get a moved permanently error

Strange. no idea what's causing that. Warez Trap works fine for me when checked. It show's the full skin, all the images, CSS and javascrit etc., though so it's slow for googlebot.

 

[Hyperz]

Doesn't display it correct, your script needs finetuning m8. Also, this one is better http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/index.htm .

 

[kholu]

Good work Mr Happy
Got an idea how Gbot see our pages

 

[dyear20]

Doesn't display it correct, your script needs finetuning m8. Also, this one is better http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/index.htm .

i tired that site it showed my site but had 404 images all over the place like i dont have my images uploaded lol

 

[Curtis129]

Moved Permanently

The document has moved here.

 

[boris]

my site is seen properly woohoo i make bot use lofi

 

[CyberJ37]

Having a "spider skin" is considered cloaking. Which Google does not like/forbids.

 

[Mac]

No, letting spiders to crawl parts of your site that are usually not open for guests or displaying some other content just to Google is cloaking. Do your homework.

 

[Mr Happy]

No, letting spiders to crawl parts of your site that are usually not open for guests or displaying some other content just to Google is cloaking. Do your homework.

+1

Having a "spider skin" is considered cloaking. Which Google does not like/forbids.

having a separate skin for spiders is encouraged. Do you honestly think sites like Digital Point which specialize in custom SEO and Google Ranking chat would have their whole site cloaked to Google and risk being banned. Think about it.