I got few question reading Google, SEO And WarezIT

[lig}{tning]

I got few question reading Google, SEO And WarezIT

1. In my Webmasters -> Tools -> Dashboard i see this Crawl errors how can i fix this problem?

[SLIDE]http://lulzimg.com/i09/b0c7f6.png[/SLIDE]

2. This is my robots.txt is this ok or do i have to add extra bits on it? http://warezit.org/robots.txt

3. Here is WarezIT site Description & Keywords is this ok?

site Description:
WarezIT provide free full Warez Downloads, such as Applications, Movies, Tv Shows, Games, Music, Video, Releases, and much more

Keywords:
free full warez downloads,full warez downloads,free warez downloads,warez downloads,applications,movies,tv shows,games,music,video,rapidshare forum,hotfile forum,fileserve forum,filesonic fourm,megaupload forum,dvdrip,2010,xxx,porn,

How can i improve WarezIT to get more google organic tarffic?

right now am getting google (organic) tarffic 40 to 50 a day
and my Direct Traffic going down how can i improve?

Thanks

 

[krazeek]

I'm getting similar mate, but this is what mine looks like:

 

[lig}{tning]

but why are we getting it ?
how can we fix it?

 

[krazeek]

Not sure, I'm kind of looking into it. It really isn't affecting my organic traffic. It says robots.txt unreachable but I can access it just fine :\

 

[Mr.WT]

light i already face this problems change the hosting ur prob will solve

 

[lig}{tning]

^^ Mr.WT what is this problem to do with hosting?

@right now i got Crawl errors Not found -668 its going up

 

[cgworld]

not found means maybe the post has been deleted , google is very smart.

 

[lig}{tning]

i have googled and found few info about Crawl errors but am still struggling how do i remove or delete the 404 error pages from my site?

 

[kiddo]

@krazeek: You robots.txt file is downloaded by google I think 2 times a day. At the momnet when its bout to be downloaded if ur site goes offline for a few seconds or minutes, then you get this error as the file is not reachable.

@lightening: There are several reasons why you could get crawl errors mate. I'll give you an example:

Say you have 5 posts per page and in all 50 posts. So you will have a total of 10 pages. Now assume google has indexed these 10 pages.

Tomorrow you restructure your site to have 10 posts per page. So now you have only 5 pages. The remaining 5 pages are gone from your site but they are indexed in google. So now google cannot reach them. This will result in crawl errors. Similar is the case with tags, deleted posts and stuff or your site going offline.

Hence there could be various resons that contribute to cral errors. I hope this explians it well enough in brief.

 

[filesonic1]

I'm getting same error.