Google Crawler Access

Status
Not open for further replies.

krazeek

Active Member
336
2008
17
0
Lately Google hasn't been crawling my site frequently. As of right now it last crawled my site 10 hours ago. About a week ago it was crawling every hour maybe even more.

I've not changed any of my SEO or anything, just wondering if you guys would might know what the problem was?

Thank you.
 
28 comments
Google Bot crawls whenever there is any new content. The more frequently your site updates, the more will be the time interval of Google Bot visits :)

So, maybe thats the reason ?

Also, try to build few link backs from sites similar to your niche. Whenever google bot crawls their website and finds your link, it'll give significance to it and the probability of crawling your site will increase.

Hope it helps :)
 
Currently using Google Webmasters to track this info which is how I noticed that Google Bot isn't crawling my site as frequently.

And for BlaZe, I put new content on my site whenever there are new TV Episodes out, I'm adding more content now than I was a week ago.

I still get organic traffic, but not to the new content I'm adding.

I had some SEO work done (back-links) about 2-3 weeks ago from someone on here.
 
Alright, I'm gonna do something.

Just to know whether the trick worked or not.

Now :
3Mzh.png

[SLIDE]http://imm.io/media/3M/3Mzp.png[/SLIDE]

I'll update with an reply after 2-3 days when the experiment is over :) Hope it works and your indexing rate will surely increase as I have tried it on my websites :)
 
also make sure ur not stealing other peoples content, maybe google thought ur site just leeching and decided it doesnt need u in its index?
 
Implement pingomatic.com into your script so whenever new content is posted it will ping pingomatic, wordpress does this by default and you don't to overdo it as this is pingspam and could lead to more problems.
 
@krazeek,

Build backlinks. Thats what I said earlier.

3Nyc.png


3Nyf.png


Try to get more and more link backs from other sites.

Wait for a week for the changes to take effect. Whitehat SEO takes time -_-
 
Doesn't make sense though, One week it was every 5-10 minutes and now its 2 times a day if I'm lucky.

It makes perfect sense, why is your website so special to Google that they should worship you? If you want new things indexed immediately after they are posted, then you need a few things:

1. Time, Patience
2. Hard SEO Work
3. More Time

Authority sites get crawled the instant they have something posted, Google knows those sites are providing users with useful, helpful or new content.

Basically, you need to earn trust in Googles eyes, and this takes time and backlinks.
 
It makes perfect sense, why is your website so special to Google that they should worship you? If you want new things indexed immediately after they are posted, then you need a few things:

1. Time, Patience
2. Hard SEO Work
3. More Time

Authority sites get crawled the instant they have something posted, Google knows those sites are providing users with useful, helpful or new content.

Basically, you need to earn trust in Googles eyes, and this takes time and backlinks.
I couldn't have said this better. Awesome :)

c0rrupt is right.
 
^Possibly because in the begining Google visits alot to learn about the way your website works. It checks for changes, new content, backlinks etc then builds a pattern.

Most likely Google decided that crawling you only 2 times a day is enough for keeping track of everything ;)

-Whoo
 
ye you need pingomatic.com and if you already have it then it's maybe because google is making changes always... and maybe there is no unique content or not enought unique content (or the content is just not useful for google algorithms) on your pages or something like that.
 
Pinging is the solution :)

WHAT IS PINGING?
Pinging simply gives a nudge to search engines like Google that your site has made an update, and will probably help to get your site indexed faster .

In you wordpress blog ,go to
setting >writing [look in screnshot]

18022011pm114843.png


and add these to the box ,

Code:
http://rpc.pingomatic.com/
http://pingler.com
http://api.feedster.com/ping
http://api.moreover.com/ping
http://api.moreover.com/RPC2
http://api.my.yahoo.co.jp/RPC2
http://api.my.yahoo.com/RPC2
http://api.my.yahoo.com/rss/ping
http://audiorpc.weblogs.com/RPC2
http://bblog.com/ping.php
http://blog.goo.ne.jp/XMLRPC
http://blogdb.jp/xmlrpc/
http://blogdigger.com/RPC2
http://blogpeople.net/servlet/weblogUpdates
http://www.blogpeople.net/servlet/weblogUpdates
http://bulkfeeds.net/rpc
http://ping.myblog.jp/
http://ping.bloggers.jp/rpc/
http://api.moreover.com/ping
http://coreblog.org/ping/
http://ping.blo.gs/
http://ping.bloggers.jp/rpc/
http://ping.cocolog-nifty.com/xmlrpc
http://ping.syndic8.com/xmlrpc.php
http://ping.weblogalot.com/rpc.php
http://pinger.blogflux.com/rpc
http://rpc.blogrolling.com/pinger/
http://rpc.icerocket.com:10080/
http://blogsearch.google.ae/ping/RPC2
http://blogsearch.google.at/ping/RPC2
http://blogsearch.google.be/ping/RPC2
http://blogsearch.google.bg/ping/RPC2
http://blogsearch.google.ca/ping/RPC2
http://blogsearch.google.ch/ping/RPC2
http://blogsearch.google.cl/ping/RPC2
http://blogsearch.google.co.cr/ping/RPC2
http://blogsearch.google.co.hu/ping/RPC2
http://blogsearch.google.co.id/ping/RPC2
http://blogsearch.google.co.il/ping/RPC2
http://blogsearch.google.co.in/ping/RPC2
http://blogsearch.google.co.it/ping/RPC2
http://blogsearch.google.co.jp/ping/RPC2
http://blogsearch.google.co.ma/ping/RPC2
http://blogsearch.google.co.nz/ping/RPC2
http://blogsearch.google.co.th/ping/RPC2
http://blogsearch.google.co.uk/ping/RPC2
http://blogsearch.google.co.ve/ping/RPC2
http://blogsearch.google.co.za/ping/RPC2

http://blogsearch.google.com.ar/ping/RPC2
http://blogsearch.google.com.au/ping/RPC2
http://blogsearch.google*********/ping/RPC2
http://blogsearch.google.com.co/ping/RPC2
http://blogsearch.google.com.do/ping/RPC2
http://blogsearch.google.com.mx/ping/RPC2
http://blogsearch.google.com.my/ping/RPC2
http://blogsearch.google.com.pe/ping/RPC2
http://blogsearch.google.com.sa/ping/RPC2
http://blogsearch.google.com.sg/ping/RPC2
http://blogsearch.google.com.tr/ping/RPC2
http://blogsearch.google.com.tw/ping/RPC2
http://blogsearch.google.com.ua/ping/RPC2
http://blogsearch.google.com.uy/ping/RPC2
http://blogsearch.google.com.vn/ping/RPC2
http://blogsearch.google.com/ping/RPC2
http://blogsearch.google.de/ping/RPC2
http://blogsearch.google.es/ping/RPC2
http://blogsearch.google.fi/ping/RPC2
http://blogsearch.google.fr/ping/RPC2
http://blogsearch.google.gr/ping/RPC2
http://blogsearch.google.hr/ping/RPC2
http://blogsearch.google.ie/ping/RPC2
http://blogsearch.google.in/ping/RPC2
http://blogsearch.google.it/ping/RPC2
http://blogsearch.google.jp/ping/RPC2
http://blogsearch.google.lt/ping/RPC2
http://blogsearch.google.nl/ping/RPC2
http://blogsearch.google.pl/ping/RPC2
http://blogsearch.google.pt/ping/RPC2
http://blogsearch.google.ro/ping/RPC2
http://blogsearch.google*****ping/RPC2
http://blogsearch.google.se/ping/RPC2
http://blogsearch.google.sk/ping/RPC2
http://blogsearch.google.tw/ping/RPC2
http://blogsearch.google.us/ping/RPC2
http://rpc.technorati.com/rpc/ping
http://rpc.weblogs.com/RPC2
http://topicexchange.com/RPC2
http://www.blogdigger.com/RPC2
http://xping.pubsub.com/ping
http://api.my.yahoo.com/rss/ping
http://rpc.pingomatic.com/
http://ping.weblogs.se/
http://blogmatcher.com/u.php
http://coreblog.org/ping/
http://www.blogpeople.net/servlet/weblogUpdates
http://bulkfeeds.net/rpc
http://trackback.bakeinu.jp/bakeping.php
http://ping.myblog.jp/
http://ping.bitacoras.com/
http://ping.bloggers.jp/rpc/
http://ping.blogmura.jp/rpc/
http://xmlrpc.blogg.de/
http://1470.net/api/ping
http://bblog.com/ping.php
http://blog.goo.ne.jp/XMLRPC
http://api.feedster.com/ping
http://api.moreover.com/RPC2
http://api.my.yahoo.com/RPC2
http://xping.pubsub.com/ping/
http://ping.blo.gs/
http://ping.feedburner.com/
http://ping.syndic8.com/xmlrpc.php
http://ping.weblogalot.com/rpc.php
http://rpc.blogrolling.com/pinger/
http://rpc.icerocket.com:10080/
http://rpc.newsgator.com/
http://rpc.technorati.com/rpc/ping
http://rpc.weblogs.com/RPC2
http://topicexchange.com/RPC2
http://www.blogdigger.com/RPC2
http://www.blogstreet.com/xrbin/xmlrpc.cgi
http://www.newsisfree.com/RPCCloud
http://ping.weblogs.se/
http://blogmatcher.com/u.php
http://coreblog.org/ping/
http://www.blogpeople.net/servlet/weblogUpdates
http://bulkfeeds.net/rpc
http://trackback.bakeinu.jp/bakeping.php
http://ping.myblog.jp/
http://ping.bitacoras.com/
http://ping.bloggers.jp/rpc/
http://ping.blogmura.jp/rpc/
http://xmlrpc.blogg.de/
http://1470.net/api/ping
http://bblog.com/ping.php
http://blog.goo.ne.jp/XMLRPCishinao.net
http://api.feedster.com/ping
http://api.moreover.com/RPC2
http://api.moreover.com/ping
http://api.my.yahoo.com/RPC2
http://api.my.yahoo.com/rss/ping
http://bblog.com/ping.php
http://blog.goo.ne.jp/XMLRPC
http://blogdb.jp/xmlrpc
http://blogdigger.com/RPC2
http://blogmatcher.com/u.php
http://blogpeople.net/servlet/weblogUpdates
http://blogsearch.google.com/ping/RPC2
http://blogstreet.com/xrbin/xmlrpc.cgi
http://bulkfeeds.net/rpc
http://coreblog.org/ping
http://newsisfree.com/RPCCloud
http://ping.bitacoras.com/
http://ping.blo.gs/
http://ping.bloggers.jp/rpc
http://ping.blogmura.jp/rpc
http://ping.cocolog-nifty.com/xmlrpc
http://ping.feedburner.com/
http://ping.myblog.jp/
http://ping.syndic8.com/xmlrpc.php
http://ping.weblogalot.com/rpc.php
http://ping.weblogs.se/
http://pinger.blogflux.com/rpc
http://rpc.blogrolling.com/pinger
http://rpc.icerocket.com:10080/
http://rpc.newsgator.com/
http://rpc.pingomatic.com/
http://rpc.technorati.com/rpc/ping
http://rpc.weblogs.com/RPC2
http://topicexchange.com/RPC2
http://trackback.bakeinu.jp/bakeping.php
http://xmlrpc.blogg.de/
http://xping.pubsub.com/ping
http://api.feedster.com/ping
http://api.moreover.com/RPC2
http://api.moreover.com/ping
http://api.my.yahoo.co.jp/RPC2
http://api.my.yahoo.com/RPC2
http://api.my.yahoo.com/rss/ping
http://audiorpc.weblogs.com/RPC2
http://bblog.com/ping.php
http://blog.goo.ne.jp/XMLRPC
http://blogdb.jp/xmlrpc
http://blogdigger.com/RPC2
http://blogmatcher.com/u.php
http://blogpeople.net/ping
http://blogpeople.net/servlet/weblogUpdates
http://blogsearch.google.com/ping/RPC2
http://blogstreet.com/xrbin/xmlrpc.cgi
http://bulkfeeds.net/rpc
http://coreblog.org/ping
http://feedsky.com/api/RPC2
http://hamo-search.com/ping.php
http://holycowdude.com/rpc/ping
http://newsblog.jungleboots.org/ping.php
http://newsisfree.com/RPCCloud
http://ping.bitacoras.com/
http://ping.blo.gs/
http://ping.bloggers.jp/rpc
http://ping.blogmura.jp/rpc
http://ping.blogoon.net/
http://ping.blogs.yandex*****RPC2
http://ping.cocolog-nifty.com/xmlrpc
http://ping.fc2.com/
http://ping.feedburner.com/
http://ping.kutsulog.net/
http://ping.myblog.jp/
http://ping.namaan.net/rpc
http://ping.snap.com/ping/RPC2
http://ping.syndic8.com/xmlrpc.php
http://ping.weblogalot.com/rpc.php
http://ping.weblogs.se/
http://ping.wordblog.de/
http://pinger.blogflux.com/rpc
http://r.hatena.ne.jp/rpc
http://rpc.bloggerei.de/ping
http://rpc.blogrolling.com/pinger
http://rpc.icerocket.com:10080/
http://rpc.newsgator.com/
http://rpc.pingomatic.com/
http://rpc.reader.livedoor.com/ping
http://rpc.technorati.com/rpc/ping
http://rpc.technorati.jp/rpc/ping
http://rpc.twingly.com/
http://rpc.weblogs.com/RPC2
http://topicexchange.com/RPC2
http://trackback.bakeinu.jp/bakeping.php
http://wasalive.com/ping
http://xmlrpc.blogg.de/
http://xping.pubsub.com/ping
http://zhuaxia.com/rpc/server.php

my site ,visited by all crawlers <3 =)

18022011pm114958.png
 
Status
Not open for further replies.
Back
Top