1. MediaStar

    MediaStar Well-Known Member

    Mar 15, 2010
    Hello, i got warning error from google webmastertool after submit sitemap.

    This is my robots.txt configuration;
    [COLOR=#000000]User-agent: *[/COLOR]Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://mydomain.net/xmlsitemap.xml
    Allow: /rsssitemap.xml [COLOR=#000000]Allow: /htmlsitemap.htm[/COLOR]
    May i know what im missing?
  2. duong365

    duong365 Active Member

    Sep 24, 2016
    As I know you should disallow robot txt for only /wp-admin/ , other is allowed.It's defautl, or in case you want to block some bot traffic, that crawl website and make high rate in bounce rate.
    For this:
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php

    You can try with this:
    Disallow: /wp-admin/
    Allow: /
    Allow: /wp-admin/admin-ajax.php

Share This Page