1. abood3d

    abood3d Member

    Jul 18, 2016
    Hi man
    You OK? I hope you're fine.
    I'm desperately in need, and have a bit of issue. i have a simple robots.txt file like below:

    User-agent: *

    Sitemap: http://x.com/post-sitemap.xml
    Sitemap: http://x.com/series-sitemap.xml
    Sitemap: http://x.com/movies-sitemap.xml
    Sitemap: http://x.com/genre-sitemap.xml
    Sitemap: http://x.com/genreseries-sitemap.xml
    Sitemap: http://x.com/category-sitemap.xml
    Sitemap: http://x.com/post_tag-sitemap.xml
    Sitemap: http://x.com/tagz-sitemap.xml
    Sitemap: http://x.com/tagzz-sitemap.xml

    The XML sitemap is being created with Yoast SEO plugin. i submitted the robots.txt to google webmaster tools. then i introduced my XML sitemap url. It shows me 768 warnings : Sitemap contains urls which are blocked by robots.txt.
    But the thing is my robots.txt file doesnt have any likes that causes search engines to crawl to my sitemap.
  2. yasuo

    yasuo Member

    Jun 9, 2017
    are you using https?

    after you submit your sitemap you block robots in your website?

    just wait it will be back to normal

Share This Page