Latest Announcemnent
New thread

Is it possible to block dmca bots?

Status
Not open for further replies.
G

Godric

Active Member
590
2011
110
50
[FONT=&quot]Is it possible to block other bots specially dmca bots scraping my website and just let Google, Yahoo and Bing bots scrape the site?[/FONT]​

I have a porn website that gets DMCA and it gets de index instantly and loss ranking on google. If I don't get DMCA my website is top 1 on a specific keyword for almost all countries and has around 300 - 400 average online users and on peak hours around 800 - 1000 online users. If I get dmca online drops to only 100 on average and around 200 on peak. I've been changing domains a lot of times already but maybe there's another way to stop this.
 
20 comments
Godric said:
[FONT=&amp]Is it possible to block other bots specially dmca bots scraping my website and just let Google, Yahoo and Bing bots scrape the site?[/FONT]​
Click to expand...

As far as I understand, the bots don't need to scrape your website specifically to get your URLs, they can simply search google, yahoo or bing and send dmca request directly to them and your urls will get de-indexed. So the only way is to stop ALL search bots from indexing your site. But maybe I am wrong and there is a solution.. hopefully someone can answer.
 
I know they can do it manually but if they're doing it automatically with a bot would really love to block that bot
 
You can't block them. The moment you make it possible for a human to click, see or interact with your links or content it becomes possible for a bot to do the same.

daisu said:
Godric said:
[FONT=&amp]Is it possible to block other bots specially dmca bots scraping my website and just let Google, Yahoo and Bing bots scrape the site?[/FONT]​
Click to expand...

So the only way is to stop ALL search bots from indexing your site.
Click to expand...

That might work, but only if your site is insignificant to them and/or really small. And that's exactly when you would NOT want to block legit search robots. For larger sites, and especially larger sites that do nothing but post copyrighted content they will just scrape the site directly. This is why some stuff gets DMCA'd as fast as it does.

Edit: so the best solution is to instantly replace dead/DMCA'd stuff - this takes less then five minutes or even just a few seconds and counters an action that took them hours before it had an effect.
 
Last edited:
Replacing dead / dmca stuff wont apply to me, as I'm uploading a specific type of videos from a specific site. Every time they report my site for dmca they report every links available so it gets totally de index on google so I have no other choice but to change domain again.
 
That sucks. Not sure what to tell you. It's been years since I ran a site and back then the DMCA wasn't straight up abused and automated like it is nowadays. Your best bet might be to try cloaking the content, meaning make it impossible for DMCA bots to ID the content (changing the name etc). Since you've mentioned that the content is very specific that makes really easy for bots to find you. The downside is people won't be able to find your content if they search for that specific content.
 
Pein said:
if you know the details of the bot, maybe adding no perms in robots.txt would help.
Click to expand...

That's not how rogue bots work :p. Robots.txt only works if the bot cares to read and obey it which only legit bots like search engine robots will do.
 
Hyperz said:
That sucks. Not sure what to tell you. It's been years since I ran a site and back then the DMCA wasn't straight up abused and automated like it is nowadays. Your best bet might be to try cloaking the content, meaning make it impossible for DMCA bots to ID the content (changing the name etc). Since you've mentioned that the content is very specific that makes really easy for bots to find you. The downside is people won't be able to find your content if they search for that specific content.
Click to expand...

It really does suck, last year or 2 i have the same type of file and was sitting in top 1 for around a year with no dmca at all. And even when dmca comes, it takes about a month for the site to be de index so all the backup site is already index and ready to be redirected to. But now once google receive the dmca the effect is almost instant.
 
How is possible to get direct traffic from watermarked videos?For example i'm uploading watermarked videos to xvideos,i have rights on that videos.How can i get direct visits from that,when video is not clickable (i mean when someone watch video he will not come to my site)?
 
Popac89 said:
mervinlasting said:
Why do you want google traffic? Why you dont upload watermarked clips to big tubes and get direct traffic?
Click to expand...

Can you explain me how to get direct traffic from watermarked videos?Because i'm posting watermarked videos and nothing.

Thanks
Click to expand...
[FONT=proxima_nova_rgregular]if you give me your local (country-based) private amateur porn forums (member based) which has a lot of rare and unique videos i will give these ideas.[/FONT]
 
absolutely its not possible
you can block all google bots via robots.txt in this case none of your pages wouldn't be indexed by google
you just can provide a DMCA ignored host
we can provide such service for you by just 1 $/month
 
Serverogen said:
absolutely its not possible
you can block all google bots via robots.txt in this case none of your pages wouldn't be indexed by google
you just can provide a DMCA ignored host
we can provide such service for you by just 1 $/month
Click to expand...

Lol the problem is not about the host it's google. And I already have a DMCA Ignored host, haven't received any dmca email from my host even though google always sends dmca notices
 
Status
Not open for further replies.
Back
Top