Sujet : Re: bad bot behavior
De : candycanearter07 (at) *nospam* candycanearter07.nomail.afraid (candycanearter07)
Groupes : comp.miscDate : 23. Mar 2025, 15:30:04
Autres entêtes
Organisation : the-candyden-of-code
Message-ID : <slrnvu06im.2o4dt.candycanearter07@candydeb.host.invalid>
References : 1 2 3 4
User-Agent : slrn/1.0.3 (Linux)
Ian <${send-direct-email-to-news1021-at-jusme-dot-com-if-you-must}@jusme.com> wrote at 12:06 this Wednesday (GMT):
On 2025-03-18, Toaster <toaster@dne3.net> wrote:
>
But what can be done to mitigate this issue? Crawlers and bots ruin the
internet.
>
#mode=evil
>
How about a script that spews out an endless stream of junk from
/usr/share/dict/words, parked on a random URL that's listed in
robots.txt as forbidden. Any bot choosing to chew on that gets what
it deserves, though you might need to bandwidth limit it.
I heard Cloudflare is doing something like that, but ironically
with their own generative AI..
-- user <candycane> is generated from /dev/urandom
bad bot behavior
Re: bad bot behavior