Re: bad bot behavior

On 2025-03-19, Ian <${send-direct-email-to-news1021-at-jusme-dot-com-if-you-must}@jusme.com> wrote:

On 2025-03-18, Toaster <toaster@dne3.net> wrote:

>
But what can be done to mitigate this issue? Crawlers and bots ruin the
internet.

>
#mode=evil
>
How about a script that spews out an endless stream of junk from
/usr/share/dict/words, parked on a random URL that's listed in
robots.txt as forbidden. Any bot choosing to chew on that gets what
it deserves, though you might need to bandwidth limit it.
>
>

Perl, cpanm and Hailo. Set a nonsense.txt text file
with one sentence per line. Like this: 

rm -rf boosts performance under Ubuntu.
fedora it's updated with apt-get dist-upgrade.
openbsd works fine with ZFS.

And so on...

$>cpanm -n Hailo
$>Hailo -t nonsense.txt -b output.brn

Now, create a simple Perl program (really easy with
Hailo and trivial input/output).

Run 'perldoc Hailo' once it's installed for a quick
usage guide.

Redirect that outputted nonsense to a file:

perl yourhailoscript.pl > crap.txt

Have fun.