Re: bad bot behavior

Liste des GroupesRevenir à c misc 
Sujet : Re: bad bot behavior
De : ${send-direct-email-to-news1021-at-jusme-dot-com-if-you-must} (at) *nospam* jusme.com (Ian)
Groupes : comp.misc
Date : 19. Mar 2025, 13:06:13
Autres entêtes
Organisation : Wet Socks!
Message-ID : <slrnvtlcpl.41d.${send-direct-email-to-news1021-at-jusme-dot-com-if@vm46.home.jusme.com>
References : 1 2 3
User-Agent : slrn/1.0.3 (Linux)
On 2025-03-18, Toaster <toaster@dne3.net> wrote:
>
But what can be done to mitigate this issue? Crawlers and bots ruin the
internet.

#mode=evil

How about a script that spews out an endless stream of junk from
/usr/share/dict/words, parked on a random URL that's listed in
robots.txt as forbidden. Any bot choosing to chew on that gets what
it deserves, though you might need to bandwidth limit it.


--
Ian

"Tamahome!!!" - "Miaka!!!"

Date Sujet#  Auteur
18 Mar 25 * bad bot behavior18Ben Collver
18 Mar 25 `* Re: bad bot behavior17D Finnigan
18 Mar 25  +- Re: bad bot behavior1Computer Nerd Kev
18 Mar 25  `* Re: bad bot behavior15Toaster
19 Mar 25   +* Re: bad bot behavior13Ian
19 Mar 25   i+* Re: bad bot behavior2Rich
23 Mar 25   ii`- Re: bad bot behavior1candycanearter07
20 Mar 25   i+* Re: bad bot behavior5Lawrence D'Oliveiro
20 Mar 25   ii`* Re: bad bot behavior4Ian
21 Mar 25   ii +- Re: bad bot behavior1Toaster
21 Mar 25   ii `* Re: bad bot behavior2Lawrence D'Oliveiro
21 Mar 25   ii  `- Re: bad bot behavior1Ian
23 Mar 25   i+* Re: bad bot behavior4candycanearter07
26 Mar 25   ii`* Re: bad bot behavior3D Finnigan
26 Mar 25   ii +- Re: bad bot behavior1candycanearter07
26 Mar 25   ii `- Re: bad bot behavior1Computer Nerd Kev
12 May 25   i`- Re: bad bot behavior1anthk
12 May 25   `- Re: bad bot behavior1anthk

Haut de la page

Les messages affichés proviennent d'usenet.

NewsPortal