Sujet : Re: "Red" And The DoD Language Competition
De : randy (at) *nospam* rrsoftware.com (Randy Brukardt)
Groupes : comp.lang.adaDate : 02. Nov 2024, 04:48:38
Autres entêtes
Organisation : A noiseless patient Spider
Message-ID : <vg47eo$3kvno$1@dont-email.me>
References : 1 2 3 4 5 6
User-Agent : Microsoft Outlook Express 6.00.2900.5931
"Lawrence D'Oliveiro" <
ldo@nz.invalid> wrote in message
news:vc3di3$1bmhk$3@dont-email.me...On Sat, 14 Sep 2024 01:27:22 -0500, Randy Brukardt wrote:
...
You're confused. The attackers aren't using Wget, but they are
*claiming* to be WGet.
>
But that long list of user agents being blocked that you previously
mentioned did not include wget.
I don't block WGet myself, I haven't seen enough abuse. There's more from
Meta and Amazon, and I probably shouldn't block them, either. (Meta and
Amazon both have crawlers that ignore requests for throttling, I know some
webmasters block them for that reason.)
But I'm sure that other webmasters have different experiences. I don't find
it surprising when anything is blocked anymore (although blocking Firefox
seems a bit much).
Randy.
“Red” And The DoD Language Competition
Re: “Red” And The DoD Language Competition