Sujet : Re: "Red" And The DoD Language Competition
De : findlaybill (at) *nospam* blueyonder.co.uk (Bill Findlay)
Groupes : comp.lang.adaDate : 13. Sep 2024, 00:17:25
Autres entêtes
Organisation : none
Message-ID : <0001HW.2C93AE0500F5F854306B4D38F@news.individual.net>
References : 1 2 3 4 5
User-Agent : Hogwasher/5.24
On 13 Sep 2024, Lawrence D'Oliveiro wrote
(in article <
vbvpta$esm6$8@dont-email.me>):
On Wed, 11 Sep 2024 23:57:33 -0500, Randy Brukardt wrote:
>
"Lawrence D'Oliveiro"<ldo@nz.invalid> wrote in message
news:vbimad$1j26j$6@dont-email.me...
>
Don't you wonder why people insist on returning "403
Forbidden" for those using a command-line tool like wget?
>
Most SEO tools and other
useless/criminal scrapers like to fake their identification, and WGet is
a favorite for that task. There are many owners that block that and many
other abused user-agents.
>
That doesn´t make any sense, because anybody who knows how to use wget
would know about its "--user-agent" option. So if they really were using
wget to conduct their site abuse, you wouldn´t know, and blocking wget´s
default user-agent setting wouldn´t help.
Wrong.
-- Bill Findlay
“Red” And The DoD Language Competition
Re: “Red” And The DoD Language Competition