From: Groepaz (groepaz_at_gmx.net)
Date: 2004-02-06 13:48:29
On Friday 06 February 2004 12:41, David Wood wrote:
> That said, and if you dont want people archiving your website, I have three
> words:
>
> robots dot txt
>
> Learn how to use it.
not it would prevent anyone using wget from mirroring it :o) (ok THEN it would
be rude, admitted)
gpz
Message was sent through the cbm-hackers mailing list
Archive generated by hypermail pre-2.1.8.