[csw-maintainers] robots.txt

Philip Brown phil at bolthole.com
Mon Aug 31 17:41:39 CEST 2009


Why do you suggest we do this?



On Sun, Aug 30, 2009 at 5:32 PM, Maciej (Matchek)
Blizinski<maciej at opencsw.org> wrote:
> O
>>> Can we set up a robots.txt file on www.opencsw.org? I would suggest
>>> the following content:
>>>
>>> User-agent: *
>>> Disallow: /search
>>



More information about the maintainers mailing list