K 10 svn:author V 4 miwi K 8 svn:date V 27 2008-02-16T13:52:51.000000Z K 7 svn:log V 265 WWW::RobotRules::Parser allows you to simply parse robots.txt files as described in http://www.robotstxt.org/wc/norobots.html. WWW: http://http://search.cpan.org/dist/WWW-RobotRules-Parser/ PR: ports/120160 Submitted by: Masahiro Teramoto END