Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).
ANG
GES
G
P
Full Featured php Form Generation Class, by Strudleman.
Simple to use, full CSS support, XHTML compliant output.
ANG
GES
G
P
An extenstion of html_mime_mail.class with pgp support
ANG
GES
G
P
This class was created to simplify the process of representing images with
thumbnails. This class simply gets the image's size, converts the heig ...
ANG
GES
G
P
Der PHP Autoloader findet Klassendefinitionen automatisch. Er muss nicht weiter konfiguriert werden und funktioniert so wie er ist über ein einfa ...
ANG
GES
G
P
A "better" CountryList class. Supports German, English and Frensh ISO 3166
Country Codes and Names.
ANG
GES
G
P
Description:
Class that generates HTML output of a calendar month based on the table
wrapper base class. It features:
- Generates output any m ...
ANG
GES
G
P
Pass the class any text and it will check for matches against a list of
badwords you wish to exclude.
Excuded words are in ACSII format held in ...
ANG
GES
G
P
Class for parsing RSS 0.9 and 0.91 formats. Includes utility functions for
walking the parse tree.