robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Reviews

There are no comments available yet.

Here you can write a comment


Please enter at least 10 characters.
Loading... Please wait.
* Pflichtangabe
ANG GES G P
xmlobjects is a class for reading xml documents and to parse it into a php object for easy access from within php. this class is some kind of exp ...
ANG GES G P
Object manipulation routine.
ANG GES G P
A generalized parsed template caching mechanism, that can work with a variety of existing template classes.
ANG GES G P
Mit diesem Script kann man bestimmte Seiten cachen. Eignet sich gut um schlechte Datenbankperformance aus zugleichen.
ANG GES G P
A collection of classes and resources to process XML using PHP
ANG GES G P
A Class to render automagically Form Fields Html code. I use it in combination with a table that contains the fields description like type, name ...
ANG GES G P
Cached Fast Template is a template system for PHP that implements caching for PHP's FastTemplate module. Features include: Supports lock files, so ...
ANG GES G P
In diesem RegEx-Bereich wird eine kurze Einführung in das Thema Reguläre Ausdrücke gegeben. Danach werden einige gebrauchsfertige Reguläre A ...
547 x viewed
0 x memorized
Details to the advertisement
ANG GES G P
Make a request

You are no longer logged in as a user. Please enter your name and your E-mail-adress!

Loading... Please wait.
Details to the seller

toon.goedhart@