robots.txt class

Give this class the contents of a robots.txt file or the URL to it and it will parse it for you. As an option you can give it the name or your robot/spider/crawler and it will return only the section that applies to your case. Works through proxies with the help of Snoopy (see script for more details).

Rezensionen

Es sind noch keine Kommentare vorhanden.

Hier Kannst Du einen Kommentar verfassen


Bitte gib mindestens 10 Zeichen ein.
Wird geladen... Bitte warte.
* Pflichtangabe
ANG GES G P
Almost every PHP and SQL site a search. The problem is that these searches almost never support booleans. If they do it's usually pretty bad. The ...
ANG GES G P
OO interface for generating HTML tables. All HTML 3.2 elements can be defined.
ANG GES G P
This is a very easy to use class for making tables with various styles. It also has an example included.
ANG GES G P
Try to simplify and improve Sword Su's menutree class
ANG GES G P
The aim of this class is to easily create a combobox/listbox taking data from an array of one dimension. Values will be automatically escaped to ...
ANG GES G P
phpHtmllib is a set of PHP classes and library functions to help facilitate building, debugging, and rendering of HTML and XHTML. It provides a me ...
ANG GES G P
This class allows one to read and modify files using the INI file format.
ANG GES G P
This is a little improvement to "Mp3 & ID3 tag parser" by marty sejba . I made this to support ID3v1.1 TAGS (with track number info) and added ...
404 x angesehen
0 x gemerkt
Details zur Anzeige
ANG GES G P
Anfrage stellen

Du bist nicht als Benutzer angemeldet. Bitte gebe Deinen Namen und E-Mailadresse an!

Wird geladen... Bitte warte.
Details zur Anbieter

toon.goedhart@