AraybOt
Name | AraybOt |
---|---|
Cover | http://www.araykoo.com/ |
Details | http://www.araykoo.com/araybot.html |
Status | active |
Description | AraybOt is the agent software of AraykOO! which crawls web sites listed in http://dmoz.org/Adult/, in order to build a adult search engine. |
Purpose | indexing maintenance |
Type | standalone |
Platform | Linux |
Language | perl5 |
Availability | none |
Owner Name | Guti |
Owner URL | http://www.araykoo.com/ |
Owner Email | robot@araykoo.com |
Exclusion | yes |
Exclusion User-Agent | AraybOt |
NOINDEX | yes |
Host | * |
From | no |
UserAgent | AraybOt/1.0 (+http://www.araykoo.com/araybot.html) |
History | |
Environment | service |
ID | araybot |
Modified Date | Sat, 19 Jun 2004 20:25:00 GMT+1 |
Modified By | Guti |
Previous: Araneo
Next: ArchitextSpider