skip to content
Advertisement

ArchitextSpider

Name ArchitextSpider
Cover http://www.excite.com/
Details
Status
Description Its purpose is to generate a Resource Discovery database, and to generate statistics. The ArchitextSpider collects information for the Excite and WebCrawler search engines.
Purpose indexing, statistics
Type standalone
Platform
Language perl 5 and c
Availability
Owner Name Architext Software
Owner URL http://www.atext.com/spider.html
Owner Email spider@atext.com
Exclusion yes
Exclusion User-Agent
NOINDEX no
Host *.atext.com
From yes
UserAgent ArchitextSpider
History
Environment
ID architext
Modified Date Tue Oct 3 01:10:26 1995
Modified By
Advertisement