skip to content
Advertisement

RoboCrawl Spider

Name RoboCrawl Spider
Cover http://www.canadiancontent.net/
Details http://www.canadiancontent.net/corp/spider.html
Status active
Description The Canadian Content robot indexes for it's search database.
Purpose indexing
Type standalone
Platform linux
Language C and C++
Availability none
Owner Name Canadian Content Interactive Media
Owner URL http://www.canadiancontent.net/
Owner Email staff@canadiancontent.net
Exclusion yes
Exclusion User-Agent RoboCrawl
NOINDEX yes
Host ncc.canadiancontent.net, ncc.air-net.no, canadiancontent.net, spider.canadiancontent.net
From no
UserAgent RoboCrawl (http://www.canadiancontent.net)
History Our robot is a newer project at Canadian Content.
Environment service
ID robocrawl
Modified Date July 30th, 2001
Modified By Christopher Walsh and Adam Rutter
Advertisement