RoboCrawl Spider
Name | RoboCrawl Spider |
---|---|
Cover | http://www.canadiancontent.net/ |
Details | http://www.canadiancontent.net/corp/spider.html |
Status | active |
Description | The Canadian Content robot indexes for it's search database. |
Purpose | indexing |
Type | standalone |
Platform | linux |
Language | C and C++ |
Availability | none |
Owner Name | Canadian Content Interactive Media |
Owner URL | http://www.canadiancontent.net/ |
Owner Email | staff@canadiancontent.net |
Exclusion | yes |
Exclusion User-Agent | RoboCrawl |
NOINDEX | yes |
Host | ncc.canadiancontent.net, ncc.air-net.no, canadiancontent.net, spider.canadiancontent.net |
From | no |
UserAgent | RoboCrawl (http://www.canadiancontent.net) |
History | Our robot is a newer project at Canadian Content. |
Environment | service |
ID | robocrawl |
Modified Date | July 30th, 2001 |
Modified By | Christopher Walsh and Adam Rutter |
Previous: ComputingSite Robi/1.0
Next: RoboFox