Conceptbot
| Name | Conceptbot |
|---|---|
| Cover | http://www.aptltd.com/~sifry/conceptbot/tech.html |
| Details | http://www.aptltd.com/~sifry/conceptbot |
| Status | development |
| Description | The Conceptbot spider is used to research concept-based search indexing techniques. It uses a breadth first seach to spread out the number of hits on a single site over time. The spider runs at irregular intervals and is still under construction. |
| Purpose | indexing |
| Type | standalone |
| Platform | unix |
| Language | perl5 |
| Availability | data |
| Owner Name | David L. Sifry |
| Owner URL | http://www.aptltd.com/~sifry |
| Owner Email | david@sifry.com |
| Exclusion | yes |
| Exclusion User-Agent | conceptbot |
| NOINDEX | yes |
| Host | router.sifry.com |
| From | yes |
| UserAgent | conceptbot/0.3 |
| History | This spider began as a research project at Sifry Consulting in April 1996. |
| Environment | research |
| ID | conceptbot |
| Modified Date | Mon, 9 Sep 1996 15:31:07 GMT |
| Modified By | David L. Sifry <david@sifry.com> |
Previous: Combine System
Next: ConfuzzledBot