What kinds of robots are there?
Robots can be used for a number of purposes:
- Indexing
- HTML validation
- Link validation
- "What's New" monitoring
- Mirroring
See the list of active robots to see what robot does what. Don't ask me -- all I know is what's on the list...