webs
| Name | webs |
|---|---|
| Cover | http://webdew.rnet.or.jp/ |
| Details | http://webdew.rnet.or.jp/service/shank/NAVI/SEARCH/info2.html#robot |
| Status | active |
| Description | The webs robot is used to gather WWW servers' top pages last modified date data. Collected statistics reflects the priority of WWW server data collection for webdew indexing service. Indexing in webdew is done by manually. |
| Purpose | statistics |
| Type | standalone |
| Platform | unix |
| Language | perl5 |
| Availability | none |
| Owner Name | Recruit Co.Ltd, |
| Owner URL | |
| Owner Email | dew@wwwadmin.rnet.or.jp |
| Exclusion | yes |
| Exclusion User-Agent | webs |
| NOINDEX | no |
| Host | lemon.recruit.co.jp |
| From | yes |
| UserAgent | webs@recruit.co.jp |
| History | |
| Environment | service |
| ID | webs |
| Modified Date | Fri, 6 Sep 1996 10:00:00 GMT |
| Modified By |