w@pSpider by wap4.com
| Name | w@pSpider by wap4.com |
|---|---|
| Cover | http://mopilot.com/ |
| Details | http://wap4.com/portfolio.htm |
| Status | active |
| Description | wapspider is used to build the database for mopilot.com, a search engine for mobile contents; it is specially designed to crawl wml-pages. html is indexed, but html-links are (currently) not followed |
| Purpose | indexing, maintenance (special: dedicated to wap/wml pages) |
| Type | standalone |
| Platform | unix |
| Language | c, php, sql |
| Availability | data |
| Owner Name | Dieter Kneffel |
| Owner URL | http://wap4.com/ (corporate) |
| Owner Email | info@wap4.com |
| Exclusion | yes |
| Exclusion User-Agent | wapspider |
| NOINDEX | [does not apply for wap/wml pages!] |
| Host | *.wap4.com, *.mopilot.com |
| From | yes |
| UserAgent | w@pSpider/xxx (unix) by wap4.com |
| History | this robot was developed by wap4.com in 1999 for the world's first wap-search engine |
| Environment | service, commercial, research |
| ID | wapspider |
| Modified Date | Fri, 23 Jun 2000 14:33:52 MESZ |
| Modified By | Dieter Kneffel, data@wap4.com |
Previous: the World Wide Web Wanderer
Next: WebBandit Web Spider