About Us Add URL Modify Url Link To Us Contact Us

Home: Guides and Directories: Search Engines: Robots
 
LINKS:  
  • HTTP User Agent Index
    An alphabetical list of user agents and the deployer behind them, compiled by Christoph Rüegg.
    http://www.siteware.ch/webresources/useragents/db.html

  • List of Robot Agent Strings
    A list from PGTS of Web robots with the identifying data they leave in Web site logs.
    http://www.pgts.com.au/pgtsj/pgtsj0208d.html

  • Psychedelix List of User-Agents
    Andreas Staeding's large list of search engine spiders, similar Web robots, and Web browsers: their web-log identification and links to their originators.
    http://www.psychedelix.com/agents.html

  • Search Engine IP Addresses
    Lists IP addresses of search engine spiders. Can be searched by IP address. Also links to resources on spiders.
    http://www.iplists.com/

  • Search Engine Robots and Other User Agents
    John A. Fotheringham presents data in tabular form on the robots sent by search engines and other sites to read and index Web pages: their origins, names and IP addresses.
    http://www.jafsoft.com/searchengines/webbots.html

 

About Us Add URL Modify Url Link To Us Contact Us