Unknown User-Agents

A user-agent is a "thing" that visit your web site. It can human (e.g.: a browser) or a robot (e.g.: a search engine robot).

This page shows a list of the user-agents that have not been recognized. Several reasons:

Generally, robots are crawling only a limited number of pages per visit (about 1 page/visit). So if the number of hits is more or less the same than the number of visits, it's probably a robot.

In the report, we show the unknown hosts that have made hits on the "/robots.txt" file. This is offently an indication of a well-designed robot. We also include a robot trap (usually an invisible link that will be followed only by robots and not by humans, because they cannot see the link). If the unknown useragent fall in a robot trap, this another indication that it could be a robot.

You can click on the HTTP user-agent string to see the unknown user-agent activity per day and the last pages viewed. A regular activity (e.g. one time per week) is typical to robots. Most robots are not downloading javascript files and images.

If you think a user-agent is missing, please submit the following informations (if known):

See also