Detecting bots

Valid bots identify themselves as user agents of bot type and can be tracked through Discover. For example, when bots are detected, you can identify the pages on your site that have been crawled by specific search engine bots such as googlebot, msnbot, and more.

Self-reporting bots can be identified through the user-agent string value in the request. Discover can match the values reported in this field to the values in the UserAgent field in the public standard Browscap.csv. This user agent information is posted to the [ExtendedUserAgent] area of the request.

Optionally, you can configure the Discover Reference Session Agent to overload the TLT_APPLICATION_NAME with the browser type extracted from the user agent cache.

  • See "Discover Reference Session AgentOverloadingApplicationReferenceField" in the Unica Discover Configuration Manual.