User Agents are used to allow crawlers to access and crawl content requiring authentication. To configure User agents go to:
- Content -> Pages -> Options -> Setup
- Content -> Assets -> Options -> Setup
- Setup -> Site
- System -> Configuration
Select Site, and then People -> Authentication -> User agents:
1. Edit/configure:
User agent list
Click Add to user agent information. Note: to allow a User agent to login, the User agent must be associated with a guest user account, which can auto sign on by IP address.
