Fetches pages for certain user-initiated ChatGPT and custom GPT actions. This is not OpenAI automatic search indexing. User-initiated access and automatic robots.txt crawling have different documented handling.
Retrieves web pages in response to Claude user requests. A user-triggered fetcher, distinct from ClaudeBot training collection and Claude-SearchBot search indexing.
Retrieves web content for DuckDuckGo assisted-answer experiences. This identity should be distinguished from DuckDuckBot general search crawling. Check DuckDuckGo documentation for the current purpose and verification details.
Identifies web activity associated with Manus agent workflows. A browser agent identity is not a separate downloadable model. The initiating task and applicable service terms determine what the workflow…
Retrieves individual links for user-initiated Meta product features. Keep user-driven fetches distinct from Meta-ExternalAgent automated collection when reading traffic and access rules.
Identifies user-facing web retrieval associated with Mistral services. The fetcher is not an independently selectable language model. Do not infer a specific model version, context limit or API tariff…
Fetches pages in connection with Perplexity user requests. Separate user-driven retrieval from PerplexityBot indexing. Review the operator documentation for the different access and robots.txt behavior.
AI Assistants
Interface
Web crawler / fetcher
License
Operator-managed / not specified
No agents found
Try a different search, category or interface, or reset the filters.
This directory includes open-source tools and operator-managed web identities. A crawler is not necessarily an installable AI agent. Profiles distinguish purpose, source limits, licenses and costs.