Frequently Asked Questions

A: The Agentic Web refers to the new paradigm where AI agents—powered by large language models like ChatGPT, Claude, and Perplexity—actively browse, read, and interpret websites to answer user questions. These AI visitors are becoming a significant portion of web traffic and decide which content gets surfaced in AI-generated responses.

A: AI agents crawl websites to gather information for their training data, to provide real-time answers to user queries, and to cite sources in their responses. When someone asks ChatGPT or Perplexity a question, these systems may crawl relevant websites to find accurate, up-to-date information.

A: It varies by industry and site, but many websites now see 20-40% of their traffic coming from AI agents. Some B2B and tech sites see even higher percentages. AI Search Index shows you the exact split for your specific website.

A: Yes. As more people use AI tools for research and information gathering, AI agents will crawl more websites more frequently. Understanding and optimizing for this traffic is becoming essential for online visibility.

A: AI Search Index is a platform that tracks AI agent activity on your website. See the split between human and AI traffic, identify which LLM crawlers visit, understand which pages AI agents read most, and optimize your content for the agentic web.

A: We detect 60+ AI agents including GPTBot, OAI-SearchBot, and ChatGPT-User (OpenAI), PerplexityBot (Perplexity), ClaudeBot (Anthropic), Google-Extended and Gemini-Deep-Research (Google), xAI-Grok (xAI), DeepSeekBot (DeepSeek), MistralAI-User (Mistral), Meta AI bots, Microsoft Copilot, CCBot (Common Crawl), Cohere, You.com, KagiBot, and many emerging agents. Our database is continuously updated.

A: Traditional analytics tools like Google Analytics often filter out bot traffic or lump all bots together. AI Search Index specifically identifies and categorizes AI agents, showing you exactly which AI systems are reading your content and how they differ from human visitors.

A: AI agents are the new gatekeepers to your content. When users ask ChatGPT or Perplexity questions, these AI systems decide which websites to reference. Understanding which AI agents crawl your site—and which pages they visit—helps you optimize for visibility in AI-generated answers.

A: After creating an account and adding your website, copy the provided JavaScript snippet and paste it into your website's HTML. It works in the head section or before the closing body tag. Compatible with any website, CMS, or framework.

A: Yes! We offer a free plan that includes 1 website and core analytics features. View all plans to see what's included.

A: Most users are up and running in under 5 minutes. Create an account, add your website, and install the tracking script. AI agent data starts appearing in your dashboard immediately.

A: Yes! Our paid plans support multiple websites. The Starter plan includes 3 websites, Pro includes 10, and Enterprise includes 100—all managed from a single dashboard.

A: Your dashboard shows the real-time split between human visitors and AI agents. You can view this as a percentage, see trends over time, and drill down by specific AI agent type (ChatGPT, Perplexity, Claude, etc.).

A: Yes! Page-level insights show exactly which pages receive the most AI agent attention. This helps you understand what content AI systems find most valuable and where to focus optimization efforts.

A: We track page visits, user agents (to identify specific AI bots), timestamps, referrers, and geographic information. For AI agents, we categorize them by company (OpenAI, Anthropic, etc.) and specific product (ChatGPT, Claude, etc.).

A: Prompt Tracking is an advanced feature that shows the actual queries users ask AI systems that lead to your content. Understand user intent in the AI era and optimize your content for the questions that matter most.

A: The free AI Search Analyzer is a one-time tool that scores any URL for AI-friendliness. The full platform provides continuous tracking of AI agents visiting your site, real-time agent vs. human split analytics, page-level insights, and more.

A: The analyzer evaluates three key dimensions: Technical Optimization (SEO and LLM-readability), Content Quality (structure and clarity), and Schema.org Documentation (structured data implementation). Each receives a score out of 100.

A: Yes, the free analyzer requires no account or sign-up. Enter any URL and get instant results. For ongoing AI agent tracking, we recommend creating a free account.

A: We accept all major credit cards, PayPal, and Apple Pay through our secure payment processor.

A: Yes! You can upgrade or downgrade your plan at any time from your account settings. Changes take effect immediately with prorated billing.

A: Yes, all paid plans include a 14-day free trial. No credit card required to start—you only pay if you decide to continue.

A: No. Our script is lightweight (under 2KB), loads asynchronously, and doesn't block page rendering. It has negligible impact on page load times.

A: We take privacy seriously. Our tracking focuses on AI agent identification, not individual user tracking. See our Privacy Policy for complete details.

A: Yes. You can export your analytics data at any time and request complete deletion of your account and data through your account settings.