The Live AI Bot Behavior Index

The LightSite AI Bot Behavior Index is a live, free dashboard that shows what AI assistants actually fetch from the web — and which engines send humans back. It is updated every five minutes from real AI crawler hits and labeled AI referral traffic across 100+ live sites running LightSite AI.

What marketers get from the index

AI assistants now sit between your buyer and your site. They crawl your category of content, decide which engines and pages to recommend, and send only a fraction of those buyers back as a labeled click. Traditional analytics cannot see most of this. The Bot Behavior Index gives marketers three things their existing stack does not:

  • The live engine mix — which AI engines (ChatGPT, Claude, Gemini, Perplexity and the long tail) are actually crawling real category content right now, ranked by share of volume and with trend arrows vs. the previous period.
  • Measured payback per engine — labeled human visitors per 1,000 AI crawls, so you stop confusing crawl volume with acquisition. Only engines that pass first-party referral signal are scored, so you never see misleading "zero payback" entries.
  • A per-surface picture — where bots and humans actually land. Each surface (page mirrors, question pages, product feeds, customer homepages and articles) is shown with bots and humans side by side, so you can see which AI-ready surfaces are worth shipping on your own site.

What this lets a marketer decide

  • Which AI engines deserve the next round of content investment.
  • Which page types (question pages, product feeds, JSON-LD page mirrors) AI assistants are actually pulling — and which are being ignored.
  • Which engines convert AI crawls into human clicks, and which crawl heavily without sending anyone back.
  • Where to invest in answer-ready content for buyers who first ask ChatGPT, Claude, Gemini or Perplexity.

What's inside

  • Who's crawling right now — engine leaderboard with crawl share, raw crawls, and trend vs. the previous window.
  • Which engines send humans — payback ranking by labeled humans per 1,000 crawls.
  • Where bots and humans go — surfaces grouped into LightSite-published (page mirrors, question pages, business profile, product/category/FAQ feeds, skills manifest, status feed, AI robots) and customer-site (homepage, other pages, sitemap), each with bots and humans side by side.
  • Headline insights — pre-computed observations with finding, why-it-matters and a recommended action.
  • Action playbook — concrete plays filterable by audience (marketing leaders, ecommerce, B2B SaaS).

Frequently asked questions

What is the LightSite AI Bot Behavior Index?

A live, free dashboard that shows what AI assistants actually fetch from the web and which engines send humans back. Built from real AI crawler hits and labeled AI referral traffic across 100+ live sites, refreshed every five minutes.

Why should a marketer care?

It answers two questions traditional analytics cannot: which AI engines are crawling your category of content, and which ones actually drive measurable human visits — so you can spend content and structured-data effort where payback is real.

How is this different from AI mention tracking?

Mention trackers report what AI assistants said in a prompt sample. The Bot Behavior Index reports what AI systems actually do on real websites — crawl behavior and labeled human payback, not sampled answers.

How often is the data updated?

Every five minutes. The hero counters, leaderboards and surface splits reflect rolling activity over the selected 24h, 7d or 30d window.

Where do I see this for my own site?

LightSite gives every customer the per-site version of this dashboard plus the AI-ready surfaces (JSON-LD page mirrors, question pages, product and skills feeds) that AI assistants actually fetch.

Source: LightSite AI Bot Behavior Index — aggregated across integrated sites. Updated every 5 minutes.

Related