# AI traffic analytics: crawlers, referrals, and the answers nobody clicks

> AI traffic means three things: crawler hits, visitors referred by AI answers, and answers that cite you with no click. How to measure each, and where GA4 stops.

Source: https://terradium.io/ai-traffic-analytics

Last updated 23 October 2026 · Prices checked 23 October 2026

![AI traffic analytics: crawlers, referrals, and answers, Terradium](https://terradium.io/media/guides/ai-traffic-analytics.png)

**The short answer**

"AI traffic" covers three different things: AI crawlers fetching your pages, people who click through to your site from an AI answer, and AI answers that mention or cite you without anyone clicking. A web analytics tool only sees the second one, and only partly. To get the full picture you need referral attribution on your site, sampled tracking of what AI engines actually say about you, and a check that AI crawlers can read your pages at all.

## What people find when they search this term

The US results for "ai traffic analytics" are a mix of tool pages that log AI crawler activity, GA4 tutorials on spotting AI referrals, CDN documentation for analyzing AI bot traffic, platform guides (Webflow), and forum threads asking how to track ChatGPT referrals at all.

Most of them pick one of the three meanings and treat it as the whole story. This page separates them, says what each one can and cannot tell you, and shows a setup that covers all three.

## The three things "AI traffic" can mean

| | What it is | Where you see it | What it tells you |
| --- | --- | --- | --- |
| Crawler traffic | AI bots (training, search, and browsing crawlers) fetching your pages | Server logs, CDN or firewall analytics | Whether AI systems can reach your content |
| Referral traffic | Humans who click a link in an AI answer and land on your site | Web analytics, or an attribution script on your site | Which AI answers send visitors, and to which pages |
| Answer visibility | AI answers that mention or cite you, clicked or not | Only by asking the engines and recording the answers | Whether you are part of the answer in the first place |

They move independently. A site can be crawled heavily and still never be cited. A brand can be cited often and get few clicks, because the answer already satisfied the question. Measuring only one of the three gives you a misleading number.

## What GA4 shows you, and what it doesn't

Google Analytics 4 can show visits from AI chat tools when the visit arrives with a referrer: the AI tool's domain appears as the source, usually grouped with ordinary referrals. You can build a custom channel group or an exploration filter to pull those sources together.

What GA4 does not do:

- **It does not see crawler hits.** Bots that don't run JavaScript never fire the analytics tag.
- **It cannot see visits that arrive without a referrer.** Those land in Direct, and nothing in GA4 tells you an AI answer sent them.
- **It knows nothing about answers that didn't produce a click.** If ChatGPT recommends you and the reader never visits, GA4 records nothing.

GA4 is a reasonable first look at AI referrals. It is not AI traffic analytics on its own.

## How to track visitors who came from an AI answer

There are three practical layers, and they stack:

1. **Referrer classification.** Tag each visit by where it came from and mark the ones that came from an [AI answer engine](https://terradium.io/ai-answer-engines). This is what a GA4 channel group does, and what a dedicated attribution script does automatically.
2. **UTM parameters where you control the link.** If you publish links that AI tools pick up (docs, directories, your own content), consistent UTMs make those visits easier to separate.
3. **Ask the visitor.** A one-question "How did you find us?" prompt catches the visits that arrive with no referrer at all. Self-reported answers are noisy, but they are the only signal for the visits referrers miss.

Terradium's Embed SDK does the first and third for you. It is a small script you add to your site (`npx terradium init` sets it up), and it attributes which visitors arrived from an AI answer (ChatGPT, Perplexity, Gemini, Google AI Overviews). Passive attribution needs no visitor interaction. An optional, dismissible visitor survey asks how they found you. Both are toggled from the dashboard without a redeploy.

It is built to be safe to deploy: no PII collected by default, no advertising cookies, no fingerprinting, IP addresses anonymized server-side, and a consent mode that keeps it inactive until consent is granted when you require it. Details are in the [Embed SDK docs](https://terradium.io/docs/embed).

## The traffic you never see: answers that cite you without a click

Referral tracking only measures the readers who clicked. Many AI answers resolve the question in the answer itself, so the more useful question is: **are you in the answer at all?**

That can only be measured by asking the engines. Answers also vary from run to run, so a single check is not meaningful ([why ChatGPT doesn't give everyone the same answer](https://terradium.io/does-chatgpt-give-the-same-answers)). The reliable approach is sampling: ask a fixed set of real questions repeatedly over time and record whether you appear, whether you are cited, and who appears alongside you.

Terradium's AI Visibility does this and reports four numbers per engine and rolled up:

- **Appearance rate:** the share of sampled prompts where your brand shows up at all.
- **Citation share:** how often you are the named source the engine links or attributes.
- **Share of voice:** your slice of the cited sources versus competitors on the same prompts.
- **Average position:** where you tend to land among cited sources when you do appear.

They are directional trends, not fixed ranks. See the [AI Visibility docs](https://terradium.io/docs/ai-visibility).

## Crawler access comes first

If AI crawlers can't read your pages, there is nothing to cite and nothing to click. Most AI crawlers don't run JavaScript, so a client-rendered page can look empty to them. A robots.txt rule can also block a search or browsing crawler without anyone noticing.

The free [AI crawler checker](https://terradium.io/tools/ai-crawler-checker) tests one URL for three things: robots.txt rules per AI crawler (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and others), whether [llms.txt](https://terradium.io/llms-txt-example) exists and follows the format, and whether the page's content is in the raw HTML when fetched as GPTBot. It's free and needs no sign-up.

To be clear about scope: the checker tests access. It does not log crawler visits over time. For crawler volume, use your server logs or your CDN's bot analytics.

## A simple AI traffic analytics setup

1. **Check crawler access** for your key pages with the [AI crawler checker](https://terradium.io/tools/ai-crawler-checker). Fix any blocked search crawler or empty server-rendered page first.
2. **Watch crawler volume** in your server logs or CDN bot analytics, if you want to know how often AI bots fetch you.
3. **Attribute AI referrals** on your site, with a GA4 channel group as a starting point or an attribution script that classifies AI referrals for you.
4. **Ask a sample of visitors** how they found you, to catch the visits with no referrer.
5. **Track answer visibility** on a fixed list of the questions your buyers ask, sampled over time across the engines that matter to you.
6. **Act on the gaps.** Questions where competitors are cited and you are not are your content backlog.

## Where Terradium fits

Terradium covers the referral and visibility layers in one place, plus the content to close gaps:

- **Embed SDK** for AI-referral attribution and an optional visitor survey.
- **AI Visibility:** 15 tracked questions, sampled weekly, across 3 answer engines of your choice (ChatGPT, Perplexity, AI Overviews, or Gemini), with appearance rate, citation share, and share of voice.
- **Actions** that turn lost questions into a list of articles to write, and a writer that produces answer-ready articles (30 generations per billing period).
- **Google Search Console integration**, so questions you already earn impressions for can become tracked questions.

One plan: **$29/month**, 7 days free, then billed monthly. Cancel anytime. See [pricing](https://terradium.io/pricing). If you are comparing dedicated trackers, start with [the best AI visibility tools](https://terradium.io/best-ai-visibility-tools).

## FAQ

**What is AI traffic analytics?**

Measuring how AI systems interact with your site and brand: crawlers fetching your pages, visitors who click through from AI answers, and how often AI answers mention or cite you.

**Can Google Analytics 4 track ChatGPT traffic?**

Partly. Visits that arrive with a referrer show the AI tool as the source, and you can group them with a custom channel group. Visits without a referrer land in Direct, and GA4 cannot see answers that never produced a click.

**How do I track traffic from Google AI Overviews?**

AI Overviews sit inside Google Search, so in standard analytics reports those clicks can be hard to tell apart from ordinary Google search clicks. An attribution script that classifies AI referrals, plus sampled tracking of whether AI Overviews cite you for your key questions, gives you both sides. Terradium's Embed SDK attributes AI Overviews referrals, and AI Visibility can sample AI Overviews.

**Is AI crawler traffic the same as AI referral traffic?**

No. Crawler traffic is bots fetching pages; it shows up in server logs, not in analytics. Referral traffic is people clicking a link in an AI answer. A site can get a lot of one and little of the other.

**Does Terradium log AI crawler visits?**

No. The free AI crawler checker tests whether AI crawlers can access and read a page. For crawler visit volume, use your server logs or CDN analytics.

**Does the Embed SDK collect personal data?**

Not by default. It collects traffic-source signals (referrer and AI-referral classification, UTM and gclid parameters, entry path, and optional survey answers), anonymizes IPs server-side, and supports a consent mode.

## Start the 7-day free trial

[Start the 7-day free trial](https://terradium.io/pricing) · [Check your site's AI crawler access free](https://terradium.io/tools/ai-crawler-checker)