# Large language model (LLM)

> For the complete documentation index, see [llms.txt](https://attensira.com/llms.txt).
> Every page on this site is also served as Markdown: append `.md` to any URL, or send `Accept: text/markdown`.

> An LLM is a neural network trained on huge amounts of text to predict the next token. How it works, and why answers about your brand can be fluent and wrong.

- Canonical page: https://attensira.com/glossary/llm
- Family: glossary
- Last updated: 2026-10-04
- Author: Karl-Gustav Kallasmaa (https://x.com/kallasmaa)
- Claims as data: https://attensira.com/claims.json?slug=llm

**In short:** A large language model (LLM) is a neural network with billions of parameters, trained on large amounts of text to predict the next token, then tuned to follow instructions. It writes fluent answers from patterns in its training data, or from pages a search step fetches at answer time. Fluency is not accuracy: it can state wrong facts confidently.

| Figure | What it counts | n |
| --- | --- | --- |
| 33.5 | citations per ChatGPT answer | 78,667 citations in 2,349 answers |
| 10.0 | citations per Perplexity answer | 21,713 citations in 2,175 answers |
| 6.6% | ChatGPT answers citing attensira.com | 154 of 2,349 |
| 3.9% | Perplexity answers citing attensira.com | 85 of 2,175 |

Window 2026-09-04 to 2026-10-04. attensira.com workspace, the same 61 tracked questions on both engines, read over the Attensira MCP on 2026-10-04.

_Source: attensira.com workspace, the same 61 tracked questions on both engines, read over the Attensira MCP, as of 2026-10-04._

## Key facts

- Also called: LLM, foundation model
- Trained to: Predict the next token, then follow instructions
- Architecture: The Transformer (2017)
- Unit of text: [Tokens; about 3.5 English characters for Claude](/glossary/tokens)
- Two routes to an answer: Weights from training, or pages fetched at answer time
- Covers: The AI-search sense of machine learning
- In Attensira: [Answers counted per engine, with n](https://docs.attensira.com/measure/how-we-collect-data)

A large language model is a neural network with a very large number of parameters, trained on large amounts of text, that generates language by repeatedly predicting the next token. Anthropic's [glossary](https://platform.claude.com/docs/en/about-claude/glossary) calls LLMs "AI language models with many parameters that are capable of performing a variety of surprisingly useful tasks", trained on vast text data and able to answer questions and summarise information.

Everything else about how these systems behave, the fluency, the confidence and the particular ways they get facts about your company wrong, follows from that mechanism and from what was done to the model after pretraining.

## How does an LLM work, step by step?

**Tokenisation.** Text is cut into tokens before the model sees it. Anthropic describes tokens as words, subwords, characters or bytes, and documents that a Claude token is about 3.5 English characters. Your product name may be one token or five. See [tokens](/glossary/tokens).

**Pretraining.** The model learns to predict the next token over a huge unlabelled corpus. Anthropic notes that pretrained models "are not inherently good at answering questions or following instructions": the objective is prediction, not helpfulness. Machine learning is the wider field; this is the specific technique.

**Fine-tuning and RLHF.** Further training, including reinforcement learning from human feedback, turns the predictor into an assistant by ranking outputs and pushing the model toward the preferred ones.

**Inference.** At request time the model works inside a [context window](/glossary/context-window), its working memory for that request. Anthropic documents 1M-token windows on several current Claude models and warns that accuracy and recall degrade as the window fills.

The architecture underneath is the Transformer, from [Attention Is All You Need](https://arxiv.org/abs/1706.03762) (12 June 2017), which dropped recurrence for attention alone and reported 28.4 BLEU on English-to-German and 41.8 on English-to-French after 3.5 days on eight GPUs.

## How does a sentence about your brand get into an answer?

By one of two routes, with opposite economics.

**Through the weights.** Something in the training corpus shaped a tendency. You cannot edit it or date it, and it comes with no citation. The model can even produce plausible-looking URLs it never fetched. See [AI training data](/glossary/ai-training-data) and [knowledge cutoff](/glossary/knowledge-cutoff).

**Through retrieval.** A page was fetched during the request and placed in the window. That passage exists, can be cited, and changes the moment you edit the page. This is the only route with a feedback loop short enough to work with, which is why [RAG](/glossary/rag) matters more to a publisher than model choice does.

## What does an LLM say when asked about its own field?

It sorts the market and names the familiar brands. Asked for an "LLM SEO tool" on 3 October 2026, ChatGPT split the field into tracking, content optimization and execution, listed eight tools and did not name Attensira. Answers like this are drawn from the pages a search step fetched, so they move when those pages do.

**ChatGPT, asked 2026-10-03:** "LLM SEO tool"

> If you mean tools for LLM SEO / GEO (getting your brand cited in ChatGPT, Perplexity, Gemini, Google AI Overviews, etc.), the market has split into a few categories.… Current comparisons generally distinguish between tracking, content optimization, and execution—and the right tool depends heavily on which of those you need.

Sources cited, in order: crawlraven.com, tracemetry.com, rankscope.ai, loudscale.com, slatehq.com, rankai.ai, neverdrafts.com, lovedby.ai, aicitationhub.net, pepper.inc, crawloria.com, ranktopai.com.

Attensira: not named.

_Source: attensira.com workspace, a stored ChatGPT answer read over the Attensira MCP, as of 2026-10-04._

## Do different AI assistants answer the same question the same way?

No, and the difference is measurable. Attensira reads the same tracked questions on ChatGPT and Perplexity every day for our own site. Over the 30 days to 4 October 2026, the two diverged on evidence more than on rates.

ChatGPT named Attensira in 99 of 2,349 answers (4.2%) and cited attensira.com in 154 (6.6%). Perplexity named us in 98 of 2,175 (4.5%) and cited us in 85 (3.9%). Every one of those namings came from the three tracked questions that contain our name; the other 58 questions named us in none of 4,326 answers. The figure at the top of this page sets the citation rates beside the starkest difference: a ChatGPT answer carried 33.5 citations on average, a Perplexity answer 10.0.

Our mention rates on the two were close. The evidence was not. ChatGPT read widely and leaned hardest on OpenAI's and Google's own documentation; Perplexity cited a third as many pages per answer, spread across vendor blogs, LinkedIn and review sites. Same questions, different retrieval, different evidence. A single answer from one assistant tells you about that draw on that engine, not about "AI".

That is also why Attensira tracks the product surface a person uses, with a stable id such as `chatgpt`, rather than a model version: [tracked models](/features/models) keep a continuous history when a vendor swaps the model underneath.

## What goes wrong when LLMs answer about brands?

- **Fluent wrongness.** The training objective rewards likely text, not true text. A confident wrong sentence is the base behaviour when nothing grounds the request. See [AI hallucination](/glossary/ai-hallucination).

- **Fabricated citations.** A URL generated from the weights looks exactly like a retrieved one. A link is not evidence a page was read.

- **Stale claims.** A parametric answer reflects a corpus frozen months earlier; prices and positioning you changed last quarter can persist.

- **Context rot.** Filling a large window is not free; a retrieval step that dumps everything can do worse than one that selects well.

- **Non-determinism.** Anthropic states that even at temperature 0 identical inputs can produce different outputs. One answer is one draw, which is why any rate needs its sample size.

## What does Attensira do with LLM answers?

It treats them as observations to count, not quotes to screenshot. Attensira asks your buyers' questions on every engine your plan reads (the [models documentation](https://docs.attensira.com/tracking/models) lists which engines each plan includes) at a fixed daily cadence, keeps every answer verbatim, and computes mention and citation rates over runs with the sample size attached. A change is reported only when it passes a significance test, as its [methodology](https://docs.attensira.com/measure/how-we-collect-data) documents. Then the crew does the part a dashboard leaves to you: it finds the pages the answers lean on and writes the fix, which waits for your approval before it ships.

## FAQ

### What is a large language model, precisely?

Anthropic's glossary defines LLMs as AI language models with many parameters that are capable of performing a variety of surprisingly useful tasks, trained on vast amounts of text, able to generate human-like text, answer questions and summarise information. Underneath is next-token prediction learned in pretraining.

### What is a token, and how much text is one?

Tokens are the smallest units a language model processes, and can be words, subwords, characters or bytes. Anthropic documents that for Claude a token is approximately 3.5 English characters, though the exact number varies by language.

### Where does the architecture come from?

The Transformer, introduced in Attention Is All You Need by Vaswani and colleagues, submitted 12 June 2017. It replaced recurrence and convolution with attention alone, reporting 28.4 BLEU on WMT 2014 English-to-German and 41.8 BLEU on English-to-French after 3.5 days of training on eight GPUs.

### Is ChatGPT an LLM?

ChatGPT is a product built on LLMs, not a single model. The product adds search, tools and routing between model versions on top. That is why Attensira tracks the product surface a person uses, such as chatgpt, rather than a model version: the vendor can swap the model underneath while the product stays the same.

### Does a bigger context window mean the model reads everything I publish?

No. The window is working memory for one request, not a store of your site. Anthropic documents 1M-token windows on several current Claude models and notes that accuracy and recall degrade as the token count grows, which it calls context rot. Something still has to choose what goes in.

### If a model states a wrong fact about my product, can I correct it?

Not in the weights, and not on your schedule. What you can change is what a retrieval step finds today. A claim in a fetchable, self-contained passage on your site changes the moment you edit it; a claim learned in pretraining does not.