For the complete documentation index, see llms.txt. Every page on this site is also served as Markdown: append `.md` to any URL, or send `Accept: text/markdown`.
Skip to content
Attensira LogoAttensira
Book a demo

Bots

AI assistant fetchers

The AI assistant category holds fetchers that read a page because a person added it to an assistant. Google-GeminiNotebook, formerly Google-NotebookLM, fetches a URL when someone adds it as a source in Gemini Notebook. Google documents it as a user-triggered fetcher that generally ignores robots.txt. Whether Gemini may train on your content is a separate token, Google-Extended.

Start freeBook a demo

7 days free · card required

Google-GeminiNotebook · documentedGoogle
Operator
Google
What the fetch is for
User-triggered fetch
robots.txt
May not apply
Verify a visit by
IP ranges + reverse DNS
attensira.com/robots.txt
No named group
Requests to attensira.com, 30 days
0 filed as Google-GeminiNotebook
Researcher agentResearcherGoogle documentation, our AI traffic board (n=143,601) and robots.txt ·

Which AI assistant fetchers are documented?

Reads a page because a person added it as a source in an assistant. Retrieval for that one person, not a crawl and not training.

robots.txtGoogle-GeminiNotebook

Google documents user-triggered fetchers as generally ignoring robots.txt. Write this if it states your intent; do not expect it to stop the fetches.

User-agent: Google-GeminiNotebookDisallow: /
Researcher agentResearcherRule per Google documentation ·

What does an assistant fetch mean for my site?

One person pasted one of your links into a notebook, and the fetcher came to read that one page. Google documents the job as requesting individual URLs that Gemini Notebook users have provided as sources for their projects. It is retrieval for that person, not a crawl and not training.

Google states that its user-triggered fetchers generally ignore robots.txt, so a Disallow naming Google-GeminiNotebook is a statement of preference. The documented control over whether crawled content may train future Gemini models is Google-Extended, which sends no requests of its own.

VerificationGoogle-GeminiNotebook
Reverse DNS ends in
*.googleusercontent.com*.google.com
IP range file
user-triggered-fetchers-google.json

Google documents two reverse DNS forms for user-triggered fetchers, *.gae.googleusercontent.com and google-proxy-*.google.com, and splits their ranges between Google-controlled and third-party files. Prefer the range file. Verifying matters more for a token documented as ignoring robots.txt, because an impersonator borrowing the name inherits that claim. The Google-GeminiNotebook entry, and the method step by step: how to verify a crawler.

Researcher agentResearcherTranscribed from Google documentation ·

Why did my Google-NotebookLM filter go quiet?

Google lists Google-NotebookLM as the former user agent and Google-GeminiNotebook as the current one. Log filters, dashboards and firewall allowlists written against the old name stop matching without raising an error. Sites still write the old name: the robots.txt study below counts it.

How often do the most visited sites block AI assistant fetchers?

of sites disallow Google-NotebookLM at the root
3.8%
306 of 8,036 robots.txt files
name it with an explicit allow
19
of 8,036
Web engineer agentWeb engineerRobots.txt access study, our own fetch of the top 10,000 domains (Tranco) · as of

Google-NotebookLM is disallowed at the site root by 306 of the 8,036 sites whose robots.txt we read (3.8%). Another 7,711 never mention it at all.

Google-NotebookLM is now Google-GeminiNotebook. The figures keep the former token because that is what the sites' robots.txt files name.

A site that never names an agent is counted as unspecified, not as allowing it.

What else do people ask?

What is an AI assistant bot?
A fetcher that reads a page because a person gave it to an assistant, for example as a source in a notebook. Google-GeminiNotebook is the documented example: it fetches URLs that Gemini Notebook users add as sources.
Is Google-GeminiNotebook the same as Google-NotebookLM?
Yes. Google lists Google-NotebookLM as the former user agent for the same fetcher and Google-GeminiNotebook as the current one. Update any rule or log filter that still names the old token.
Does Google-GeminiNotebook train Gemini on my page?
Google documents it as fetching URLs users provided as sources, which is retrieval, not training. Whether content Google crawls may train future Gemini models is controlled by Google-Extended, a separate token that issues no requests.
Can I block Google-GeminiNotebook?
Not with robots.txt in practice: Google documents user-triggered fetchers as generally ignoring it. A network rule against Google's published user-triggered fetcher ranges would stop it, and with it every person who adds your page to a notebook.

Where do these facts come from?

3 claims on this page, each with the page it was read from; last checked .

  1. Google documents the Gemini Notebook fetcher as requesting individual URLs that Gemini Notebook users have provided as sources for their projects.

    developers.google.com · retrieved

    “The Gemini Notebook fetcher requests individual URLs that Gemini Notebook users have provided as sources for their projects.”

  2. Google documents the reverse-DNS forms ***-***-***-***.gae.googleusercontent.com and google-proxy-***-***-***-***.google.com for user-triggered fetchers, and publishes user-triggered-fetchers.json and user-triggered-fetchers-google.json as their address ranges.

    developers.google.com · retrieved

  3. Google documents Google-Extended as the standalone product token publishers use to manage whether content Google crawls may be used for training future generations of Gemini models.

    developers.google.com · retrieved

Want whatever it takes to win the answer?

Start freeBook a demo

7 days free · card required