For the complete documentation index, see llms.txt. Every page on this site is also served as Markdown: append `.md` to any URL, or send `Accept: text/markdown`.
Skip to content

Bots

Webhook agents

The webhook category holds agents that deliver data your application asked for, not crawlers that read your pages. APIs-Google delivers push notification messages from Google APIs to endpoints that subscribed to them. Google documents it as ignoring the wildcard robots.txt group, so a 'block all bots' rule leaves it running, which is usually what you want.

7 days free · card required

APIs-Google · documentedGoogle
Operator
Google
What the fetch is for
Product operations
robots.txt
Named group only
Verify a visit by
IP ranges + reverse DNS
attensira.com/robots.txt
No named group
Requests to attensira.com, 30 days
0 filed as APIs-Google
Researcher agentResearcherGoogle documentation, our AI traffic board (n=143,601) and robots.txt ·

Which webhook agents are documented?

robots.txtAPIs-Google

A wildcard group will NOT stop this agent. Address the token directly.

User-agent: APIs-GoogleDisallow: /
Researcher agentResearcherRule per Google documentation ·

Why is APIs-Google calling my endpoint?

Because something you run subscribed to a Google API that pushes updates instead of waiting to be polled. Google documents crawling preferences addressed to APIs-Google as affecting the delivery of push notification messages by Google APIs. It is the client that brings those messages.

If you are certain nothing depends on Google API push delivery, a group naming APIs-Google will reach it. The wildcard group will not: Google states the global user agent is ignored for this token. That is why a site-wide block leaves it running, and why your robots.txt is not broken when you see it.

User-AgentAPIs-Google
APIs-Google (+https://developers.google.com/webmasters/APIs-Google.html)

The APIs-Google entry, and reading user-agent strings.

Researcher agentResearcherTranscribed from Google documentation ·

How do I verify an APIs-Google request?

Not the way you verify Googlebot: check the hostname and the range file Google lists for its special-case crawlers, shown beside this. Google describes no search-indexing or training role for it, so it has no bearing on how search engines or AI assistants see your pages.

What else do people ask?

What is a webhook bot?
An agent that delivers data to an endpoint that asked for it, such as a push notification, rather than reading pages. APIs-Google, which delivers Google API push messages, is the documented example.
Does APIs-Google obey robots.txt?
Partly. Google documents APIs-Google as a robots.txt token and states that the wildcard group is ignored. A group that names APIs-Google applies; rules under User-agent: * do not.
Should I block APIs-Google?
Only if nothing you run depends on Google API push delivery. Blocking it stops those messages arriving and saves no crawl budget, because it is delivering data, not reading pages.
Does APIs-Google index my pages?
Google documents its job as delivering push notification messages by Google APIs and describes no indexing role. Search indexing is Googlebot's job, a separate token.

Where do these facts come from?

One claim on this page, with the page it was read from; last checked .

  1. Google documents that crawling preferences addressed to the APIs-Google user agent affect the delivery of push notification messages by Google APIs.

    developers.google.com · retrieved

    “affect the delivery of push notification messages by Google APIs.”

Want whatever it takes to win the answer?

7 days free · card required