Bot identity
Ravensight Bots
This page documents the automated agents Ravensight operates, so site administrators can verify our traffic.
RavensightBot — publisher crawler
RavensightBot discovers newly published reporting for Ravensight's media intelligence service. It polls publisher-provided RSS and Atom feeds and article-listing sitemaps for updates. When a new article appears, RavensightBot may fetch that article page for analysis. It does not systematically traverse publisher archives or unrelated site pages.
RavensightBot follows applicable robots.txt rules and Crawl-delay,
and uses conditional requests where supported to avoid downloading unchanged feeds. It does
not bypass paywalls or access controls.
How RavensightBot behaves
| Discovery | Publisher-provided RSS and Atom feeds and article-listing sitemaps. |
|---|---|
| Article access | Newly discovered article URLs, with retries when a fetch fails. |
| Server load | Conservative polling, conditional requests, and publisher crawl delays. |
| Access controls | No paywall or authentication bypass. |
| Content use | Article pages are processed to produce structured analysis. Publisher text is not exposed, sold, republished, redistributed, or offered as an article archive. |
| Model training | Publisher content is not used to train generative AI models. |
| Attribution | References name the publisher and link to the original article. |
| Publisher control | Use robots.txt to limit or stop RavensightBot access. |
Partnership enquiries:
partnerships@ravensight.ai.
Corrections, removals, and crawler questions:
ops@ravensight.ai.
- User-Agent
-
RavensightBot/1.0 (+https://bot.ravensight.ai) - From header
ops@ravensight.ai— sent on every identified fetch.- Purpose
- Fresh-article discovery via feeds and article-listing sitemaps for source-linked news intelligence.
- Crawl behavior
-
Honors robots.txt, including
Crawl-delay. Feed polling intervals are per-publisher and conservative. - Opt out
-
Disallow
RavensightBotin your robots.txt — we check it before fetching. - Contact
- ops@ravensight.ai
Ravensight Entity Resolver
Resolves entities mentioned in third-party reporting to Wikidata identifiers. Automated, cache-backed, rate-limited, limited to the Wikidata Action API, and compliant with Wikimedia User-Agent policy.
- User-Agent
-
Ravensight-EntityResolver/1.0 (+https://bot.ravensight.ai; ops@ravensight.ai) - Purpose
- Entity resolution for source-linked intelligence, plus periodic link re-validation.
- Contact
- ops@ravensight.ai
Ravensight is operated by Ravensight OÜ, a legal entity registered in Estonia.