About ADVSRBot
ADVSRBot is the crawler behind ADVSR. It identifies itself honestly on every request:
Mozilla/5.0 (compatible; ADVSRBot/1.0; +https://advsr.network/about-bot)
What it does
It polls RSS feeds and, where no feed exists, public index pages, at respectful intervals. It obeys robots.txt and backs off when asked.
What it stores
Headlines, links, publish timestamps, and source names. That is all.
What it never stores
Article bodies, and any image file. ADVSR keeps the address of the preview image a publisher declares for sharing, never the image itself, so it is always served by them. ADVSR links to publishers; it does not republish them.
Not a training crawler
ADVSRBot is an aggregator-referrer, not an AI training crawler. It does not collect content for model training. Rules aimed at training bots (GPTBot, ClaudeBot, CCBot) do not describe what ADVSRBot does; it follows the general rules in robots.txt.
Opt out
Publishers who prefer not to be aggregated can say so and we will honor it within 24 hours, permanently. Contact: see the About page.