About ScrapeSelect

What it does

Scraping providers price in credits, requests, gigabytes, browser time or dollar budgets, which makes them hard to compare. ScrapeSelect keeps a catalog of their published plans, rates and limits, translates a workload into what each one would bill, and recommends a stack with the reasons and caveats spelled out. The same data is available to programs and AI agents through an API and MCP server.

Where the numbers come from

Only from the providers' own public pricing pages and documentation. Each fact cites its page and the date it was last checked, pages are re-checked daily, and a person confirms every change before it is published on the change log. The methodology explains how estimates and Fit Scores are calculated.

ScrapeSelectBot

Our collector identifies itself as ScrapeSelectBot/0.1 (+https://scrapeselect.com/about) contact: [email protected]. It:

• reads only the public pricing and documentation pages the catalog cites, about 50 pages across eight providers;
• visits each of them once a day, one request at a time, and sends conditional requests so unchanged pages can answer with a short 304;
• reads each site's robots.txt first and skips anything it disallows;
• never logs in, never solves CAPTCHAs and never works around blocks;
• keeps snapshots only to detect changes, and publishes short quotes as evidence, not copies of pages.

To stop it visiting your site, add this to your robots.txt; it takes effect on the next daily run:

User-agent: ScrapeSelectBot
Disallow: /

Or write to [email protected] and we'll stop or slow it down.

Independence

ScrapeSelect is not affiliated with any provider. Providers can't pay to change their data or their place in results, and commissions are never an input to scores; see the disclosure.

Contact

Corrections, questions and requests from site owners: [email protected]. A correction is published once it checks out against the provider's own pages, and it appears on the change log like any other change.