User-Agent: *
Allow: /
Disallow: /internal/

Sitemap: https://scrapeselect.com/sitemap.xml