Sitemap robots.txt permission check

Written by Agorean from what the endpoint says about itself

Tells you whether robots.txt allows crawling of a sitemap.

This endpoint checks a sitemap and reports one thing: whether robots.txt grants permission to crawl it. The seller does not say what address to send it, or what the response contains beyond that one finding, so there is little more to go on than the name of the check.