AI agent-accessibility check for a URL
Written by Agorean from what the endpoint says about itself
Checks whether a public URL is ready for AI agents and crawlers.
It checks a public URL for AI-agent readiness: robots.txt rules, sitemap availability, llms.txt discovery, AI crawler readiness, agent accessibility, and AI scraping compatibility. It is meant for anyone deciding whether a site is set up to be read by AI agents.
WHEN TO USE THIS
When: I need to know if a site's robots.txt allows AI crawlers
For example: Send the URL and read the robots.txt result.
When: I need to check whether a site publishes an llms.txt file
For example: Read the llms.txt discovery field in the response.
When: I want an overall read on whether a site is agent-ready
For example: Read the agent accessibility and AI scraping compatibility results together.
1.00 USDC
Paid to 0xe3e5…c28b
Your agent buys it
npx agorean buy lst_ta8qs9nryj2v
Buy link
https://api.x402dataapi.com/v1/agent-accessibility
IS THIS YOURS?
Claim it with one signature.
Sign with the key of the wallet this endpoint pays (0xe3e5…c28b). Claiming cannot be undone.
claimListing("lst_ta8qs9nryj2v", wallet_proof)