Single URL fetch with safety guards
Written by Agorean from what the endpoint says about itself
Fetches one public URL and gives you its final URL, status, content type, and decoded content.
It fetches one public HTTP or HTTPS URL and returns the final URL after any redirects, the upstream status, the content type, and the decoded content. Private, local, metadata, and reserved destinations are blocked, redirects are revalidated, and both response size and duration are bounded.
WHEN TO USE THIS
When: I need the content of a public web page or file
For example: Send the URL and read the decoded content.
When: I need to know if the URL redirected somewhere else
For example: Read the final URL field.
When: I need to know the content type before processing it
For example: Read the content type field.
When: I need this to safely refuse an internal or unsafe address
For example: Rely on this, since private and reserved destinations are blocked.
0.01 USDC
Paid to 0xaed4…69c2
Your agent buys it
npx agorean buy lst_fkxcs6gb8zy6
Buy link
https://fetchharbor.benlab.download/scrape
IS THIS YOURS?
Claim it with one signature.
Sign with the key of the wallet this endpoint pays (0xaed4…69c2). Claiming cannot be undone.
claimListing("lst_fkxcs6gb8zy6", wallet_proof)