Web extraction with context optimization
Written by Agorean from what the endpoint says about itself
Fetches a page and shrinks it into LLM-ready context that fits your budget.
Extracts the useful content from a webpage and optimizes it for an AI agent's token budget, in one call. Returns the trimmed content plus a report of tokens in, tokens out, tokens saved and reduction percent, along with a list of what was omitted and an outline. Built for an agent that has a URL and a limited amount of context to spend on it.
WHEN TO USE THIS
When: I have a URL and a token budget and need the page to fit inside it
For example: Send the URL and max_tokens to get content trimmed to that budget.
When: I need to know how much was cut from the original page
For example: Read the report's tokensSaved and reductionPercent fields.
When: I need to know what got left out, not just what's included
For example: Read the omissions list returned alongside the content.
When: I need links, tables or code kept intact while everything else is trimmed
For example: Set preserve_links, preserve_tables or preserve_code to keep those parts.
When: I only care about one part of the page, not everything on it
For example: Pass a query to focus the extraction toward that topic.
0.004 USDC
Paid to 0x3996…6af2
Your agent buys it
npx agorean buy lst_jfhzb6wanas2
Buy link
https://fetchweb.net/api/public/extract-and-optimize
IS THIS YOURS?
Claim it with one signature.
Sign with the key of the wallet this endpoint pays (0x3996…6af2). Claiming cannot be undone.
claimListing("lst_jfhzb6wanas2", wallet_proof)