Website content scraper: get clean page text from any URL

Website Content Scraper takes a web address and gives you back the page as clean, readable text plus a few basic details about it. Use it when you want the content of a page without writing your own parser or wrestling with raw HTML.

What it tells you

• The title of the page.
• The body of the page as clean Markdown text (plain text with simple formatting), ready to read, store or pass into your own tools.
• How many characters of content the page produced.
• How many links were found on the page.
• Whether the page returned any usable content at all.

What you need to provide

One input: the address of the page you want. It must start with http:// or https://, or be a plain valid domain.

What it costs

10 credits per lookup. Live per-product costs are shown on the Billing page in your dashboard.

How to run it

• In the dashboard: Website Content Scraper
• From your code: POST /v1/website-scraper, then see the Developer Hub at app.1lookup.io/developer-hub.

Good to know

• It scrapes the single page at the address you give it. It does not walk the rest of the site, so send one address per lookup.
• Results are point-in-time. What comes back is what the page contained at the moment you ran the lookup, and pages get edited, moved and taken down, so re-run when you need current content.
• Check the "has content" flag before you use the text. Some pages return nothing usable, and the character count will show that too.
• The link count and character count are quick ways to judge whether you got a real page or a near-empty one, before you spend time on the text itself.

Updated on: 24/08/2026