> ## Knowledge Base Index
> Fetch the complete knowledge base index at: https://help.1lookup.io/sitemap.xml
> Use this file to discover available pages before exploring further.
> Pure-Markdown content can be obtained by appending a '.md' suffix to the content URLs listed in the sitemap (without the trailing slash).

# Website content scraper: get clean page text from any URL

Website Content Scraper takes a web address and gives you back the page as clean, readable text plus a few basic details about it. Use it when you want the content of a page without writing your own parser or wrestling with raw HTML.

## What it tells you

- The title of the page.
- The body of the page as clean Markdown text (plain text with simple formatting), ready to read, store or pass into your own tools.
- How many characters of content the page produced.
- How many links were found on the page.
- Whether the page returned any usable content at all.

## What you need to provide

One input: the address of the page you want. It must start with `http://` or `https://`, or be a plain valid domain.

## What it costs

10 credits per lookup. Live per-product costs are shown on the Billing page in your dashboard.

## How to run it

- In the dashboard: Website Content Scraper
- From your code: POST /v1/website-scraper, then see the Developer Hub at app.1lookup.io/developer-hub.

## Good to know

- It scrapes the single page at the address you give it. It does not walk the rest of the site, so send one address per lookup.
- Results are point-in-time. What comes back is what the page contained at the moment you ran the lookup, and pages get edited, moved and taken down, so re-run when you need current content.
- Check the "has content" flag before you use the text. Some pages return nothing usable, and the character count will show that too.
- The link count and character count are quick ways to judge whether you got a real page or a near-empty one, before you spend time on the text itself.