Add to ClaudeWeb Scraper turns any website into structured, readable data. It handles JavaScript-heavy pages, anti-bot protection, geographic targeting, and AI-powered data extraction — all without writing any code. Whether you need the text from a single page, a full site crawl, or a structured dataset extracted to a schema, it's one tool.
Standard web scrapers break on modern sites that require JavaScript to render. This one renders fully, bypasses bot detection, supports custom request headers, and can extract specific data fields using AI so you get exactly what you asked for, not raw HTML. Checked 2026-08-26 against this manifest.
What you can do
- scrape_page — scrape a single page with JS rendering; returns markdown, HTML, filtered content, or JSON responses
- crawl_site — recursively crawl a site up to a depth and page limit, collecting all content
- map_site — fast URL discovery without content, useful before deciding what to crawl
- extract_data — AI-powered structured extraction — describe what you want or pass a JSON schema
- search_web — search the web and optionally scrape the top results in one call
- stealth_scrape / stealth_crawl — enhanced anti-bot bypass for heavily protected pages
Who it's for
Researchers aggregating content from multiple sites. Data teams building datasets from web sources. Developers integrating web content into pipelines. Marketers monitoring competitor offers and messaging. Analysts tracking content changes over time.
How to use it
- Start with scrape_page for a single URL — add onlyMainContent to strip navigation and footers
- Use map_site to discover URLs on a domain before deciding what to crawl
- Use crawl_site for recursive multi-page collection with depth and path filters
- Use extract_data when you want specific fields — pass a schema or describe what to extract in plain English
- If a page blocks the ordinary request, use stealth_scrape for enhanced routing
- For long React/SPA pages or competitor research, set fullContent to true or increase maxPreviewChars so the model-facing response includes more than the compact preview
fetch_page adds browser controls, cookies and selectors.
Getting started
Try scrape_page with "https://example.com" and a bounded preview. Representative manifest-schema shape: success, data [redacted]. Complete rendering is not guaranteed; timing varies.
