Features
Markdown extraction with automatic cleaning
Smart caching (up to 10x faster)
Change detection feeds (polling-free updates)
Crawling Agent (Wagent) for natural-language extraction
Sitemap-assisted crawl discovery
Multiple output formats: markdown, cleaned, html, links
Synchronous scrape endpoint with 3-minute timeout
Job cost visibility in dashboard
Job status filtering in dashboard
Organization balance endpoint
Multiple API keys per account
Structured output with JSON Schema
Subscription plans with self-serve management
Tax-inclusive billing via Stripe
Proxies, retries, headless browsers, CAPTCHA solving
Web crawling and scraping API with Rust engine
AI Studio for natural language crawling (add-on $6/mo)
Browser AI commands via WebSocket: Act, Extract, Observe
Silk custom AI model for extraction and captcha solving
Browser Cloud with stealth anti-detection
Structured output: markdown, HTML, JSON, CSV, XML, plain text
Screenshot capture of pages
Link extraction from pages
Search endpoint for query-based data retrieval
Unblocker with rotating proxies and automatic retries
1,000+ ready-made scraper examples (32 categories)
Data connectors: S3, GCS, Google Sheets, Azure Blob, Supabase
Respects robots.txt (configurable)
Failed requests not billed
Open-source core available on GitHub
