Features
Visual workflow designer (drag & drop)
YAML-based workflow as code
Event-driven triggers (Kafka, SQS, webhook)
Cron scheduling & time-based triggers
Parallel task execution with DAG support
Built-in script & SQL tasks
Plugin system for 200+ connectors
Real-time execution monitoring & logs
Alerting & notifications (Slack, email)
Backfill & replay of past executions
Version control for workflows (Git integration)
Role-based access control (RBAC)
Audit trail for compliance
Nested workflows & subflows
Blue/green deployment support
Web crawling and scraping API with Rust engine
AI Studio for natural language crawling (add-on $6/mo)
Browser AI commands via WebSocket: Act, Extract, Observe
Silk custom AI model for extraction and captcha solving
Browser Cloud with stealth anti-detection
Structured output: markdown, HTML, JSON, CSV, XML, plain text
Screenshot capture of pages
Link extraction from pages
Search endpoint for query-based data retrieval
Unblocker with rotating proxies and automatic retries
1,000+ ready-made scraper examples (32 categories)
Data connectors: S3, GCS, Google Sheets, Azure Blob, Supabase
Respects robots.txt (configurable)
Failed requests not billed
Open-source core available on GitHub
