Automation

Crawl4AI is an open-source (Apache 2.0) web crawler and scraper that converts sites into LLM-ready Markdown and structured data. It can be self-hosted with Docker, supports MCP and offers a cloud API.

Browse AI is a no-code web scraper and website monitor that you train by pointing and clicking. It offers 250+ prebuilt robots and integrations with Google Sheets, Airtable and Zapier.

BrowserAct is an AI-powered no-code scraping platform where you describe the data you need and it builds a self-healing bot with proxy and CAPTCHA handling. It exports to CSV, JSON, APIs, Make, n8n and Zapier.

Web scraping API service. Simplifies data extraction by handling proxy rotation, JavaScript rendering, and CAPTCHA solving.

Firecrawl is a web data API that turns websites into clean markdown and structured data such as JSON for AI. With its Search, Scrape, Crawl, Interact and Parse endpoints, you can run searches, crawl entire sites, interact with pages that require login, and read PDF or DOCX files. It is aimed at developers building RAG pipelines and AI applications; it is open source, with SDKs for Python, Node.js, Go and more, plus an MCP server. The free plan, which requires no card, includes 1,000 credits per month.

Cloud browser automation platform for AI agents. Manage headless browser sessions and pull web data programmatically.

Apify is a cloud-based platform with ready-made "Actor" tools for web scraping and automation. Actors are serverless programs that pull data from the web or automate browser tasks. Apify offers thousands of ready-made Actors, API access, data storage, proxy services and an MCP server for AI agents. It suits developers and businesses doing market research, lead generation and social media monitoring. The free plan, which requires no credit card, gives $5 in usage credit that renews every month; beyond that it works on a pay-as-you-go model.

AI-powered web crawling and data extraction tool. Automatically collect structured data from websites.