Open-source repositories gaining traction right now.
10 repositories
#web-scraping
The API to search, scrape, and interact with the web at scale. 🔥

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Clone any website with one command using AI coding agents

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.


Headless browser automation server for AI agents to visit sites that are usually blocked

Star firecrawl / firecrawl-mcp-server 🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Sponsor Star gosom / google-maps-scraper scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

HTML obfuscation library and CLI for Rust. Renders identically in browsers but is hard for humans to read.
Paste a github.com URL. Submissions are reviewed before they are tracked.