#web-scraping

orangecoding/fredy

JavaScript

90

health

❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Germany on platforms like ImmoScout24, Immowelt, Immonet, eBay Kleinanzeigen, and WG-Gesucht and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)

php-curl-class/php-curl-class

PHP

90

health

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

apify/crawlee

TypeScript

89

health

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

xberg-io/crawlberg

Rust

89

health

High-performance web crawling engine with bindings for 11 languages

microlinkhq/browserless

JavaScript

88

health

The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.