← Back to Discover
apify

apify/crawlee-python

PythonApache-2.0activepopular
89Health

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Stars9.3k
Forks768
Open Issues86
Contributors768
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
14
Popularity
25
#apify#automation#beautifulsoup#crawler#crawling#headless#headless-chrome#parsel#pip#playwright#python#scraper#scraping#selenium#web-crawler#web-crawling#web-scraping
View on GitHub ↗Issues (86) ↗Pull Requests ↗

Should you contribute to apify/crawlee-python?

apify/crawlee-python has a FoundDev health score of 89/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

apify
apify/crawlee-python
PythonApache 2.0
89

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

activepopular
9.3k768 contributors86 issues
0d ago

More Python repos

gem
gem/oq-engine
OpenQuake Engine: a software for Seismic Hazard and Risk Analysis
44594
dancinlab
dancinlab/anima
🧠 Living Consciousness Agent — PureField repulsion-field engine · Engine A ⇄ Engine G · Ψ=1/2 fixed point · 2,448 laws + 392 hypotheses
16393
vprusso
vprusso/toqito
|toqito> (Theory of Quantum Information Toolkit) is a Python library for research in quantum information theory.
28393