All projects
5 repositories · updated 2026-11-07
Loading…
1unclecode / crawl4aiOpen-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtfPythonApache-2.0 · PermissiveInsufficient rank history87,015
2lexmount / moliAuthor description: Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in RustRustApache-2.0 · PermissiveInsufficient rank history22,832
3apify / crawlee-pythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.PythonApache-2.0 · PermissiveInsufficient rank history9,657
4MontFerret / ferretDeclarative data automation language and Go runtime for structured extraction workflows.GoApache-2.0 · PermissiveInsufficient rank history6,024
5omkarcloud / botasaurusThe All in One Framework to Build Undefeatable ScrapersTypeScriptMIT · PermissiveInsufficient rank history5,828
