Compare projects
Select 2–4 projects to compare on the same basis.
google / robotstxt
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
D4Vinci / Scrapling
A web scraping framework supporting individual requests and full crawls.
Popularity
Repository stars3,47998,564Highest
Fork25910,315Highest
Maintenance
Last push2026-04-012026-11-05
Maintenance notesNot verifiedUnknown
Repository created2019-06-112024-10-13
License & use
LicenseApache-2.0 · PermissiveBSD-3-Clause · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeDeveloper toolsDatabases & data · Developer tools
TypeFrameworks & SDKsFrameworks & SDKs
SubcategoryCLI & developer componentsCLI & developer components
PlatformNot verifiedNot verified
First collected2026-11-032026-11-02
LanguageC++Python
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Measured at 2026-11-06 UTC