google / robotstxt
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
- Repository stars
- 3,479All-time #17,826
- Fork
- 259
- Last push
- updated 7 months ago
- Repository created
- since 2019
About
Summarised by AI from the README; the original prevails
Author description: The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Basic listing based on official public information; functionality has not been independently evaluated.
Check before adopting
- No pushes for over 6 months (last 2026-04-01); check whether it is maintained.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified