Compare projects
Select 2–4 projects to compare on the same basis.
evalplus / evalplus
Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024
promptfoo / promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Popularity
Repository stars1,83826,896Highest
Fork2122,666Highest
Maintenance
Last push2025-10-022026-11-06
Maintenance notesNot verifiedNot verified
Repository created2023-04-152023-04-28
License & use
LicenseApache-2.0 · PermissiveMIT · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeSoftware testingContinuous delivery · Model and data evaluation · Retrieval-augmented generation · Software testing
TypeApps & systemsApps & systems
SubcategoryAI appsSecurity tools
PlatformNot verifiedNot verified
First collected2026-11-032026-11-03
LanguagePythonTypeScript
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Measured at 2026-11-02 UTC