Compare projects
Select 2–4 projects to compare on the same basis.
SWE-bench / SWE-bench
Organize software-engineering agent evaluation around real repository issues.
promptfoo / promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Popularity
Repository stars6,15426,896Highest
Fork1,0462,666Highest
Maintenance
Last push2026-09-182026-11-06
Maintenance notesUnknownNot verified
Repository created2023-10-042023-04-28
License & use
LicenseMIT · PermissiveMIT · Permissive
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeModel and data evaluation · Software testingContinuous delivery · Model and data evaluation · Retrieval-augmented generation · Software testing
TypeDatasets & evaluationsApps & systems
SubcategoryBenchmarksSecurity tools
PlatformNot verifiedNot verified
First collected2026-11-022026-11-03
LanguagePythonTypeScript
License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Measured at 2026-11-06 UTC