Compare projects

Select 2–4 projects to compare on the same basis.

promptfoo / promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

chunxiaoxx / nautilus-compass

Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform

Popularity
Repository stars26,914Highest1,256
Fork2,670Highest35
Maintenance
Last push2026-11-072026-11-07
Maintenance notesNot verifiedNot verified
Repository created2023-04-282026-04-27
License & use
LicenseMIT · PermissiveLicense not declared
PricingPricing not verifiedPricing not verified
Basics
Browse by purposeContinuous delivery · Model and data evaluation · Retrieval-augmented generation · Software testingModel and data evaluation · Retrieval-augmented generation
TypeApps & systemsApps & systems
SubcategorySecurity toolsAI apps
PlatformNot verifiedNot verified
First collected2026-11-032026-11-03
LanguageTypeScriptPython

License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited. Measured at 2026-11-07 UTC