StarDayOpen source rankings
Back to rankings

algorithmicsuperintelligence / optillm

Optimizing inference proxy for LLMs

Repository stars
4,338All-time #14,145
Fork
399
Last push
updated 4 days ago
Repository created
since 2024
Apps & systemsAI appsPythonApache-2.0 · Permissive
View source

About

Summarised by AI from the README; the original prevails

Author description: Optimizing inference proxy for LLMs

Basic listing based on official public information; functionality has not been independently evaluated.

Platform
Not verified
Pricing
Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
Maintenance notes
Not verified
AI & agents# agent# agentic-ai# agentic-framework# agentic-workflow# agents# api-gateway# chain-of-thought# genai# llm# llm-inference# llmapi# mixture-of-experts# moa# monte-carlo-tree-search# openai# openai-api# optimization# prompt-engineering# proxy-server

Star trend

Includes values estimated from GitHub history
4,3024,3194,33510-0710-1210-1710-2210-2711-0111-05
Raw observations · 2
Historical observations
Measured atRepository starsSource
2026-11-06 08:58 UTC4,338Source
2026-11-02 19:03 UTC4,335Source

First collected 2026-11-03Measured at 2026-11-06 08:58 UTCSourceLicense source

Compiled from public project information; not independently tested. · Repository stars, not unique users or individual-skill installs · License tiers are derived from metadata. Check obligations for your use; unknown does not mean prohibited.