一款用于机器学习模型的推理服务器,支持多种框架、多模型服务等功能。
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more