omlx jundot
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
- Language
- Python
- Stars
- 18,882
- Forks
- 1,642
Tags
- 推理优化
- 本地部署
- 桌面应用
- Python
- 工具调用
- 上下文协议MCP
- 模型管理
- 库/SDK
README
<p align="center"> <picture> <source media="(prefers-color-scheme: dark)" srcset="docs/images/icon-rounded-dark.svg" width="140"> <source media="(prefers-color-scheme: light)" srcset="docs/images/icon-rounded-light.svg" width="140"> <img alt="oMLX" src="docs/images/icon-rounded-light.svg" width="14…