Switchyard NVIDIA-NeMo
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
- 主要语言
- Rust
- Stars
- 1,560
- Forks
- 141
README
<p align="center"> <img src="assets/logo.png" alt="Switchyard" width="800"> </p> # Switchyard Switchyard is a Rust proxy and library for LLM traffic. It routes requests across providers, translates between OpenAI and Anthropic APIs, records operational metrics, and provides typed, composable routin…