airllm lyogavin

AirLLM 70B inference with single 4GB GPU

Language
Jupyter Notebook
Stars
31,204
Forks
3,316

README

![airllm_logo](https://github.com/lyogavin/airllm/blob/main/assets/airllm_logo_sm.png?v=3&raw=true) [**Quickstart**](#quickstart) | [**Configurations**](#configurations) | [**MacOS**](#macos) | [**Example notebooks**](#example-python-notebook) | [**FAQ**](#faq) **AirLLM** dramatically reduces infer…

查看完整页面