🔥 jundot / omlx - LLM inference server with continuous batching & SSD caching
GitHub热门项目 | LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar | Stars: 15,979 | 108 stars today | 语言: Python
本文内容来源于互联网,版权归原作者所有
查看原文