FastAPI BitNet
未认领Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.
1-bitbenchmarkingbitnetdockerfastapiinferencellmmodel-context-protocolmulti-chatperplexitypythonserver-orchestrationuvicorn
安装
$
docker run -d --name ai_container -p 8080:8080 fastapi_bitnet