campinator/gridllm-server

•Updated about 1 year ago

GridLLM scales LLM inference with a central server, load balancing, and Ollama API support

Buildkit cache

Image

Message queues

Machine learning & AI

597

campinator/gridllm-server repository overview

No overview available

This repository doesn't have an overview

Recent tags

Content type

Image

Digest

sha256:45ba35cc5…

Size

69 MB

Last updated

about 1 year ago

docker pull campinator/gridllm-server