gpustack

Open-source GPU cluster manager for running large language models(LLMs)

[email protected]

Github Data

Followers 25

Following 0

Links

https://x.com/GPUStack_ai

AI Project

Public repos: 8Public gists: 0

gguf-packer-go

Deliver LLMs of GGUF format via Dockerfile.

created at: 2024-07-30

updated at: 2024-10-24

llama-box

LLM inference server implementation based on llama.cpp.

star: 34fork: 3

language: C++

created at: 2024-06-19

updated at: 2024-11-20

gguf-parser-go

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

star: 47fork: 4

created at: 2024-05-28

updated at: 2024-11-20

gpustack

Manage GPU clusters for running LLMs

star: 639fork: 51

language: Python

created at: 2024-05-11

updated at: 2024-11-19