ModelTC

Model Infra

Github Data

Followers 171

Following 0

Links

AI Project

Public repos: 39Public gists: 0

llmc

[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

star: 322fork: 34

language: Python

created at: 2024-03-06

updated at: 2024-11-20

QLLM

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

star: 36fork: 3

language: Python

created at: 2024-02-21

updated at: 2024-11-18

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

star: 2.6Kfork: 206

language: Python

created at: 2023-07-22

updated at: 2024-11-20

awesome-lm-system

Summary of system papers/frameworks/codes/tools on training or serving large model

star: 56fork: 5

created at: 2023-06-21

updated at: 2024-08-05