intel

[email protected]

Github Data

Followers 3754

Following 0

Links

AI Project

Public repos: 1219Public gists: 0

auto-round

Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

star: 248fork: 20

language: Python

created at: 2024-01-04

updated at: 2024-11-19

llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray

star: 103fork: 30

language: Python

created at: 2023-11-13

updated at: 2024-11-13

xFasterTransformer

star: 380fork: 64

language: C++

created at: 2023-06-14

updated at: 2024-11-19

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

star: 2.1Kfork: 211

language: Python

created at: 2022-11-11

updated at: 2024-11-19

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

star: 2.2Kfork: 257

language: Python

created at: 2020-07-21

updated at: 2024-11-20

lms

star: 33fork: 10

language: C++

created at: 2019-04-09

updated at: 2024-10-02

lmbench

star: 283fork: 124

created at: 2018-07-31

updated at: 2024-11-20