picollm
On-device LLM Inference Powered by X-Bit Quantization
compressionefficient-inferencegemmagenerative-ailanguage-modellanguage-modelslarge-language-modelllamallama2llama3llmllm-inferencellmsmistralmixtralmodel-compressionnatural-language-processingquantizationself-hosted
Github Data
Star 131
Fork 4
Subscriber 8
Language Python
Size 33.0K
owner
created at 2024-04-09
updated at 2024-07-23
pushed at 2024-07-22
