NanoLLM
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
edge-aillm-inferencemultimodalragspeechvector-databasevision-transformer
Github Data
Star 197
Fork 31
Subscriber 8
Language Python
Size 3.8K
owner
created at 2024-03-31
updated at 2024-11-16
pushed at 2024-10-18
