Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
llmllm-inference
Github Data
Star 2.0K
Fork 129
Subscriber 34
Language Jupyter Notebook
Size 5.0K
owner
created at 2023-09-10
updated at 2024-08-10
pushed at 2024-06-25
