bentoml

The easiest way to build fast and reliable AI serving systems

San Francisco

Github Data

Followers 954

Following 0

Links

https://x.com/bentomlai https://bentoml.com

AI Project

Public repos: 101Public gists: 0

BentoVLLM

Self-host LLMs with vLLM and BentoML

star: 74fork: 12

language: Python

created at: 2024-01-17

updated at: 2024-11-18

OpenLLM

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

star: 10.1Kfork: 639

language: Python

created at: 2023-04-19

updated at: 2024-11-20

stable-diffusion-server

Deploy Your Own Stable Diffusion Service

star: 198fork: 25

language: Python

created at: 2022-09-16

updated at: 2024-11-11

BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

star: 7.2Kfork: 792

language: Python

created at: 2019-04-02

updated at: 2024-11-20