bentoml/

BentoML

GitHub Website

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

8.7kstars

983forks

183issues

Apache-2.0license

2019since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

ray-project/

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

43k7.8kPython

langchain-ai/

langchain

The agent engineering platform.

142k24kPython

vllm-project/

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

86k19kPython

BerriAI/

litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

53k9.7kPython

rohitg00/

ai-engineering-from-scratch

Learn it. Build it. Ship it for others.

38k6.3kPython

langchain-ai/

langgraph

Build resilient agents.

37k6.2kPython

CompareBentoML vs ray BentoML vs langchain BentoML vs vllm

SharePost on X LinkedIn