jmaczan/

tiny-vllm

GitHub

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

911stars

61forks

1issues

Apache-2.0license

2026since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

vllm-project/

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

86k19kPython

mlabonne/

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

81k9.4k

nomic-ai/

gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

77k8.3kC++

ray-project/

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

43k7.8kPython

rohitg00/

ai-engineering-from-scratch

Learn it. Build it. Ship it for others.

38k6.3kPython

affaan-m/

ECC

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

229k35kJavaScript

Comparetiny-vllm vs vllm tiny-vllm vs llm-course tiny-vllm vs gpt4all

SharePost on X LinkedIn