Tiiny-AI/

PowerInfer

High-speed Large Language Model Serving for Local Deployment

9.6kstars

587forks

129issues

MITlicense

2023since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

hiyouga/

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

73k8.9kPython

ray-project/

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

43k7.8kPython

ollama/

Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

176k17kGo

rasbt/

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

99k15kJupyter Notebook

vllm-project/

A high-throughput and memory-efficient inference and serving engine for LLMs

86k19kPython

mlabonne/

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

81k9.4k