b4rtaz/

distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

3.0kstars

238forks

48issues

MITlicense

2023since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

ollama/

Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

176k17kGo

unslothai/

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

68k6.1kPython

open-webui/

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

145k21kPython

nomic-ai/

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

77k8.3kC++

hiyouga/

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

73k8.9kPython

ray-project/

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

43k7.8kPython