Awesome-LLM-Inference

vllm-project/

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

zilliztech/

deep-searcher

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Fosowl/

agenticSeek

Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity. 🔔 Official updates only via twitter @Martin993886460 (Beware of fake account)

1Panel-dev/

MaxKB

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

johnbean393/

Sidekick

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

gpustack/

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.