gguf-org/desktop-server

desktop server

support: 🐧linux/ubuntu, 🖥️ macOS (metal), 💻 windows (cpu/gpu)

• get it here

features

• 💫 super fast server 🐷
• 👁️ vision clip supported
• 🔨 tool sets supported (depends on model selected)

examples

• interact the desktop server with durian (see setup below)

• computer use agent (see here)
• agent with vision and tool use capabilities (see here)

• inspect a picture (see above - vision); vibe code a tic tac toe game (see below - tool)