The  LGTM
  • Home
  • Agentic Coding
  • Claude Code
  • Codex
Sign in Subscribe

GGUF

A collection of 3 posts
llama.cpp Is Quietly Becoming the Local Agent Runtime, One API Compatibility Fix at a Time
ai-models

llama.cpp Is Quietly Becoming the Local Agent Runtime, One API Compatibility Fix at a Time

The most important local-AI releases increasingly look like schema chores. That sounds dismissive until an agent stack breaks because a JSON field is missing. llama.cpp release b9763 adds an item-level id field to llama-server Responses API function-call outputs. Six additions, three deletions, one changed file in the relevant PR.
22 Jun 2026 4 min read
Running Qwen Behind Claude Code Is the Local-Agent Wedge Alibaba Should Care About
qwen

Running Qwen Behind Claude Code Is the Local-Agent Wedge Alibaba Should Care About

The interesting part of the latest Qwen/Claude Code field guide is not that someone made a local model answer coding prompts. That stopped being novel somewhere around the third weekend everybody spent compiling llama.cpp. The useful part is more specific: a refreshed GitHub Gist shows what it actually
12 Jun 2026 6 min read
Unsloth’s Qwen3.6 MTP GGUFs Make Local Coding Agents Less Theoretical
qwen

Unsloth’s Qwen3.6 MTP GGUFs Make Local Coding Agents Less Theoretical

Unsloth’s new Qwen3.6-27B MTP GGUF release is not interesting because the internet needed another quantized model file. It is interesting because it documents the messy runtime details that decide whether local coding agents feel usable or collapse into a pile of parser errors, exhausted token budgets, and “works
13 May 2026 5 min read
Page 1 of 1
The LGTM © 2026
  • Sign up
Powered by Ghost