ai-models - The LGTM (Page 7)

The LGTM

Sign in Subscribe

ai-models

A collection of 177 posts

Gemma 4 QAT Is Google’s Local-AI Pitch With the Memory Bill Cut Down to Size

Gemma 4 QAT Is Google’s Local-AI Pitch With the Memory Bill Cut Down to Size

Local AI keeps getting marketed like a revolution and used like a science project. Google’s new Gemma 4 Quantization-Aware Training release is interesting because it attacks the least glamorous blocker: memory. Not “can a small model beat the cloud?” but “can a useful model fit where the user actually

NF-CoT Makes Chain-of-Thought Cheaper by Moving the Reasoning Into Continuous Space

NF-CoT Makes Chain-of-Thought Cheaper by Moving the Reasoning Into Continuous Space

Reasoning models have a billing problem disguised as a philosophy problem. We keep talking about chain-of-thought as if the central question is whether the model should “show its work.” For anyone running coding agents at scale, the more immediate question is uglier and more operational: why are we paying for