The  LGTM
  • Home
  • Agentic Coding
  • Claude Code
  • Codex
Sign in Subscribe

async-inference

A collection of 1 post
xAI’s Deferred Chat Completions Add the Missing Middle Between Wait on the Request and Batch It Overnight
xai

xAI’s Deferred Chat Completions Add the Missing Middle Between Wait on the Request and Batch It Overnight

xAI’s Deferred Chat Completions are the kind of API feature that looks minor until you have to build around the absence of it. Most AI platform diagrams pretend model calls come in two shapes: synchronous requests where the user waits, and batch jobs where nobody cares until tomorrow. Production
21 Jun 2026 6 min read
Page 1 of 1
The LGTM © 2026
  • Sign up
Powered by Ghost