Blog
Writing
Life, tech, and everything in-between.
Thin SDK, Fat Runtime: Owning the Agent Loop in Pure Python
15 minAI
A provider's SDK earns its keep on six concerns: auth, request shape, transport, retries, streaming reassembly, and response parsing. Everything above that, the agent loop, planning, routing, memory, parallelism, guardrails, and workflow state, is application architecture and is better written in pure Python.
Workflows Versus Agents in LLM Systems
7 minAI
The term agent has become overloaded, and the overloading is expensive. A system in which the language model controls its own flow costs more to run and more to debug. The default should be a workflow.