Blog

The noisy work goes to a smaller model

A lot of a coding session is not the edit. It is finding the file, listing a directory, summarizing a log, or drafting a bit of boilerplate. That work is real, and it is noisy. Toknary sends it to a smaller, faster model.

What counts as noisy

Exploration. Search. A summary of what a folder holds. Formatting. The first sketch of something ordinary. These can run as a helper beside the session, so the main colleague is not rereading the tree at the careful rate.

What stays in the session

The change you asked for stays with the everyday model. The helper reports back a short result. The session then writes. That is the optimization: the tokens that repeat are the cheap ones, and the tokens that decide the patch are not spent on the search.

How the writing is separated from the plan is in plan, then write.

All notes