A lab notebook

Local LLM hosting, measured.

Adam Greene writes down what his own machines do when they run a model: tokens per second, watts at the wall, and what the parts cost on the day he checked. If a figure did not come from a run or a dated price pull, the page says PLACEHOLDER.

Measured18 measured runs in the table.

The rules

  • Measured tok/s

    Generation speed and prompt speed, with the model, the quant, the context, and the software version. An empty cell stays empty until a run fills it.

  • Dated prices

    A price names the day it was pulled and the source. Sold listings and asking prices do not share a cell. Nothing here is a live quote.

  • Don’t buy this if

    Every build says when it is the wrong machine. That note is part of the page, next to the parts, not a disclaimer in the footer.

The full version is the methodology. Build-page prices are still unpulled. The first measured speeds are in the benchmark table.

Builds by objective

All builds

Six jobs a homelab box might be for. Prices on those pages are still placeholders. Frankenstein’s first measured speeds are in the benchmark table.

Benchmarks

Full table

Frankenstein, 2026-11-18. Two Xeon E5-2697 v2 (24 cores / 48 threads), 288 GB DDR3 RDIMM at 1067 MT/s, Tesla P40 24 GB, Ollama 0.35.0. All rows are Q4_K_M. Generation tok/s is the median of three runs (128 tokens, temperature 0, seed 42, think off). Prompt tok/s is the first uncached prefill. n/a means that pass was already cached. Cached repeats are not listed.

Rows from the benchmark file. Open the full table for every column.
MachineModelGen tok/sDate
Frankenstein qwen3:4b-instruct-2507-q4_K_M12.36Nov 18, 2026
Frankenstein qwen3:4b-instruct-2507-q4_K_M6.62Nov 18, 2026
Frankenstein qwen3:8b6.91Nov 18, 2026
Frankenstein qwen3:8b4.66Nov 18, 2026
Frankenstein qwen3:14b4.41Nov 18, 2026
Frankenstein qwen3:14b3.02Nov 18, 2026
Frankenstein qwen3:14b4.24Nov 18, 2026
Frankenstein qwen3:14b1.33Nov 18, 2026
Frankenstein frank-qwen3-30b-64k9.58Nov 18, 2026
Frankenstein frank-qwen3-30b-64k8.73Nov 18, 2026
Frankenstein qwen3:4b-instruct-2507-q4_K_M69.57Nov 18, 2026
Frankenstein qwen3:4b-instruct-2507-q4_K_M60.03Nov 18, 2026
Frankenstein qwen3:8b44.18Nov 18, 2026
Frankenstein qwen3:8b40.22Nov 18, 2026
Frankenstein qwen3:14b25.42Nov 18, 2026
Frankenstein qwen3:14b21.85Nov 18, 2026
Frankenstein frank-qwen3-30b-64k65.29Nov 18, 2026
Frankenstein frank-qwen3-30b-64k57.64Nov 18, 2026

What the model cards actually say, plus computed memory at Q4_K_M and Q8. Speeds stay “not yet measured” unless a Frankenstein row exists. What can my rig run? ranks that list against a machine you type in. The ranking stays in the browser.

Notebook

All notes