{"name":"ModelFit Measured Local-LLM Speed Dataset","description":"Real tokens/sec measured on submitters' machines with Ollama, one board per catalog model, aggregated to per-machine medians. These are measurements from the wild, not estimates.","referenceModel":"qwen2.5:1.5b-instruct-q4_K_M","boardModel":"qwen3.8-27b-q4","promptId":"modelfit-bench-v2","source":"https://modelfit.io/bench/","license":"CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)","attribution":"ModelFit: https://modelfit.io/","methodology":"modelfit bench 1.7+ (promptId modelfit-bench-v2): Ollama API, a warm-up, then 3 fixed prompts of about 500 tokens, 256 generated tokens each, 4096 context, temperature 0; the server recomputes each run from the raw Ollama counters and keeps only runs under the model's memory-bandwidth ceiling on that machine (times one plus the draft tokens on a board with speculativeDecoding, where one pass over the weights can emit several tokens). Rows are medians per machine (chip + RAM + GPU bin, or GPU) and per decoding mode: machines[].decoding is \"speculative\" (the MLX build with its multi-token-prediction head, or a decode above the one-pass ceiling) or \"classic\", and a machine that ran a model both ways has one row of each; a board speculativeDecoding flag says the model has a speculative build. measuredFormat is the build the runs measured as Ollama reported it (quant, MLX runner, loaded size in GB), which can differ from the catalog quant of the board. n is the submission count. The reference model board also keeps single-prompt runs from CLI 1.5.2 to 1.6 (modelfit-bench-v1, decode only).","updated":"2026-11-17T07:14:47.472Z","count":9,"aggregates":[{"key":"Apple M5 Max","kind":"chip","model":"qwen2.5:1.5b-instruct-q4_K_M","n":3,"medianTokPerSec":251,"minTokPerSec":230.5,"maxTokPerSec":280,"lastAt":"2026-10-23T20:50:02.755Z"},{"key":"Apple M1 Pro","kind":"chip","model":"qwen2.5:1.5b-instruct-q4_K_M","n":3,"medianTokPerSec":65.9,"minTokPerSec":65.2,"maxTokPerSec":66.3,"lastAt":"2026-10-04T10:01:15.750Z"},{"key":"Apple M1","kind":"chip","model":"qwen2.5:1.5b-instruct-q4_K_M","n":2,"medianTokPerSec":51.1,"minTokPerSec":50.4,"maxTokPerSec":51.7,"lastAt":"2026-10-15T21:31:40.046Z"},{"key":"rtx-3090","kind":"gpu","model":"qwen2.5:1.5b-instruct-q4_K_M","n":1,"medianTokPerSec":306.4,"minTokPerSec":306.4,"maxTokPerSec":306.4,"lastAt":"2026-10-25T22:45:20.509Z"},{"key":"rtx-4070-ti","kind":"gpu","model":"qwen2.5:1.5b-instruct-q4_K_M","n":1,"medianTokPerSec":260.1,"minTokPerSec":260.1,"maxTokPerSec":260.1,"lastAt":"2026-10-24T23:11:21.303Z"},{"key":"Apple M4 Pro","kind":"chip","model":"qwen2.5:1.5b-instruct-q4_K_M","n":1,"medianTokPerSec":166.7,"minTokPerSec":166.7,"maxTokPerSec":166.7,"lastAt":"2026-10-05T16:26:39.199Z"},{"key":"rtx-3060","kind":"gpu","model":"qwen2.5:1.5b-instruct-q4_K_M","n":1,"medianTokPerSec":134.6,"minTokPerSec":134.6,"maxTokPerSec":134.6,"lastAt":"2026-10-06T05:25:42.260Z"},{"key":"Apple M1 Max","kind":"chip","model":"qwen2.5:1.5b-instruct-q4_K_M","n":1,"medianTokPerSec":115.6,"minTokPerSec":115.6,"maxTokPerSec":115.6,"lastAt":"2026-10-05T16:15:00.005Z"},{"key":"Apple M4","kind":"chip","model":"qwen2.5:1.5b-instruct-q4_K_M","n":1,"medianTokPerSec":71.3,"minTokPerSec":71.3,"maxTokPerSec":71.3,"lastAt":"2026-10-03T00:05:38.960Z"}],"boards":[{"modelId":"qwen3.8-27b-q4","name":"Qwen3.8 27B","tag":"qwen3.8:27b","quant":"Q4_K_M","speculativeDecoding":true,"runs":15,"machines":[{"id":"m-qwen3-8-27b-q4--rtx-5090","kind":"gpu","key":"rtx-5090","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":150,"medianPrefillTokPerSec":1924,"offloadRuns":0,"runners":[],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"Q4_K_M · 17.3 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":112,"lastAt":"2026-11-10T12:44:38.708Z"},{"id":"m-qwen3-8-27b-q4--apple-m5-ultra-96gb-64c","kind":"chip","key":"Apple M5 Ultra","ramGb":96,"gpuCores":64,"n":1,"medianTokPerSec":99.4,"medianPrefillTokPerSec":731.1,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":77,"lastAt":"2026-11-10T18:14:20.141Z"},{"id":"m-qwen3-8-27b-q4--apple-m5-max-128gb-40c","kind":"chip","key":"Apple M5 Max","ramGb":128,"gpuCores":40,"n":1,"medianTokPerSec":71.3,"medianPrefillTokPerSec":248.6,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":39,"lastAt":"2026-11-09T02:43:14.210Z"},{"id":"m-qwen3-8-27b-q4--apple-m5-max-64gb-40c","kind":"chip","key":"Apple M5 Max","ramGb":64,"gpuCores":40,"n":1,"medianTokPerSec":70.9,"medianPrefillTokPerSec":902.1,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":39,"lastAt":"2026-11-12T18:17:38.884Z"},{"id":"m-qwen3-8-27b-q4--apple-m4-max-64gb-40c","kind":"chip","key":"Apple M4 Max","ramGb":64,"gpuCores":40,"n":2,"medianTokPerSec":49.7,"medianPrefillTokPerSec":220.7,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":34,"lastAt":"2026-11-08T03:34:08.318Z"},{"id":"m-qwen3-8-27b-q4--apple-m2-ultra-128gb-60c","kind":"chip","key":"Apple M2 Ultra","ramGb":128,"gpuCores":60,"n":1,"medianTokPerSec":43,"medianPrefillTokPerSec":204.5,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":50,"lastAt":"2026-10-27T10:55:05.977Z"},{"id":"m-qwen3-8-27b-q4--apple-m5-pro-48gb-20c","kind":"chip","key":"Apple M5 Pro","ramGb":48,"gpuCores":20,"n":2,"medianTokPerSec":37.8,"medianPrefillTokPerSec":449.3,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":19,"lastAt":"2026-10-28T15:04:07.939Z"},{"id":"m-qwen3-8-27b-q4--apple-m4-pro-48gb-20c","kind":"chip","key":"Apple M4 Pro","ramGb":48,"gpuCores":20,"n":2,"medianTokPerSec":31.7,"medianPrefillTokPerSec":138.4,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":17,"lastAt":"2026-11-01T03:53:49.130Z"},{"id":"m-qwen3-8-27b-q4--apple-m2-max-64gb-30c","kind":"chip","key":"Apple M2 Max","ramGb":64,"gpuCores":30,"n":1,"medianTokPerSec":25.3,"medianPrefillTokPerSec":139.9,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":25,"lastAt":"2026-10-31T15:36:56.904Z"},{"id":"m-qwen3-8-27b-q4--apple-m1-max-64gb-24c","kind":"chip","key":"Apple M1 Max","ramGb":64,"gpuCores":24,"n":1,"medianTokPerSec":14.5,"medianPrefillTokPerSec":89.9,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":25,"lastAt":"2026-11-09T21:01:04.970Z"},{"id":"m-qwen3-8-27b-q4--apple-m5-max-36gb-32c-classic","kind":"chip","key":"Apple M5 Max","ramGb":36,"gpuCores":32,"n":1,"medianTokPerSec":13.1,"medianPrefillTokPerSec":202.1,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 17.3 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":29,"lastAt":"2026-11-01T08:34:40.149Z"},{"id":"m-qwen3-8-27b-q4--apple-m1-max-32gb-32c","kind":"chip","key":"Apple M1 Max","ramGb":32,"gpuCores":32,"n":1,"medianTokPerSec":11.7,"medianPrefillTokPerSec":70.8,"offloadRuns":0,"runners":["mlx"],"decoding":"speculative","speculativeDecoding":true,"measuredFormat":"nvfp4 MLX · 18.5 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":25,"lastAt":"2026-11-15T13:20:38.288Z"}]},{"modelId":"qwen3.5-9b-q4","name":"Qwen3.5 9B Instruct","tag":"qwen3.5:9b","quant":"Q4_K_M","speculativeDecoding":false,"runs":11,"machines":[{"id":"m-qwen3-5-9b-q4--apple-m3-ultra-96gb-60c","kind":"chip","key":"Apple M3 Ultra","ramGb":96,"gpuCores":60,"n":1,"medianTokPerSec":126.2,"medianPrefillTokPerSec":1107.3,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 7.7 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":166,"lastAt":"2026-11-10T15:09:32.674Z"},{"id":"m-qwen3-5-9b-q4--apple-m5-ultra-96gb-64c","kind":"chip","key":"Apple M5 Ultra","ramGb":96,"gpuCores":64,"n":1,"medianTokPerSec":125,"medianPrefillTokPerSec":3086.4,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.5 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":249,"lastAt":"2026-11-10T18:16:41.531Z"},{"id":"m-qwen3-5-9b-q4--rtx-4080","kind":"gpu","key":"rtx-4080","ramGb":null,"gpuCores":null,"n":2,"medianTokPerSec":92.5,"medianPrefillTokPerSec":4902.8,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.6 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":145,"lastAt":"2026-11-05T23:43:04.901Z"},{"id":"m-qwen3-5-9b-q4--rtx-4070","kind":"gpu","key":"rtx-4070","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":67.7,"medianPrefillTokPerSec":3412.2,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.6 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":102,"lastAt":"2026-10-28T21:22:53.144Z"},{"id":"m-qwen3-5-9b-q4--rtx-5060-ti","kind":"gpu","key":"rtx-5060-ti","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":67.1,"medianPrefillTokPerSec":2721.6,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.6 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":91,"lastAt":"2026-11-11T22:13:02.381Z"},{"id":"m-qwen3-5-9b-q4--rtx-4060-ti","kind":"gpu","key":"rtx-4060-ti","ramGb":null,"gpuCores":null,"n":2,"medianTokPerSec":34,"medianPrefillTokPerSec":1939.2,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.6 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":58,"lastAt":"2026-11-04T15:49:42.094Z"},{"id":"m-qwen3-5-9b-q4--apple-m2-pro-16gb-16c","kind":"chip","key":"Apple M2 Pro","ramGb":16,"gpuCores":16,"n":1,"medianTokPerSec":32.7,"medianPrefillTokPerSec":258.6,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 7.7 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":41,"lastAt":"2026-11-02T23:48:46.153Z"},{"id":"m-qwen3-5-9b-q4--apple-m1-pro-16gb-16c","kind":"chip","key":"Apple M1 Pro","ramGb":16,"gpuCores":16,"n":1,"medianTokPerSec":29.9,"medianPrefillTokPerSec":240.5,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 7.7 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":41,"lastAt":"2026-11-02T16:23:22.649Z"},{"id":"m-qwen3-5-9b-q4--apple-m2-16gb-10c","kind":"chip","key":"Apple M2","ramGb":16,"gpuCores":10,"n":1,"medianTokPerSec":4.9,"medianPrefillTokPerSec":50.1,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 7.7 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":20,"lastAt":"2026-11-09T02:13:53.704Z"}]},{"modelId":"qwen3.5-4b-q4","name":"Qwen3.5 4B Instruct","tag":"qwen3.5:4b","quant":"Q4_K_M","speculativeDecoding":false,"runs":12,"machines":[{"id":"m-qwen3-5-4b-q4--rtx-5080","kind":"gpu","key":"rtx-5080","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":163.8,"medianPrefillTokPerSec":8304.6,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 3.1 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":362,"lastAt":"2026-10-27T16:49:27.437Z"},{"id":"m-qwen3-5-4b-q4--rtx-5060-ti","kind":"gpu","key":"rtx-5060-ti","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":104.2,"medianPrefillTokPerSec":4144,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 3.1 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":169,"lastAt":"2026-11-11T22:21:04.603Z"},{"id":"m-qwen3-5-4b-q4--rtx-4070","kind":"gpu","key":"rtx-4070","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":101.4,"medianPrefillTokPerSec":3543.3,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 3.1 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":190,"lastAt":"2026-10-28T21:23:29.429Z"},{"id":"m-qwen3-5-4b-q4--rtx-3070","kind":"gpu","key":"rtx-3070","ramGb":null,"gpuCores":null,"n":2,"medianTokPerSec":96.8,"medianPrefillTokPerSec":2988.3,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 3.1 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":169,"lastAt":"2026-11-14T10:15:39.160Z"},{"id":"m-qwen3-5-4b-q4--rtx-5060","kind":"gpu","key":"rtx-5060","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":69.8,"medianPrefillTokPerSec":2476.9,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 3.1 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":169,"lastAt":"2026-11-01T13:18:41.314Z"},{"id":"m-qwen3-5-4b-q4--apple-m1-max-64gb-24c","kind":"chip","key":"Apple M1 Max","ramGb":64,"gpuCores":24,"n":1,"medianTokPerSec":52.1,"medianPrefillTokPerSec":550.4,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 4.1 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":151,"lastAt":"2026-11-09T21:06:55.121Z"},{"id":"m-qwen3-5-4b-q4--apple-m4-16gb-10c","kind":"chip","key":"Apple M4","ramGb":16,"gpuCores":10,"n":3,"medianTokPerSec":27.7,"medianPrefillTokPerSec":410,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 4.1 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":45,"lastAt":"2026-10-27T22:12:17.501Z"},{"id":"m-qwen3-5-4b-q4--apple-m2-16gb-10c","kind":"chip","key":"Apple M2","ramGb":16,"gpuCores":10,"n":1,"medianTokPerSec":23,"medianPrefillTokPerSec":229.2,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 4.1 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":38,"lastAt":"2026-11-09T02:09:28.397Z"},{"id":"m-qwen3-5-4b-q4--apple-m1-8gb-7c","kind":"chip","key":"Apple M1","ramGb":8,"gpuCores":7,"n":1,"medianTokPerSec":10.2,"medianPrefillTokPerSec":110.9,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 4.0 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":26,"lastAt":"2026-10-28T09:43:02.286Z"}]},{"modelId":"flint-40b","name":"Flint 40B-A2.5B","tag":"flint:40b","quant":"NVFP4","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-flint-40b--apple-m4-pro-48gb-20c","kind":"chip","key":"Apple M4 Pro","ramGb":48,"gpuCores":20,"n":1,"medianTokPerSec":100.1,"medianPrefillTokPerSec":942.8,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"int4 MLX · 22.6 GB","measuredQuant":"int4","contextLength":4096,"ceilingTokPerSec":212,"lastAt":"2026-11-07T18:39:51.967Z"}]},{"modelId":"qwen3.6-35b-a3b-q4","name":"Qwen3.6 35B-A3B","tag":"qwen3.6:35b-a3b","quant":"Q4_K_M","speculativeDecoding":false,"runs":5,"machines":[{"id":"m-qwen3-6-35b-a3b-q4--apple-m2-max-64gb-38c","kind":"chip","key":"Apple M2 Max","ramGb":64,"gpuCores":38,"n":1,"medianTokPerSec":101,"medianPrefillTokPerSec":888.7,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 23.2 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":273,"lastAt":"2026-11-04T20:34:40.199Z"},{"id":"m-qwen3-6-35b-a3b-q4--apple-m4-pro-48gb-20c","kind":"chip","key":"Apple M4 Pro","ramGb":48,"gpuCores":20,"n":4,"medianTokPerSec":80.5,"medianPrefillTokPerSec":771.2,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 22.0 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":187,"lastAt":"2026-11-04T17:40:32.149Z"}]},{"modelId":"nemotron-3.5-lightning-30b-q4","name":"Nemotron 3.5 Lightning 30B-A3B","tag":"nemotron-3.5-lightning:30b","quant":"Q4_K_M","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-nemotron-3-5-lightning-30b-q4--apple-m2-max-64gb-38c","kind":"chip","key":"Apple M2 Max","ramGb":64,"gpuCores":38,"n":1,"medianTokPerSec":96.4,"medianPrefillTokPerSec":828.8,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 19.2 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":154,"lastAt":"2026-11-04T20:55:58.963Z"}]},{"modelId":"gemma4-26b-a4b-q4","name":"Gemma 4 26B-A4B","tag":"gemma4:26b","quant":"Q4_K_M","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-gemma4-26b-a4b-q4--apple-m6-32gb-12c","kind":"chip","key":"Apple M6","ramGb":32,"gpuCores":12,"n":1,"medianTokPerSec":59.3,"medianPrefillTokPerSec":1027.8,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 0.7 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":76,"lastAt":"2026-10-29T03:34:21.915Z"}]},{"modelId":"ornith-9b-q4","name":"Ornith 1.0 9B","tag":"ornith:9b","quant":"Q4_K_M","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-ornith-9b-q4--rtx-4070","kind":"gpu","key":"rtx-4070","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":77.5,"medianPrefillTokPerSec":3318.7,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.3 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":102,"lastAt":"2026-11-11T09:39:02.315Z"}]},{"modelId":"lfm2.5-8b-a1b-q4","name":"LFM2.5 8B-A1B","tag":"lfm2.5:8b-a1b-q4_K_M","quant":"Q4_K_M","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-lfm2-5-8b-a1b-q4--apple-m2-16gb-10c","kind":"chip","key":"Apple M2","ramGb":16,"gpuCores":10,"n":1,"medianTokPerSec":58.2,"medianPrefillTokPerSec":568.5,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q4_K_M · 5.3 GB","measuredQuant":"Q4_K_M","contextLength":4096,"ceilingTokPerSec":103,"lastAt":"2026-11-09T02:21:38.805Z"}]},{"modelId":"gemma4-e4b-q8","name":"Gemma 4 E4B (Q8)","tag":"gemma4:e4b-it-q8_0","quant":"Q8_0","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-gemma4-e4b-q8--apple-m2-pro-16gb-16c","kind":"chip","key":"Apple M2 Pro","ramGb":16,"gpuCores":16,"n":1,"medianTokPerSec":26.5,"medianPrefillTokPerSec":304.2,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"Q8_0 · 5.3 GB","measuredQuant":"Q8_0","contextLength":4096,"ceilingTokPerSec":40,"lastAt":"2026-11-17T07:14:47.472Z"}]},{"modelId":"nemotron-3.5-bolt-e4b-q4","name":"NVIDIA Nemotron 3.5 Bolt E4B","tag":"nemotron-3.5-bolt:e4b","quant":"Q4_K_M","speculativeDecoding":false,"runs":1,"machines":[{"id":"m-nemotron-3-5-bolt-e4b-q4--apple-m2-16gb-10c","kind":"chip","key":"Apple M2","ramGb":16,"gpuCores":10,"n":1,"medianTokPerSec":23.6,"medianPrefillTokPerSec":264.8,"offloadRuns":0,"runners":["mlx"],"decoding":"classic","speculativeDecoding":false,"measuredFormat":"nvfp4 MLX · 7.2 GB","measuredQuant":"nvfp4","contextLength":4096,"ceilingTokPerSec":26,"lastAt":"2026-11-09T02:19:48.436Z"}]},{"modelId":"qwen2.5-1.5b-q4","name":"Qwen2.5 1.5B Instruct","tag":"qwen2.5:1.5b-instruct-q4_K_M","quant":"Q4_K_M","speculativeDecoding":false,"runs":14,"machines":[{"id":"m-qwen2-5-1-5b-q4--rtx-3090","kind":"gpu","key":"rtx-3090","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":306.4,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":949,"lastAt":"2026-10-25T22:45:20.509Z"},{"id":"m-qwen2-5-1-5b-q4--rtx-4070-ti","kind":"gpu","key":"rtx-4070-ti","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":260.1,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":511,"lastAt":"2026-10-24T23:11:21.303Z"},{"id":"m-qwen2-5-1-5b-q4--apple-m5-max-128gb","kind":"chip","key":"Apple M5 Max","ramGb":128,"gpuCores":null,"n":3,"medianTokPerSec":251,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":623,"lastAt":"2026-10-23T20:50:02.755Z"},{"id":"m-qwen2-5-1-5b-q4--apple-m4-pro-48gb","kind":"chip","key":"Apple M4 Pro","ramGb":48,"gpuCores":null,"n":1,"medianTokPerSec":166.7,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":277,"lastAt":"2026-10-05T16:26:39.199Z"},{"id":"m-qwen2-5-1-5b-q4--rtx-3060","kind":"gpu","key":"rtx-3060","ramGb":null,"gpuCores":null,"n":1,"medianTokPerSec":134.6,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":365,"lastAt":"2026-10-06T05:25:42.260Z"},{"id":"m-qwen2-5-1-5b-q4--apple-m1-max-64gb","kind":"chip","key":"Apple M1 Max","ramGb":64,"gpuCores":null,"n":1,"medianTokPerSec":115.6,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":406,"lastAt":"2026-10-05T16:15:00.005Z"},{"id":"m-qwen2-5-1-5b-q4--apple-m4-16gb","kind":"chip","key":"Apple M4","ramGb":16,"gpuCores":null,"n":1,"medianTokPerSec":71.3,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":122,"lastAt":"2026-10-03T00:05:38.960Z"},{"id":"m-qwen2-5-1-5b-q4--apple-m1-pro-32gb","kind":"chip","key":"Apple M1 Pro","ramGb":32,"gpuCores":null,"n":3,"medianTokPerSec":65.9,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":203,"lastAt":"2026-10-04T10:01:15.750Z"},{"id":"m-qwen2-5-1-5b-q4--apple-m1-8gb","kind":"chip","key":"Apple M1","ramGb":8,"gpuCores":null,"n":2,"medianTokPerSec":51.1,"medianPrefillTokPerSec":null,"offloadRuns":0,"runners":[],"decoding":"classic","speculativeDecoding":false,"measuredFormat":null,"measuredQuant":null,"contextLength":null,"ceilingTokPerSec":69,"lastAt":"2026-10-15T21:31:40.046Z"}]}]}