commonllama benchmark · model

Granite 4.0 H Tiny

Every number on this page is an observed measurement from a benchmark run, shown with the run that produced it.

Pre-release: these numbers come from commonllama harness 0.0.0, a build not yet released. They are real measurements, not estimates; released-harness numbers will replace them.

Observed facts

What the harness read from the file.

Model file digest064bea0136420b38d0b65697fa5e772e28b112eee1757aacc7f64eba6bf37810
Architecturegranitehybrid
Quantizationq4_k_m
Max context1,048,576 tokens
Model file size3.94 GiB (4,230,975,936 bytes)
Fact provenanceunknown

Context capacity

How much context this model has carried.

Qualified to at least 131,072 tokens of context, an observed lower bound, not a maximum.

Observed on darwin-arm64-apple-accelerator metal. A frontier is a property of one run on one machine class, never a promise about another.

Saved context

What a saved context costs on disk.

Each curve keeps to one named key: this model, one backend. Unlike measurements are never folded together.

The KV cache is the AI’s memory of the conversation so far. Saving it to disk lets the AI return to the conversation and load that memory back in, rather than read everything from the start again.

Bytes per cached token, complete runs only
BackendContextBytes per tokenSaved bytes
cpu4,096unavailableunavailable
cpu8,192unavailableunavailable
cpu16,384unavailableunavailable
cpu32,768unavailableunavailable
cpu65,536unavailableunavailable
cpu131,072unavailableunavailable
cpu4,09675,936,752 / 4,096 (~18,539.2 bytes per token)72.4 MiB (75,936,752 bytes)
cpu8,19293,811,696 / 8,192 (~11,451.6 bytes per token)89.5 MiB (93,811,696 bytes)
cpu16,384129,561,584 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,561,584 bytes)
cpu32,768201,061,360 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,360 bytes)
cpu65,536344,060,912 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,060,912 bytes)
cpu131,072630,060,016 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,016 bytes)
cuda4,096unavailableunavailable
cuda4,096unavailableunavailable
cuda4,096unavailableunavailable
cuda4,096unavailableunavailable
cuda8,192unavailableunavailable
cuda8,192unavailableunavailable
cuda8,192unavailableunavailable
cuda8,192unavailableunavailable
cuda16,384unavailableunavailable
cuda16,384unavailableunavailable
cuda16,384unavailableunavailable
cuda16,384unavailableunavailable
cuda32,768unavailableunavailable
cuda32,768unavailableunavailable
cuda32,768unavailableunavailable
cuda32,768unavailableunavailable
cuda65,536unavailableunavailable
cuda65,536unavailableunavailable
cuda65,536unavailableunavailable
cuda65,536unavailableunavailable
cuda131,072unavailableunavailable
cuda131,072unavailableunavailable
cuda131,072unavailableunavailable
cuda131,072unavailableunavailable
cuda4,09675,936,752 / 4,096 (~18,539.2 bytes per token)72.4 MiB (75,936,752 bytes)
cuda4,096unavailableunavailable
cuda4,09675,936,752 / 4,096 (~18,539.2 bytes per token)72.4 MiB (75,936,752 bytes)
cuda4,096unavailableunavailable
cuda8,19293,811,696 / 8,192 (~11,451.6 bytes per token)89.5 MiB (93,811,696 bytes)
cuda8,192unavailableunavailable
cuda8,19293,811,696 / 8,192 (~11,451.6 bytes per token)89.5 MiB (93,811,696 bytes)
cuda8,192unavailableunavailable
cuda16,384129,561,584 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,561,584 bytes)
cuda16,384unavailableunavailable
cuda16,384129,561,584 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,561,584 bytes)
cuda16,384unavailableunavailable
cuda32,768201,061,360 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,360 bytes)
cuda32,768unavailableunavailable
cuda32,768201,061,360 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,360 bytes)
cuda32,768unavailableunavailable
cuda65,536344,060,912 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,060,912 bytes)
cuda65,536unavailableunavailable
cuda65,536344,060,912 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,060,912 bytes)
cuda65,536unavailableunavailable
cuda131,072630,060,016 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,016 bytes)
cuda131,072unavailableunavailable
cuda131,072630,060,016 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,016 bytes)
cuda131,072unavailableunavailable
metal4,096unavailableunavailable
metal4,096unavailableunavailable
metal4,096unavailableunavailable
metal8,192unavailableunavailable
metal8,192unavailableunavailable
metal8,192unavailableunavailable
metal16,384unavailableunavailable
metal16,384unavailableunavailable
metal16,384unavailableunavailable
metal32,768unavailableunavailable
metal32,768unavailableunavailable
metal32,768unavailableunavailable
metal65,536unavailableunavailable
metal65,536unavailableunavailable
metal65,536unavailableunavailable
metal131,072unavailableunavailable
metal131,072unavailableunavailable
metal131,072unavailableunavailable
metal4,09675,937,315 / 4,096 (~18,539.4 bytes per token)72.4 MiB (75,937,315 bytes)
metal4,09675,937,315 / 4,096 (~18,539.4 bytes per token)72.4 MiB (75,937,315 bytes)
metal4,09675,937,315 / 4,096 (~18,539.4 bytes per token)72.4 MiB (75,937,315 bytes)
metal8,19293,812,259 / 8,192 (~11,451.7 bytes per token)89.5 MiB (93,812,259 bytes)
metal8,19293,812,259 / 8,192 (~11,451.7 bytes per token)89.5 MiB (93,812,259 bytes)
metal8,19293,812,259 / 8,192 (~11,451.7 bytes per token)89.5 MiB (93,812,259 bytes)
metal16,384129,562,147 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,562,147 bytes)
metal16,384129,562,147 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,562,147 bytes)
metal16,384129,562,147 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,562,147 bytes)
metal32,768201,061,923 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,923 bytes)
metal32,768201,061,923 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,923 bytes)
metal32,768201,061,923 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,923 bytes)
metal65,536344,061,475 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,061,475 bytes)
metal65,536344,061,475 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,061,475 bytes)
metal65,536344,061,475 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,061,475 bytes)
metal131,072630,060,579 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,579 bytes)
metal131,072630,060,579 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,579 bytes)
metal131,072630,060,579 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,579 bytes)
vulkan4,096unavailableunavailable
vulkan4,096unavailableunavailable
vulkan4,096unavailableunavailable
vulkan4,096unavailableunavailable
vulkan8,192unavailableunavailable
vulkan8,192unavailableunavailable
vulkan8,192unavailableunavailable
vulkan8,192unavailableunavailable
vulkan16,384unavailableunavailable
vulkan16,384unavailableunavailable
vulkan16,384unavailableunavailable
vulkan16,384unavailableunavailable
vulkan32,768unavailableunavailable
vulkan32,768unavailableunavailable
vulkan32,768unavailableunavailable
vulkan32,768unavailableunavailable
vulkan65,536unavailableunavailable
vulkan65,536unavailableunavailable
vulkan65,536unavailableunavailable
vulkan65,536unavailableunavailable
vulkan131,072unavailableunavailable
vulkan131,072unavailableunavailable
vulkan131,072unavailableunavailable
vulkan131,072unavailableunavailable
vulkan4,09675,937,315 / 4,096 (~18,539.4 bytes per token)72.4 MiB (75,937,315 bytes)
vulkan4,096unavailableunavailable
vulkan4,09675,936,752 / 4,096 (~18,539.2 bytes per token)72.4 MiB (75,936,752 bytes)
vulkan4,096unavailableunavailable
vulkan8,19293,812,259 / 8,192 (~11,451.7 bytes per token)89.5 MiB (93,812,259 bytes)
vulkan8,192unavailableunavailable
vulkan8,19293,811,696 / 8,192 (~11,451.6 bytes per token)89.5 MiB (93,811,696 bytes)
vulkan8,192unavailableunavailable
vulkan16,384129,562,147 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,562,147 bytes)
vulkan16,384unavailableunavailable
vulkan16,384129,561,584 / 16,384 (~7,907.8 bytes per token)123.6 MiB (129,561,584 bytes)
vulkan16,384unavailableunavailable
vulkan32,768201,061,923 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,923 bytes)
vulkan32,768unavailableunavailable
vulkan32,768201,061,360 / 32,768 (~6,135.9 bytes per token)191.7 MiB (201,061,360 bytes)
vulkan32,768unavailableunavailable
vulkan65,536344,061,475 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,061,475 bytes)
vulkan65,536unavailableunavailable
vulkan65,536344,060,912 / 65,536 (~5,250.0 bytes per token)328.1 MiB (344,060,912 bytes)
vulkan65,536unavailableunavailable
vulkan131,072630,060,579 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,579 bytes)
vulkan131,072unavailableunavailable
vulkan131,072630,060,016 / 131,072 (~4,807.0 bytes per token)600.9 MiB (630,060,016 bytes)
vulkan131,072unavailableunavailable

Provenance

Every run behind the numbers.

Published runs
RunProvenanceStatusHardware classRAM bucketBackendStorageFrontier
967cf195f13ccommunitycompletedarwin-arm64-apple-accelerator16 to 31 GiBmetalother131,072+
351b00ef1aa6communitycompletewindows-x64-nvidia-accelerator32 to 63 GiBvulkanother131,072+
53194a4bd2c1communitycompletedarwin-arm64-apple-accelerator16 to 31 GiBmetalother131,072+
71290f56840bcommunitycompletedarwin-arm64-apple-accelerator16 to 31 GiBmetalother131,072+
3850ccf6d4e1migrationcompletegoldspier-x64-cudaunavailablevulkanresident-memory131,072+
58dfd141f342migrationcompletegoldspier-x64-vulkanunavailablevulkanresident-memory131,072+
674c59680555migrationcompletegoldspier-x64-cudaunavailablecudaresident-memory131,072+
6fbee9db97a8migrationcompletegoldspier-x64-cudaunavailablecudaresident-memory131,072+
a7053fabf3demigrationcompletegoldspier-x64-cudaunavailablecudaresident-memory131,072+
ae84204c6426migrationcompletegoldspier-x64-vulkanunavailablevulkanresident-memory131,072+
af402ed27975migrationcompletegoldspier-x64-cpuunavailablecpu · provisional at measurementresident-memory131,072+
fd000c6827dfmigrationcompletegoldspier-x64-cudaunavailablecudaresident-memory131,072+

A partial run is content, not a failure: its rungs carry typed reasons on the run page. Partial and complete runs are never mixed inside one aggregate on this page.

commonllama benchmark records are dedicated to the public domain under CC0 1.0. Use them for anything.