Recipe benchmark dgr-001-controlled-whole-model-baseline-v1 (local-real)
model Qwen/Qwen2.5-0.5B-Instruct@7ae557604adf67be50417f59c2c2f167def9a775
transformers-safetensors-reference     [quality         ] c= 1 ttft p50/p95     37.5/   193.5 ms; prefill   671.8 tok/s; decode   46.1 tok/s; aggregate    40.3 tok/s; rss  1.94 GB; vram  0.00 GB; artifact  1.00 GB; failures 0
transformers-safetensors-reference     [quality         ] c= 4 ttft p50/p95     94.4/   444.7 ms; prefill   247.6 tok/s; decode   13.1 tok/s; aggregate    47.1 tok/s; rss  2.18 GB; vram  0.00 GB; artifact  1.00 GB; failures 0
llama-cpp-near-lossless-quality        [quality         ] c= 1 ttft p50/p95     43.9/   107.0 ms; prefill  1427.2 tok/s; decode   88.0 tok/s; aggregate    73.8 tok/s; rss  1.11 GB; vram  0.00 GB; artifact  0.99 GB; failures 0
llama-cpp-near-lossless-quality        [quality         ] c= 4 ttft p50/p95     33.6/   128.5 ms; prefill  1077.8 tok/s; decode   73.9 tok/s; aggregate   211.4 tok/s; rss  1.13 GB; vram  0.00 GB; artifact  0.99 GB; failures 0
llama-cpp-quantized-performance-fit    [performance-fit ] c= 1 ttft p50/p95     23.8/   237.7 ms; prefill   783.4 tok/s; decode  170.1 tok/s; aggregate   110.0 tok/s; rss  0.54 GB; vram  0.00 GB; artifact  0.40 GB; failures 0
llama-cpp-quantized-performance-fit    [performance-fit ] c= 4 ttft p50/p95     67.9/   431.8 ms; prefill   474.3 tok/s; decode   83.5 tok/s; aggregate   206.4 tok/s; rss  0.57 GB; vram  0.00 GB; artifact  0.40 GB; failures 0
drift llama-cpp-near-lossless-quality  vs transformers-safetensors-reference exact 0.33; similarity 0.947 (gated)
drift llama-cpp-quantized-performance-fit vs transformers-safetensors-reference exact 0.00; similarity 0.456 (advisory)