feat: complete route session baseline benchmark
This commit is contained in:
@@ -1,4 +1,4 @@
|
||||
Status: ready-for-agent
|
||||
Status: done (2026-07-14)
|
||||
|
||||
# 01 — Baseline and profiling harness
|
||||
|
||||
@@ -12,16 +12,15 @@ sizes and connection counts without requiring a real model or external host.
|
||||
|
||||
## Acceptance criteria
|
||||
|
||||
- [ ] The harness runs a fixed prompt and fixed generated-token count through a
|
||||
- [x] The harness runs a fixed prompt and fixed generated-token count through a
|
||||
two-node route in direct and relay modes.
|
||||
- [ ] It reports p50/p95 per-token latency, per-hop latency, payload bytes,
|
||||
- [x] It reports p50/p95 per-token latency, per-hop latency, payload bytes,
|
||||
compression ratio, connection attempts, and queue wait.
|
||||
- [ ] It distinguishes prefill from decode and cached from stateless mode.
|
||||
- [ ] It emits machine-readable JSON suitable for CI artifacts and a concise
|
||||
- [x] It distinguishes prefill from decode and cached from stateless mode.
|
||||
- [x] It emits machine-readable JSON suitable for CI artifacts and a concise
|
||||
human-readable summary.
|
||||
- [ ] A test fixture can assert connection attempts and output token identity.
|
||||
- [x] A test fixture can assert connection attempts and output token identity.
|
||||
|
||||
## Blocked by
|
||||
|
||||
None - can start immediately.
|
||||
|
||||
None - completed. Verified with `PYTHONPATH=packages/node pytest -q tests/test_route_session_benchmark.py` (7 passed).
|
||||
|
||||
Reference in New Issue
Block a user