Dobromir Popov e2b20883ca Stream chat responses in the dashboard with live progress and unified styles
Chat now sends stream=true and renders SSE tokens incrementally with live
tok/s status, a stop button (AbortController), and a blinking cursor; because
streamed requests emit tracker 'proxy progress' events, the Call wall now
shows in-flight requests with live TPS too. Chat colors route through :root
tokens instead of hardcoded hex values.

ADR-0020 documents the changes and the mixed-topology routing flaw: a partial
GPU head (0-21) + full CPU node (0-39) gets downstream start_layer=0 instead
of 22, corrupting activations into 1-token generations that were billed and
polluted throughput stats. Fix steps recorded, not yet implemented.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-07 19:48:43 +02:00
2026-06-28 23:49:11 +03:00
2026-07-07 16:06:05 +02:00
2026-07-07 15:56:38 +03:00
2026-07-02 22:03:37 +03:00
2026-07-03 00:55:06 +02:00
env
2026-07-06 18:47:21 +03:00
2026-07-07 20:16:39 +03:00
2026-07-01 14:40:42 +02:00
2026-07-07 15:27:33 +03:00
2026-06-28 23:49:11 +03:00
Description
No description provided
12 MiB
Languages
Python 94.7%
HTML 5%
JavaScript 0.2%