Commit Graph

134 Commits

Author SHA1 Message Date
Dobromir Popov
377346c301 [verified] feat: complete Ralph task workstreams 2026-07-12 11:17:03 +03:00
Dobromir Popov
9a1b15c020 models on tracker 2026-07-12 02:44:12 +03:00
Dobromir Popov
95d79a0a16 quantizations 2026-07-12 01:33:51 +03:00
Dobromir Popov
f615b6befb fix tests 2026-07-11 22:47:12 +03:00
Dobromir Popov
7cf8d9bcf3 test descriptions 2026-07-11 22:25:30 +03:00
Dobromir Popov
7d259d7c9b test grouping 2026-07-11 22:11:21 +03:00
Dobromir Popov
c195b5ce78 fix dash test runner 2026-07-11 21:59:43 +03:00
Dobromir Popov
bd99c5177b dash test runner 2026-07-11 21:59:37 +03:00
Dobromir Popov
f99237b4e6 dashboard test runner . backend 2026-07-11 16:11:42 +03:00
Dobromir Popov
bb561a9665 tests on dash 2026-07-11 12:38:51 +03:00
Dobromir Popov
11bf460027 routing tests, launch.configs, redirect, stats and route statistics 2026-07-11 11:39:47 +03:00
Dobromir Popov
f54ea100fb issues, chat FPS; optimisations 2026-07-10 01:30:07 +03:00
Dobromir Popov
916f531e9d Merge branch 'master' of https://git.d-popov.com/popov/neuron-tai 2026-07-10 01:08:30 +03:00
Dobromir Popov
23dd0c3219 install jit on liunux fedora, TPS in chat 2026-07-10 01:08:26 +03:00
Dobromir Popov
d598896be9 more inference fixes 2026-07-09 23:44:58 +02:00
Dobromir Popov
e30272e83f dropp baes64 use binary 2026-07-09 22:40:43 +02:00
Dobromir Popov
3d264a500a inference fixes 2026-07-09 20:46:29 +02:00
Dobromir Popov
3abd4176d7 favicon 2026-07-09 12:16:12 +02:00
Dobromir Popov
1d3fb060ae relay working with qwen2.5;
relay anounced on node ready
2026-07-09 10:48:32 +02:00
Dobromir Popov
4c6e1ed8b6 different node IDs 2026-07-09 09:43:36 +02:00
Dobromir Popov
65ad8289b3 Merge branch 'master' of https://git.d-popov.com/popov/neuron-tai 2026-07-09 08:48:11 +02:00
Dobromir Popov
6ba8546c55 relay preparing for public internet 2026-07-09 08:01:22 +02:00
Dobromir Popov
5b1655fcca fix model selector loading 2026-07-09 08:28:32 +03:00
Dobromir Popov
9ec4ca9ce1 -cpu flag 2026-07-09 08:19:15 +03:00
Dobromir Popov
1d3d3018cd ROCm HW support 2026-07-09 01:07:53 +03:00
Dobromir Popov
08826f6ace Merge branch 'master' of https://git.d-popov.com/popov/neuron-tai 2026-07-09 00:06:01 +03:00
Dobromir Popov
5feb5b96f8 Merge branch 'master' of https://git.d-popov.com/popov/neuron-tai 2026-07-08 22:53:07 +02:00
Dobromir Popov
daddbaa4a3 distributd cache 2026-07-08 22:53:03 +02:00
Dobromir Popov
94046f1102 misc 2026-07-08 23:32:51 +03:00
Dobromir Popov
4a10eb6013 UI update changed 2026-07-08 22:58:11 +03:00
Dobromir Popov
1e44e8e578 node and account names 2026-07-08 21:33:42 +03:00
Dobromir Popov
52629d7762 hp 2026-07-08 21:19:20 +03:00
Dobromir Popov
aa7f4eb13b more chat UI 2026-07-08 20:51:42 +03:00
Dobromir Popov
42d6fe2b15 chat UI 2026-07-08 20:48:12 +03:00
Dobromir Popov
a224644247 Merge branch 'master' of https://git.d-popov.com/popov/neuron-tai 2026-07-08 20:00:56 +03:00
Dobromir Popov
91e4bcf2c9 connections 2026-07-08 19:49:52 +03:00
Dobromir Popov
e44abc910d routing 2026-07-08 18:48:50 +02:00
Dobromir Popov
29db25108f dash 2026-07-08 18:24:45 +02:00
Dobromir Popov
e06969fcb5 md rework. new code 2026-07-08 17:59:08 +02:00
Dobromir Popov
560de08edd Normalize line endings to LF via .gitattributes
Adds a committed .gitattributes so Windows and Linux checkouts converge
on LF for all text files, overriding each developer's local core.autocrlf.
Renormalizes existing blobs (server.py, dashboard.html, etc.) that had
CRLF baked in, clearing the repo-wide phantom "modified" churn.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-08 16:15:32 +02:00
Dobromir Popov
9c73db0ef2 Merge branch 'master' of https://git.d-popov.com/popov/neuron-tai
# Conflicts:
#	packages/tracker/meshnet_tracker/cli.py
#	packages/tracker/meshnet_tracker/dashboard.html
#	packages/tracker/meshnet_tracker/server.py
#	tests/test_dashboard.py
2026-07-08 16:14:24 +02:00
Dobromir Popov
3d82188dc1 wip -more responsive UI, better routing 2026-07-08 09:07:54 +02:00
Dobromir Popov
518c259cd3 routing improvements - dynamic (wip) 2026-07-07 21:25:28 +02:00
Dobromir Popov
f0dc3bd93f try to fix streaming responses 2026-07-07 22:19:22 +03:00
Dobromir Popov
a0b37ad1b9 store sessions in the DB 2026-07-07 22:13:12 +03:00
Dobromir Popov
dae0719a32 logging, routing 2026-07-07 22:00:54 +03:00
Dobromir Popov
e2b20883ca Stream chat responses in the dashboard with live progress and unified styles
Chat now sends stream=true and renders SSE tokens incrementally with live
tok/s status, a stop button (AbortController), and a blinking cursor; because
streamed requests emit tracker 'proxy progress' events, the Call wall now
shows in-flight requests with live TPS too. Chat colors route through :root
tokens instead of hardcoded hex values.

ADR-0020 documents the changes and the mixed-topology routing flaw: a partial
GPU head (0-21) + full CPU node (0-39) gets downstream start_layer=0 instead
of 22, corrupting activations into 1-token generations that were billed and
polluted throughput stats. Fix steps recorded, not yet implemented.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-07 19:48:43 +02:00
Dobromir Popov
471893c9d5 Skip multimodal/MTP checkpoint tensors absent from the text-only causal LM
Qwen3.5/3.6-MoE checkpoints ship vision (model.visual.*) and multi-token-
prediction (mtp.*) weights; the partial shard loader assigned them into the
text-only Qwen3_5MoeForCausalLM and crashed with AttributeError 'mtp'.
Filter selected tensors against the built model's state_dict keys, matching
transformers' _keys_to_ignore_on_load_unexpected behavior.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-07 19:16:19 +02:00
Dobromir Popov
cdd2699e63 try fix model loading quen3.6-35b 2026-07-07 18:36:29 +02:00
Dobromir Popov
aba5fb12fa Log node request processing so operators can see live activity in the console. 2026-07-07 18:12:57 +02:00