Dobromir Popov 65dee3d6d1 feat: tracker-as-first-layer-node inference entry point (US-014)
Tracker: GET /v1/tracker-nodes/<model> returns head-shard nodes registered
with tracker_mode=true. tracker_mode stored per node in registry.

Node (stub + torch): head nodes (shard_start==0 or --tracker-mode flag)
expose /v1/chat/completions alongside /forward. Pipeline: tokenize →
embed → own layers → GET /v1/route (skip self) → binary forward through
remaining hops → decode → SSE back to client.

Gateway: proxies round-robin to tracker-nodes when found, falls back to
existing direct pipeline when none registered. All US-005 tests still pass.

CLI: --tracker-mode and --tracker-url flags on meshnet-node start.

Tests: 4 new integration tests — valid responses on 10 requests, both
tracker-nodes receive load, exact 5/5 round-robin split. 78 pass, 1 skipped.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-29 17:00:52 +03:00
2026-06-28 23:49:11 +03:00
2026-06-28 23:49:11 +03:00
2026-06-28 23:49:11 +03:00
2026-06-29 00:28:29 +03:00
2026-06-28 23:49:11 +03:00
2026-06-28 23:49:11 +03:00
Description
No description provided
640 MiB
Languages
Python 94.6%
HTML 5.1%
JavaScript 0.2%