Dobromir Popov
2a4383e353
feat: add binary activation wire format
2026-06-29 14:58:55 +03:00
Dobromir Popov
b02e07d308
docs: add ADRs and user stories for real model inference stack (US-011–014)
...
ADR-0008: binary activation wire format — raw bfloat16 over HTTP, zstd compression,
128-token chunked prefill; replaces base64 JSON (~33% overhead removed).
ADR-0009: coverage-first shard assignment and tracker-as-first-layer-node —
any node serving layers[0..k] becomes the inference entry point for that model;
bin-packing fills all coverage gaps before adding redundancy; tracker issues
LOAD_SHARD/DROP_SHARD rebalance directives; nodes declare VRAM + quantization.
US-011: binary wire format migration
US-012: real PyTorch layer execution (transformers + bitsandbytes, test on GPT-2)
US-013: coverage-first tracker bin-packing with VRAM-aware shard assignment
US-014: tracker-as-node (tracker node serves first layers + handles client requests)
CONTEXT.md: Tracker Node, Coverage Map, Rebalance Directive terms added.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-06-29 14:43:54 +03:00
Dobromir Popov
3286f77e27
feat: add meshnet python sdk
2026-06-29 10:29:19 +03:00
Dobromir Popov
e9c9bf63bc
feat: add p2p shard swarm
2026-06-29 10:15:01 +03:00
Dobromir Popov
792a9fd97f
feat: add probation and ban enforcement
2026-06-29 09:58:32 +03:00
Dobromir Popov
39f6f23c83
feat: add fraud detection validator
2026-06-29 09:46:22 +03:00
Dobromir Popov
e24c2e3cea
feat: add settlement contract boundary
2026-06-29 02:46:25 +03:00
Dobromir Popov
3b7ef2743d
feat: add OpenAI-compatible gateway
...
- GET /v1/health, GET /v1/models, POST /v1/chat/completions (streaming + non-streaming)
- OpenAI SDK, LangChain ChatOpenAI, and SSE streaming integration tests
- Tracker-backed GET /v1/models endpoint
- OpenAI-format errors for unavailable model (503) and pipeline failures
- Malformed JSON body handled with 400 instead of crash
- Test deps (openai, langchain-openai) declared in root pyproject dev extras
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-06-29 01:52:45 +03:00
Dobromir Popov
0199c99f6b
feat: add node startup flow
2026-06-29 01:30:12 +03:00
Dobromir Popov
15897d5c95
feat: add tracker registration routing
2026-06-29 01:16:48 +03:00
Dobromir Popov
7c8e85c571
feat: add two-node shard pipeline
2026-06-29 00:34:57 +03:00
Dobromir Popov
1141b51286
feat: scaffold meshnet monorepo
2026-06-29 00:28:29 +03:00
Dobromir Popov
84614a36a4
chore: add Ralph task tracker
2026-06-29 00:16:13 +03:00
