1.4 KiB
1.4 KiB
name, description, metadata
| name | description | metadata | ||||||
|---|---|---|---|---|---|---|---|---|
| project-status | Current state of neuron-tai development as of 2026-07-01 |
|
Project Status (2026-07-01)
29/30 user stories done. US-030 is the only open story, ready for ralph.
US-030 — Manual route selection + hop-penalty benchmarking
- Status: open / ready
- Optional
"route": [node_id, ...]in POST /v1/chat/completions body POST /v1/benchmark/hop-penalty— privileged (non-empty Authorization header), fans out to 1/2/3-node routes, records per-hop latency- Results appended to
benchmark_results.jsonin tracker working dir GET /v1/benchmark/results— also auth-gated- Routing algorithm unchanged — data collection only
- Source:
.scratch/distributed-inference-network/issues/30-manual-route-and-hop-benchmark.md
Why: Need real hop-latency data to eventually optimize route selection beyond synthetic benchmarks. How to apply: When asked about next steps, US-030 is the one ready story.
Windows CUDA node (working as of 2026-07-01)
- miniforge3 base env, torch 2.7.1+cu118, torchvision 0.22.x+cu118
- RTX 4060 Laptop GPU, 8 GB VRAM, benchmark index ~11,200
- Run:
meshnet-node start --tracker https://ai.neuron.d-popov.com --model Qwen/Qwen2.5-0.5B-Instruct - Known: tracker registration fails with
http://— must usehttps:// - pynvml deprecation warning is harmless (use nvidia-ml-py to silence it)