32 lines
1.4 KiB
Markdown
32 lines
1.4 KiB
Markdown
---
|
|
name: project-status
|
|
description: Current state of neuron-tai development as of 2026-07-01
|
|
metadata:
|
|
node_type: memory
|
|
type: project
|
|
originSessionId: 8fb120ee-7b8e-45be-98c0-b5ae9c64d1ec
|
|
---
|
|
|
|
# Project Status (2026-07-01)
|
|
|
|
29/30 user stories done. US-030 is the only open story, ready for ralph.
|
|
|
|
## US-030 — Manual route selection + hop-penalty benchmarking
|
|
- Status: open / ready
|
|
- Optional `"route": [node_id, ...]` in POST /v1/chat/completions body
|
|
- `POST /v1/benchmark/hop-penalty` — privileged (non-empty Authorization header), fans out to 1/2/3-node routes, records per-hop latency
|
|
- Results appended to `benchmark_results.json` in tracker working dir
|
|
- `GET /v1/benchmark/results` — also auth-gated
|
|
- Routing algorithm unchanged — data collection only
|
|
- Source: `.scratch/distributed-inference-network/issues/30-manual-route-and-hop-benchmark.md`
|
|
|
|
**Why:** Need real hop-latency data to eventually optimize route selection beyond synthetic benchmarks.
|
|
**How to apply:** When asked about next steps, US-030 is the one ready story.
|
|
|
|
## Windows CUDA node (working as of 2026-07-01)
|
|
- miniforge3 base env, torch 2.7.1+cu118, torchvision 0.22.x+cu118
|
|
- RTX 4060 Laptop GPU, 8 GB VRAM, benchmark index ~11,200
|
|
- Run: `meshnet-node start --tracker https://ai.neuron.d-popov.com --model Qwen/Qwen2.5-0.5B-Instruct`
|
|
- Known: tracker registration fails with `http://` — must use `https://`
|
|
- pynvml deprecation warning is harmless (use nvidia-ml-py to silence it)
|