Files
neuron-tai/.scratch/distributed-gguf-runtime/issues/15-add-and-certify-a-qwen3-qwen3-moe-adapter.md
2026-07-13 15:09:27 +03:00

3.3 KiB

15 — Add and certify a Qwen3/Qwen3-MoE adapter

Status: ready-for-agent

Mandatory fresh-session context

  • Read RALPH-CONTEXT.md completely before changing code.
  • This issue is DGR-015 in prd.json.
  • Read the evidence README for every dependency listed below.
  • Inspect current code and git status; historical text and previous agent claims are not evidence.

Description

As a client seeking top models, I need a separately certified MoE-capable architecture after the dense runtime proves stable.

Expected durable outputs

  • Qwen3-family architecture adapter
  • Architecture-specific parity/admission/performance results
  • evidence/DGR-015/README.md

Acceptance criteria

  • Implement explicit tensor ownership, router/top-k, expert/shared-expert, Q/K normalization, boundary bundle, and cache semantics for the selected Qwen3 family recipe.
  • Do not reuse the dense-Llama adapter through unchecked name substitutions.
  • Whole-model versus distributed prefill/decode parity passes the architecture-specific tolerance.
  • Expert memory ownership and communication are measured.
  • Real consumer-hardware acceptance and capability admission pass before the recipe becomes routable.
  • Targeted pytest tests pass
  • python -m compileall packages tests passes for Python changes
  • git diff --check passes
  • Default tests remain deterministic, model-download-free, API-credit-free, and GPU-free
  • Full deterministic pytest -q passes, or the exact pre-existing unrelated failure is recorded with a clean-tree reproduction
  • Pinned native C++ target builds and focused CTest/protocol tests pass where native code is touched
  • llama.cpp patch stack applies cleanly to the exact pinned commit where patch code is touched
  • Real-model execution is opt-in through MESHNET_ENABLE_REAL_INFERENCE_TESTS=1 and records exact artifact/runtime/hardware evidence
  • Model artifacts remain on the configured mounted-drive storage and never under /home
  • Read .scratch/distributed-gguf-runtime/RALPH-CONTEXT.md and this story issue completely before changing code
  • Read and verify every dependency evidence README before relying on dependency behavior
  • Preserve all pre-existing working-tree changes and stage only files belonging to this story
  • Write .scratch/distributed-gguf-runtime/evidence/DGR-015/README.md with files changed, exact commands and real results, limitations, compatibility notes, and dependent-story handoff
  • Update only this story issue to Status: done after every acceptance criterion and quality gate passes

Dependency handoff

  • DGR-014 must have passes: true; read ../evidence/DGR-014/README.md and verify its referenced files/commands.

Finish contract

  • Create the task evidence directory and durable handoff required above.
  • Preserve real failures and blockers; never fabricate benchmark, model, test or hardware output.
  • Change this issue to Status: done only after all criteria pass.
  • Emit <promise>COMPLETE</promise> only after the evidence handoff exists.

References