popov/neuron-tai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: harden GLM alpha resource and protocol gates

Browse Source
This commit is contained in:
Dobromir Popov
2026-07-13 22:48:26 +03:00
parent 5ebce15d7a
commit 9580ed643e
11 changed files with 86 additions and 48 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
.scratch/distributed-gguf-runtime/issues/06-implement-architecture-defined-boundary-input-output.md
View File

@@ -23,6 +23,8 @@ As a Shard, I need to consume and emit the correct transformer boundary state so
- [ ] Head accepts token IDs and owns token embedding.
- [ ] Middle/tail bypass token embedding and accept the named boundary bundle.
- [ ] Amend the decode fast path so `DecodeStep` carries a versioned `TensorBundle`, not one `NamedTensor`; retain a compact one-tensor encoding and fallback compatibility, regenerate Python/C++ schema code, and update protocol goldens.
- [ ] Define an explicit typed tail result for logits and/or sampled token output, with sampling parameters and chat-template/reasoning mode bound to exact request/recipe identity.
- [ ] Non-tail emits the unnormalized architecture-defined residual/boundary before final norm/head and before tail-only row pruning.
- [ ] Tail emits logits or token output through an explicit sampling contract.
- [ ] Dense-Llama whole-model versus two-range prefill and greedy-decode parity passes the documented tolerance.