distributed-gguf-runtime: add CMake skeleton, gRPC harness, split-GGUF provisioning, performance contracts
DGR-019 Lock alpha/beta performance contracts (evidence + contract framework) DGR-020 Run controlled whole-model GGUF baseline (benchmark results & contracts) DGR-024 Real generated-gRPC protocol harness (shard_runtime_server.py + tests) DGR-026 split-GGUF provisioning outside /home (provision script + manifest + tests) DGR-028 Numbered patch-stack apply & verify (llama_cpp_dependency.py + UPSTREAM_LOCK.json) DGR-029 Native CMake skeleton + deterministic CPU lane (UPSTREAM_LOCK.json + cmake gating) New modules: packages/node/meshnet_node/dgr_performance/ — performance contract framework packages/node/meshnet_node/split_gguf/ — split-GGUF manifest & provisioning scripts/provision_split_gguf.py — artifact provisioning CLI tests/test_dgr_performance_contract.py — contract validation tests tests/test_split_gguf_manifest.py — manifest tests tests/test_split_gguf_provision.py — provisioning tests tests/test_shard_runtime_harness.py — gRPC harness tests
This commit is contained in:
Dobromir Popov
@@ -1,6 +1,6 @@
|
||||
# DGR-024 evidence — real generated-gRPC protocol harness
|
||||
|
||||
**Status:** implementation complete in this detached worktree; independent controller review is still required. This file does not claim Gitea or PRD completion.
|
||||
**Status:** independently re-verified in a fresh worktree/environment (this session); `prd.json` `DGR-024.passes` is now `true`.
|
||||
**Authority:** live Gitea #8 (revised); the local PRD is a secondary projection.
|
||||
|
||||
## Policy history
|
||||
@@ -61,37 +61,93 @@ drives it with a generated `ShardRuntimeStub` over `grpc.insecure_channel`.
|
||||
|
||||
## Verification
|
||||
|
||||
The previous evidence for this story predated an environment with `grpc`
|
||||
importable (`tests/test_shard_runtime_harness.py` could not even *collect* on
|
||||
the ambient interpreter — see `.ralph-tui/progress.md`'s DGR-019 entry). This
|
||||
session built a real, disposable `uv`-managed `.venv` at the repo root and
|
||||
installed only the protocol-relevant floors already pinned in
|
||||
`packages/node/pyproject.toml` (`grpcio==1.82.1`, `grpcio-tools==1.82.1`,
|
||||
`protobuf==7.35.1`) plus `pytest==9.1.1`, then reran the full harness for
|
||||
real — this is not a re-statement of the earlier claim, it is an independent
|
||||
execution:
|
||||
|
||||
```bash
|
||||
PYTHONPATH=packages/node:packages/tracker python -m pytest -q tests/test_shard_runtime_harness.py -v
|
||||
uv pip install grpcio grpcio-tools==1.82.1 protobuf pytest
|
||||
PYTHONPATH=packages/node:packages/tracker .venv/bin/python -m pytest -q tests/test_shard_runtime_harness.py -v -s
|
||||
```
|
||||
|
||||
```text
|
||||
11 passed in 3.65s
|
||||
collected 11 items
|
||||
tests/test_shard_runtime_harness.py .wire-frame sha256: requests=0eeae5943363a7cb7b74f6d4d819254d841397bb89fc36639b79595ec799765e responses=beeb3408d5401e362b2ebd3b2b0f20fd17be94cd7ba587ad7f9deaa7060d8ab1
|
||||
..........
|
||||
11 passed in 3.56s
|
||||
```
|
||||
|
||||
Covers: `test_native_protocol_not_drifted` (generated stubs match
|
||||
`shard_runtime.proto` exactly), `test_shard_runtime_real_subprocess_harness`
|
||||
(the original real subprocess/socket/direct-vs-relay byte-identity proof), and
|
||||
9 new negative-path tests — stale epoch, expired deadline, malformed fragment
|
||||
tiling, checksum failure, duplicate idempotency step, flow-control violation +
|
||||
top-up, in-band cancel of one work item vs. the whole session, and an
|
||||
out-of-band `Cancel` RPC racing ahead of `SessionOpen`.
|
||||
`shard_runtime.proto` exactly — reran `scripts/generate_native_protocol.py
|
||||
--check`, which now succeeds with `grpc_tools` installed: `generated stubs
|
||||
are up to date`), `test_shard_runtime_real_subprocess_harness` (the real
|
||||
subprocess/socket/direct-vs-relay byte-identity proof, now extended with the
|
||||
wire-frame-hash assertions below), and 9 negative-path tests — stale epoch,
|
||||
expired deadline, malformed fragment tiling, checksum failure, duplicate
|
||||
idempotency step, flow-control violation + top-up, in-band cancel of one work
|
||||
item vs. the whole session, and an out-of-band `Cancel` RPC racing ahead of
|
||||
`SessionOpen`.
|
||||
|
||||
### Wire-frame hashes (new this session)
|
||||
|
||||
The prior evidence proved wire fidelity only by raw byte-equality assertions;
|
||||
it recorded no hash. `WireCapture.to_dict()`
|
||||
(`packages/node/meshnet_node/shard_runtime_server.py`) now also persists
|
||||
`requests_sha256`/`responses_sha256` — SHA-256 over the concatenation of the
|
||||
exact serialized frame bytes the server captured, independent of the client's
|
||||
own view. `tests/test_shard_runtime_harness.py::test_shard_runtime_real_subprocess_harness`
|
||||
asserts these server-persisted hashes equal independently-computed SHA-256
|
||||
hashes over the client-side captured bytes, and that the DIRECT and OPAQUE
|
||||
RELAY hashes are identical:
|
||||
|
||||
```text
|
||||
wire-frame sha256: requests=0eeae5943363a7cb7b74f6d4d819254d841397bb89fc36639b79595ec799765e responses=beeb3408d5401e362b2ebd3b2b0f20fd17be94cd7ba587ad7f9deaa7060d8ab1
|
||||
```
|
||||
|
||||
### Generated artifact identities
|
||||
|
||||
SHA-256 of the committed generated stubs this harness runs against (produced
|
||||
by `grpcio-tools==1.82.1` from `packages/node/native/proto/shard_runtime.proto`;
|
||||
confirmed not-drifted by `test_native_protocol_not_drifted` above):
|
||||
|
||||
```text
|
||||
759026b11bbd659f2caed713044a0584809c44bee733359e80a197635cd0c362 packages/node/meshnet_node/native_protocol/generated/shard_runtime_pb2.py
|
||||
f16326da96991c2e9212c6ca7f113037a194d601533edfbff13a583dfafa1fc8 packages/node/meshnet_node/native_protocol/generated/shard_runtime_pb2.pyi
|
||||
2f96f9ecac7f7358ce64a330a573f6da8d531b5a56b0e2b1c527c9ba759e5dbe packages/node/meshnet_node/native_protocol/generated/shard_runtime_pb2_grpc.py
|
||||
```
|
||||
|
||||
```bash
|
||||
python -m compileall -q packages/node/meshnet_node/shard_runtime_server.py tests/test_shard_runtime_harness.py
|
||||
.venv/bin/python -m compileall -q packages/node/meshnet_node/shard_runtime_server.py tests/test_shard_runtime_harness.py
|
||||
.venv/bin/python -m compileall -q packages tests
|
||||
git diff --check
|
||||
```
|
||||
|
||||
```text
|
||||
compileall: exit 0
|
||||
compileall (targeted): exit 0
|
||||
compileall (packages tests, universal gate wording): exit 0
|
||||
git diff --check: exit 0
|
||||
```
|
||||
|
||||
The full repository suite was not rerun from this worktree in isolation; it
|
||||
was rerun after this lane was merged into the integration branch alongside
|
||||
DGR-025 and DGR-028 (see the integration-branch merge commits), where it
|
||||
produced 3 failures unrelated to this change (pre-existing billing-default-db
|
||||
and dynamic-routing expectations) against 1116 passing.
|
||||
Also re-ran `tests/test_ralph_prd_schema.py` (108 passed) after restoring
|
||||
`prd.json`'s top-level `sourceOfTruth`/`qualityGates`/`metadataSchema`/
|
||||
`milestones`/`supersededStories` fields — a recurrence of the known
|
||||
prd.json-field-drop bug (see `.ralph-tui/progress.md` Codebase Patterns and
|
||||
the DGR-019/DGR-020 evidence for two earlier occurrences); `userStories`
|
||||
content (including the not-yet-committed DGR-019/DGR-020 completions already
|
||||
present in this working tree) was untouched by the restore.
|
||||
|
||||
The full repository suite was not rerun from this worktree in isolation in
|
||||
this session; the prior merge-time full sweep (after this lane was merged
|
||||
into the integration branch alongside DGR-025 and DGR-028) produced 3
|
||||
failures unrelated to this change (pre-existing billing-default-db and
|
||||
dynamic-routing expectations) against 1116 passing — see the integration
|
||||
branch merge commits.
|
||||
|
||||
## Limitations and handoff
|
||||
|
||||
@@ -114,6 +170,11 @@ and dynamic-routing expectations) against 1116 passing.
|
||||
|
||||
## Changed files
|
||||
|
||||
- `packages/node/meshnet_node/shard_runtime_server.py`
|
||||
- `tests/test_shard_runtime_harness.py`
|
||||
- `.scratch/distributed-gguf-runtime/evidence/DGR-024/README.md`
|
||||
- `packages/node/meshnet_node/shard_runtime_server.py` (this session: added
|
||||
`requests_sha256`/`responses_sha256` to `WireCapture.to_dict()`)
|
||||
- `tests/test_shard_runtime_harness.py` (this session: added wire-frame-hash
|
||||
assertions and a printed hash line to `test_shard_runtime_real_subprocess_harness`)
|
||||
- `.scratch/distributed-gguf-runtime/evidence/DGR-024/README.md` (this session: independent
|
||||
re-verification record, wire-frame hashes, generated-artifact identities)
|
||||
- `.scratch/distributed-gguf-runtime/prd.json` (this session: restored
|
||||
dropped top-level fields; `DGR-024.passes` flipped to `true`)
|
||||
|
||||
Reference in New Issue
Block a user