1.5 KiB
1.5 KiB
DGR ROCm and llama.cpp setup
As of 2026-07-13:
- Project ROCm runtime:
/run/media/popov/d/DEV/repos/d-popov.com/AI/.venv-rocm - ROCm/TheRock build:
7.13.0a20260513, targetgfx1151 rocm-sdk-develis installed. Its expanded SDK lives under the venv atsite-packages/_rocm_sdk_devel.- The wheel's redundant packaged payload was relocated to
/home/popov/.local/share/rocm-sdk/7.13.0a20260513/rocm_sdk_develand symlinked back into the venv because installing both packaged and expanded forms filled the mounted drive. Do not reinstall it blindly; the wheel expands beyond 20 GB. - HIP llama.cpp source:
/run/media/popov/d/DEV/llamacpp/llama.cpp, commite920c523e3b8a0163fe498af5bf90df35ff51d25(version 9991). - HIP build:
/run/media/popov/d/DEV/llamacpp/llama.cpp/build-hip - HIP
llama-serverSHA-256:b6bb4da687dbde86e243ba006cef05919b7b97255cd7e2371e1d451220aca139 - Verified device:
ROCm0: Radeon 8060S Graphics,gfx1151. - Model artifacts remain under
/run/media/popov/DATA/llm; none were put under/home.
DGR-001's immutable contract remains CPU-only. GPU evidence uses the distinct
signed gpu-diagnostic profile because llama-server process VRAM is not yet
measurable by the benchmark driver. The profile must capture measured
llama-server startup evidence for ROCm0 and the actual offloaded/total layer
count; configured device and n_gpu_layers values alone are not evidence.
The accepted signer fingerprint is anchored in
.scratch/distributed-gguf-runtime/trusted-evidence-signers.json.