Files
neuron-tai/.claude/memory/dgr-rocm-setup.md
2026-07-13 21:24:43 +03:00

1.5 KiB

DGR ROCm and llama.cpp setup

As of 2026-07-13:

  • Project ROCm runtime: /run/media/popov/d/DEV/repos/d-popov.com/AI/.venv-rocm
  • ROCm/TheRock build: 7.13.0a20260513, target gfx1151
  • rocm-sdk-devel is installed. Its expanded SDK lives under the venv at site-packages/_rocm_sdk_devel.
  • The wheel's redundant packaged payload was relocated to /home/popov/.local/share/rocm-sdk/7.13.0a20260513/rocm_sdk_devel and symlinked back into the venv because installing both packaged and expanded forms filled the mounted drive. Do not reinstall it blindly; the wheel expands beyond 20 GB.
  • HIP llama.cpp source: /run/media/popov/d/DEV/llamacpp/llama.cpp, commit e920c523e3b8a0163fe498af5bf90df35ff51d25 (version 9991).
  • HIP build: /run/media/popov/d/DEV/llamacpp/llama.cpp/build-hip
  • HIP llama-server SHA-256: b6bb4da687dbde86e243ba006cef05919b7b97255cd7e2371e1d451220aca139
  • Verified device: ROCm0: Radeon 8060S Graphics, gfx1151.
  • Model artifacts remain under /run/media/popov/DATA/llm; none were put under /home.

DGR-001's immutable contract remains CPU-only. GPU evidence uses the distinct signed gpu-diagnostic profile because llama-server process VRAM is not yet measurable by the benchmark driver. The profile must capture measured llama-server startup evidence for ROCm0 and the actual offloaded/total layer count; configured device and n_gpu_layers values alone are not evidence. The accepted signer fingerprint is anchored in .scratch/distributed-gguf-runtime/trusted-evidence-signers.json.