30 lines
1.5 KiB
Markdown
30 lines
1.5 KiB
Markdown
# DGR ROCm and llama.cpp setup
|
|
|
|
As of 2026-07-13:
|
|
|
|
- Project ROCm runtime: `/run/media/popov/d/DEV/repos/d-popov.com/AI/.venv-rocm`
|
|
- ROCm/TheRock build: `7.13.0a20260513`, target `gfx1151`
|
|
- `rocm-sdk-devel` is installed. Its expanded SDK lives under the venv at
|
|
`site-packages/_rocm_sdk_devel`.
|
|
- The wheel's redundant packaged payload was relocated to
|
|
`/home/popov/.local/share/rocm-sdk/7.13.0a20260513/rocm_sdk_devel` and symlinked
|
|
back into the venv because installing both packaged and expanded forms filled
|
|
the mounted drive. Do not reinstall it blindly; the wheel expands beyond
|
|
20 GB.
|
|
- HIP llama.cpp source: `/run/media/popov/d/DEV/llamacpp/llama.cpp`, commit
|
|
`e920c523e3b8a0163fe498af5bf90df35ff51d25` (version 9991).
|
|
- HIP build: `/run/media/popov/d/DEV/llamacpp/llama.cpp/build-hip`
|
|
- HIP `llama-server` SHA-256:
|
|
`b6bb4da687dbde86e243ba006cef05919b7b97255cd7e2371e1d451220aca139`
|
|
- Verified device: `ROCm0: Radeon 8060S Graphics`, `gfx1151`.
|
|
- Model artifacts remain under `/run/media/popov/DATA/llm`; none were put under
|
|
`/home`.
|
|
|
|
DGR-001's immutable contract remains CPU-only. GPU evidence uses the distinct
|
|
signed `gpu-diagnostic` profile because llama-server process VRAM is not yet
|
|
measurable by the benchmark driver. The profile must capture measured
|
|
llama-server startup evidence for `ROCm0` and the actual offloaded/total layer
|
|
count; configured `device` and `n_gpu_layers` values alone are not evidence.
|
|
The accepted signer fingerprint is anchored in
|
|
`.scratch/distributed-gguf-runtime/trusted-evidence-signers.json`.
|