neuron-tai/.scratch/distributed-gguf-runtime/issues/10-glm52-ornith-followup-audit.md

10 — GLM-5.2 and Ornith follow-up support audit

Status: pending

What to build

Audit GLM-5.2 and Ornith after the smaller protocol smoke path and DeepSeek-V4-Flash audit. The output is a follow-up compatibility matrix focused on architecture/runtime blockers: DSA/MLA, hybrid attention, cache accounting, and GGUF/llama.cpp support.

Acceptance criteria

• Verify GLM-5.2 PyTorch/Transformers serving requirements and cache semantics from primary model documentation.
• Verify llama.cpp/GGUF support status for glm_moe_dsa or equivalent architecture support.
• Verify Ornith/Qwen3.5-MoE and hybrid attention support status in the candidate runtimes.
• Estimate artifact size and 128K cache memory by Shard range for each model.
• Identify smallest quality-preserving quantization worth testing.
• Convert each runtime blocker into a follow-up issue or upstream collaboration note.

Blocked by

• 09 — DeepSeek-V4-Flash support audit.