neuron-tai/.scratch/distributed-gguf-runtime/issues/09-deepseek-v4-flash-support-audit.md

09 — DeepSeek-V4-Flash support audit

Status: ready-for-agent

What to build

Audit deepseek-ai/DeepSeek-V4-Flash as the first serious large-model target after the small GGUF protocol smoke test. The output is a compatibility matrix and a recommended runtime path, not full production support.

Acceptance criteria

• Verify current PyTorch/Transformers load and generation semantics for DeepSeek-V4-Flash from primary model documentation.
• Verify vLLM and SGLang support status from primary runtime documentation or release notes.
• Verify whether a GGUF/llama.cpp quantization path exists or would need upstream work.
• Estimate artifact size, active parameter behavior, and 128K cache memory by Shard range.
• Identify required backend capability flags for the Tracker.
• Produce a compatibility matrix: PyTorch, vLLM, SGLang, llama.cpp/GGUF.
• End with one recommendation: first runtime path, blocked pending upstream, or defer.

Blocked by

None - can start immediately.