22 lines
1020 B
Markdown
22 lines
1020 B
Markdown
# 09 — DeepSeek-V4-Flash support audit
|
|
|
|
Status: ready-for-agent
|
|
|
|
## What to build
|
|
|
|
Audit `deepseek-ai/DeepSeek-V4-Flash` as the first serious large-model target after the small GGUF protocol smoke test. The output is a compatibility matrix and a recommended runtime path, not full production support.
|
|
|
|
## Acceptance criteria
|
|
|
|
- [ ] Verify current PyTorch/Transformers load and generation semantics for DeepSeek-V4-Flash from primary model documentation.
|
|
- [ ] Verify vLLM and SGLang support status from primary runtime documentation or release notes.
|
|
- [ ] Verify whether a GGUF/llama.cpp quantization path exists or would need upstream work.
|
|
- [ ] Estimate artifact size, active parameter behavior, and 128K cache memory by Shard range.
|
|
- [ ] Identify required backend capability flags for the Tracker.
|
|
- [ ] Produce a compatibility matrix: PyTorch, vLLM, SGLang, llama.cpp/GGUF.
|
|
- [ ] End with one recommendation: first runtime path, blocked pending upstream, or defer.
|
|
|
|
## Blocked by
|
|
|
|
None - can start immediately.
|