tasks
This commit is contained in:
@@ -0,0 +1,21 @@
|
||||
# 09 — DeepSeek-V4-Flash support audit
|
||||
|
||||
Status: ready-for-agent
|
||||
|
||||
## What to build
|
||||
|
||||
Audit `deepseek-ai/DeepSeek-V4-Flash` as the first serious large-model target after the small GGUF protocol smoke test. The output is a compatibility matrix and a recommended runtime path, not full production support.
|
||||
|
||||
## Acceptance criteria
|
||||
|
||||
- [ ] Verify current PyTorch/Transformers load and generation semantics for DeepSeek-V4-Flash from primary model documentation.
|
||||
- [ ] Verify vLLM and SGLang support status from primary runtime documentation or release notes.
|
||||
- [ ] Verify whether a GGUF/llama.cpp quantization path exists or would need upstream work.
|
||||
- [ ] Estimate artifact size, active parameter behavior, and 128K cache memory by Shard range.
|
||||
- [ ] Identify required backend capability flags for the Tracker.
|
||||
- [ ] Produce a compatibility matrix: PyTorch, vLLM, SGLang, llama.cpp/GGUF.
|
||||
- [ ] End with one recommendation: first runtime path, blocked pending upstream, or defer.
|
||||
|
||||
## Blocked by
|
||||
|
||||
None - can start immediately.
|
||||
Reference in New Issue
Block a user