md
This commit is contained in:
@@ -111,10 +111,10 @@ with `'Qwen3_5MoeConfig' object has no attribute 'vocab_size'`). If you install
|
||||
into an existing conda/miniforge env instead of a fresh venv, run
|
||||
`pip install -U transformers` there. The startup warning about
|
||||
`flash-linear-attention` / `causal-conv1d` ("fast path is not available") is
|
||||
harmless on CPU — those are optional CUDA-only kernels.
|
||||
harmless on CPU — those are optional GPU kernels.
|
||||
|
||||
If you run the node from native Windows instead of WSL2, install the Triton shim
|
||||
in the same environment:
|
||||
If you run the node from native Windows instead of WSL2, install Triton for
|
||||
Windows in the same environment:
|
||||
|
||||
```powershell
|
||||
python -m pip install triton-windows
|
||||
@@ -123,6 +123,12 @@ python -m pip install triton-windows
|
||||
Without it, Qwen3.5/3.6-MoE startup can fail with the misleading message
|
||||
`Could not import module 'Qwen3_5MoeForCausalLM'`.
|
||||
|
||||
**NVIDIA GPU on native Windows:** the CUDA fast path works — after
|
||||
`triton-windows`, install FLA with plain `pip install flash-linear-attention`
|
||||
(no `[cuda]` extra, no `causal-conv1d`; both are Linux-only packaging and fail
|
||||
on Windows). No CUDA toolkit / `nvcc` is needed. See the platform table in
|
||||
[QUICKSTART.md](../QUICKSTART.md#qwen3536-moe-notes) for details.
|
||||
|
||||
---
|
||||
|
||||
## Step 6 — Pre-download the model shard
|
||||
|
||||
Reference in New Issue
Block a user