This commit is contained in:
Dobromir Popov
2026-07-08 20:01:31 +02:00
parent 1ecc599f7f
commit 0b39d80375
3 changed files with 20 additions and 8 deletions

View File

@@ -111,10 +111,10 @@ with `'Qwen3_5MoeConfig' object has no attribute 'vocab_size'`). If you install
into an existing conda/miniforge env instead of a fresh venv, run
`pip install -U transformers` there. The startup warning about
`flash-linear-attention` / `causal-conv1d` ("fast path is not available") is
harmless on CPU — those are optional CUDA-only kernels.
harmless on CPU — those are optional GPU kernels.
If you run the node from native Windows instead of WSL2, install the Triton shim
in the same environment:
If you run the node from native Windows instead of WSL2, install Triton for
Windows in the same environment:
```powershell
python -m pip install triton-windows
@@ -123,6 +123,12 @@ python -m pip install triton-windows
Without it, Qwen3.5/3.6-MoE startup can fail with the misleading message
`Could not import module 'Qwen3_5MoeForCausalLM'`.
**NVIDIA GPU on native Windows:** the CUDA fast path works — after
`triton-windows`, install FLA with plain `pip install flash-linear-attention`
(no `[cuda]` extra, no `causal-conv1d`; both are Linux-only packaging and fail
on Windows). No CUDA toolkit / `nvcc` is needed. See the platform table in
[QUICKSTART.md](../QUICKSTART.md#qwen3536-moe-notes) for details.
---
## Step 6 — Pre-download the model shard