Document transformers>=5.12 requirement and Qwen3.5/3.6-MoE fast-path notes
Bump the node package's transformers floor to 5.12 (older versions lack composite Qwen3_5MoeConfig handling and fail with missing vocab_size), and explain in QUICKSTART/INSTALL_WINDOWS that the flash-linear-attention / causal-conv1d fast-path warning is a harmless CPU fallback. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -24,12 +24,28 @@ python3 -m venv .venv
|
|||||||
.venv/bin/pip install torch --index-url https://download.pytorch.org/whl/cpu
|
.venv/bin/pip install torch --index-url https://download.pytorch.org/whl/cpu
|
||||||
|
|
||||||
# HuggingFace model libraries
|
# HuggingFace model libraries
|
||||||
.venv/bin/pip install transformers accelerate
|
.venv/bin/pip install "transformers>=5.12" accelerate
|
||||||
```
|
```
|
||||||
|
|
||||||
> **NVIDIA GPU (CUDA):** replace the torch line with `pip install torch` (default index).
|
> **NVIDIA GPU (CUDA):** replace the torch line with `pip install torch` (default index).
|
||||||
> **AMD GPU (ROCm):** `pip install torch --index-url https://download.pytorch.org/whl/rocm6.2`
|
> **AMD GPU (ROCm):** `pip install torch --index-url https://download.pytorch.org/whl/rocm6.2`
|
||||||
|
|
||||||
|
### Version and library notes for Qwen3.5/3.6-MoE models
|
||||||
|
|
||||||
|
- **transformers ≥ 5.12 is required** for Qwen3.5/3.6-MoE (e.g. `Qwen3.6-35B-A3B`).
|
||||||
|
Older versions fail at load time with
|
||||||
|
`'Qwen3_5MoeConfig' object has no attribute 'vocab_size'`. Check with
|
||||||
|
`python -c "import transformers; print(transformers.__version__)"` and upgrade
|
||||||
|
with `pip install -U transformers` in the environment that runs `meshnet-node`
|
||||||
|
(conda/miniforge users: upgrade inside that env, not a layered `.venv`).
|
||||||
|
- The startup warning
|
||||||
|
`The fast path is not available because one of the required library is not installed`
|
||||||
|
is **harmless** — transformers falls back to a pure-torch implementation of the
|
||||||
|
linear-attention layers. The fast-path packages (`flash-linear-attention`,
|
||||||
|
`causal-conv1d`) are CUDA-only kernels: install them for GPU speed if you want,
|
||||||
|
skip them entirely on CPU nodes.
|
||||||
|
- `pip install nvidia-ml-py` silences the pynvml deprecation warning on NVIDIA hosts.
|
||||||
|
|
||||||
## Bootstrap a tracker on a new machine
|
## Bootstrap a tracker on a new machine
|
||||||
|
|
||||||
Use this when provisioning a fresh LAN/public tracker host. The tracker itself is
|
Use this when provisioning a fresh LAN/public tracker host. The tracker itself is
|
||||||
@@ -112,7 +128,7 @@ python3 -m venv .venv
|
|||||||
.venv/bin/python -m pip install --upgrade pip setuptools wheel
|
.venv/bin/python -m pip install --upgrade pip setuptools wheel
|
||||||
.venv/bin/pip install -e packages/tracker -e packages/node -e packages/p2p -e packages/gateway -e packages/relay
|
.venv/bin/pip install -e packages/tracker -e packages/node -e packages/p2p -e packages/gateway -e packages/relay
|
||||||
.venv/bin/pip install torch --index-url https://download.pytorch.org/whl/cpu
|
.venv/bin/pip install torch --index-url https://download.pytorch.org/whl/cpu
|
||||||
.venv/bin/pip install transformers accelerate
|
.venv/bin/pip install "transformers>=5.12" accelerate
|
||||||
.venv/bin/meshnet-node --help
|
.venv/bin/meshnet-node --help
|
||||||
```
|
```
|
||||||
|
|
||||||
@@ -145,9 +161,15 @@ Install project packages into the active conda/miniforge env:
|
|||||||
cd D:\DEV\workspace\REPOS\git.d-popov.com\neuron-tai
|
cd D:\DEV\workspace\REPOS\git.d-popov.com\neuron-tai
|
||||||
|
|
||||||
pip install -e packages\tracker -e packages\node -e packages\p2p -e packages\gateway -e packages\relay
|
pip install -e packages\tracker -e packages\node -e packages\p2p -e packages\gateway -e packages\relay
|
||||||
pip install transformers accelerate safetensors # torch is already present
|
pip install "transformers>=5.12" accelerate safetensors # torch is already present
|
||||||
```
|
```
|
||||||
|
|
||||||
|
> Conda/miniforge envs often carry an older `transformers` pinned by other tools
|
||||||
|
> (aider, etc.). Qwen3.5/3.6-MoE models need **transformers ≥ 5.12** — verify with
|
||||||
|
> `python -c "import transformers; print(transformers.__version__)"`. The pip
|
||||||
|
> resolver may print dependency-conflict warnings for those other tools; they don't
|
||||||
|
> affect `meshnet-node`.
|
||||||
|
|
||||||
Verify torch is importable and CUDA is live **before** starting the node:
|
Verify torch is importable and CUDA is live **before** starting the node:
|
||||||
|
|
||||||
```powershell
|
```powershell
|
||||||
@@ -213,7 +235,7 @@ python -m venv .venv
|
|||||||
|
|
||||||
# CPU-only PyTorch. For NVIDIA CUDA, use `pip install torch` instead.
|
# CPU-only PyTorch. For NVIDIA CUDA, use `pip install torch` instead.
|
||||||
.\.venv\Scripts\pip.exe install torch --index-url https://download.pytorch.org/whl/cpu
|
.\.venv\Scripts\pip.exe install torch --index-url https://download.pytorch.org/whl/cpu
|
||||||
.\.venv\Scripts\pip.exe install transformers accelerate
|
.\.venv\Scripts\pip.exe install "transformers>=5.12" accelerate
|
||||||
|
|
||||||
.\.venv\Scripts\meshnet-node.exe --help
|
.\.venv\Scripts\meshnet-node.exe --help
|
||||||
```
|
```
|
||||||
|
|||||||
@@ -103,8 +103,16 @@ Verify the install:
|
|||||||
|
|
||||||
```bash
|
```bash
|
||||||
meshnet-node --help
|
meshnet-node --help
|
||||||
|
python -c "import transformers; print(transformers.__version__)"
|
||||||
```
|
```
|
||||||
|
|
||||||
|
`transformers` must be **≥ 5.12** for Qwen3.5/3.6-MoE models (older versions fail
|
||||||
|
with `'Qwen3_5MoeConfig' object has no attribute 'vocab_size'`). If you install
|
||||||
|
into an existing conda/miniforge env instead of a fresh venv, run
|
||||||
|
`pip install -U transformers` there. The startup warning about
|
||||||
|
`flash-linear-attention` / `causal-conv1d` ("fast path is not available") is
|
||||||
|
harmless on CPU — those are optional CUDA-only kernels.
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Step 6 — Pre-download the model shard
|
## Step 6 — Pre-download the model shard
|
||||||
|
|||||||
@@ -16,7 +16,7 @@ dependencies = [
|
|||||||
"rich>=13",
|
"rich>=13",
|
||||||
"safetensors>=0.4",
|
"safetensors>=0.4",
|
||||||
"torch>=2.1",
|
"torch>=2.1",
|
||||||
"transformers>=4.39",
|
"transformers>=5.12",
|
||||||
"websockets>=13",
|
"websockets>=13",
|
||||||
"zstandard>=0.22",
|
"zstandard>=0.22",
|
||||||
"kernels>=0.11.1,<0.16",
|
"kernels>=0.11.1,<0.16",
|
||||||
|
|||||||
Reference in New Issue
Block a user