md: setup on windows native default py CUDA supprot

This commit is contained in:
Dobromir Popov
2026-07-01 11:32:15 +02:00
parent 2d833432bc
commit 78834e5045

View File

@@ -58,6 +58,68 @@ No firewall rules, no `--advertise-host` needed — just point at the public tra
Use this when the tracker is on another machine and you want Windows to host a
reachable node on the LAN.
#### Option A — existing conda/miniforge environment with CUDA torch (recommended if you already have it)
First, make sure the conda base environment is active so that `python` and `pip` both
resolve to the same miniforge installation:
```powershell
conda activate base
deactivate # drop any .venv that may be layered on top; safe no-op if none active
```
Install project packages into the active conda/miniforge env:
```powershell
cd D:\DEV\workspace\REPOS\git.d-popov.com\neuron-tai
pip install -e packages\tracker -e packages\node -e packages\p2p -e packages\gateway -e packages\relay
pip install transformers accelerate safetensors # torch is already present
```
Verify torch is importable and CUDA is live **before** starting the node:
```powershell
python -c "import torch; print(torch.__version__, torch.cuda.is_available())"
# Expected: 2.x.x+cuXXX True
```
If you get `ModuleNotFoundError: No module named 'torch'` even though `pip install torch`
says "already satisfied", the `torch/` package directory is missing while the metadata
stub remains (can happen after a conda-managed install). Force-reinstall via pip:
```powershell
pip install --force-reinstall torch --index-url https://download.pytorch.org/whl/cu118
```
Then re-run the verify step above.
If that prints `True` but `meshnet-node` still can't find torch, the venv entry point
is shadowing the conda one. Check which binary wins:
```powershell
(Get-Command meshnet-node).Source
# Should show: C:\Users\<you>\miniforge3\Scripts\meshnet-node.exe
# If it shows .venv\Scripts\meshnet-node.exe, use the full path below instead
```
To start a node:
```powershell
$env:HF_HOME = "D:\DEV\models"
meshnet-node start --tracker https://ai.neuron.d-popov.com --model Qwen/Qwen2.5-0.5B-Instruct
```
If the wrong entry point is shadowing, invoke via the full conda path:
```powershell
C:\Users\popov\miniforge3\Scripts\meshnet-node.exe start `
--tracker https://ai.neuron.d-popov.com `
--model Qwen/Qwen2.5-0.5B-Instruct
```
#### Option B — isolated virtualenv (fresh machine, no existing torch)
1. Install prerequisites on Windows:
- Python 3.11 or 3.12 from <https://www.python.org/downloads/windows/>
- Git for Windows from <https://git-scm.com/download/win>