21 lines
487 B
Plaintext
21 lines
487 B
Plaintext
https://github.com/geohot/tinygrad
|
|
Installation
|
|
git clone https://github.com/geohot/tinygrad.git
|
|
cd tinygrad
|
|
python3 -m pip install -e .
|
|
|
|
|
|
weights: https://github.com/shawwn/llama-dl
|
|
To download all model weights, cd into the directory you want them, then run this:
|
|
Linux: curl -o- https://raw.githubusercontent.com/shawwn/llama-dl/56f50b96072f42fb2520b1ad5a1d6ef30351f23c/llama.sh | bash
|
|
|
|
|
|
|
|
inference:
|
|
Put this in batch script:
|
|
|
|
set OPTLOCAL=1
|
|
set GPU=1
|
|
python examples/llama.py
|
|
pause
|