old changes

This commit is contained in:
Dobromir Popov
2023-08-23 12:43:43 +00:00
parent 88e9353b03
commit ba9389e7b0
19 changed files with 4319 additions and 64 deletions

20
agent-py/notes.txt Normal file
View File

@ -0,0 +1,20 @@
https://github.com/geohot/tinygrad
Installation
git clone https://github.com/geohot/tinygrad.git
cd tinygrad
python3 -m pip install -e .
weights: https://github.com/shawwn/llama-dl
To download all model weights, cd into the directory you want them, then run this:
Linux: curl -o- https://raw.githubusercontent.com/shawwn/llama-dl/56f50b96072f42fb2520b1ad5a1d6ef30351f23c/llama.sh | bash
inference:
Put this in batch script:
set OPTLOCAL=1
set GPU=1
python examples/llama.py
pause