https://github.com/geohot/tinygrad Installation git clone https://github.com/geohot/tinygrad.git cd tinygrad python3 -m pip install -e . weights: https://github.com/shawwn/llama-dl To download all model weights, cd into the directory you want them, then run this: Linux: curl -o- https://raw.githubusercontent.com/shawwn/llama-dl/56f50b96072f42fb2520b1ad5a1d6ef30351f23c/llama.sh | bash inference: Put this in batch script: set OPTLOCAL=1 set GPU=1 python examples/llama.py pause