s
July 19, 2023, 4:04 a.m. |

Simon Willison's Weblog simonwillison.net

llama2-mac-gpu.sh


Adrien Brault provided this recipe for compiling llama.cpp on macOS with GPU support enabled ("LLAMA_METAL=1 make") and then downloading and running a GGML build of Llama 2 13B.


Via @AdrienBrault

ai build cpp generativeai gpu homebrewllms llama llama 2 llms mac macos macosx recipe running support

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Robotics Technician - 3rd Shift

@ GXO Logistics | Perris, CA, US, 92571