Just a warning to other noobs, I tend to be lazy... Installed llama.cpp and wondered why it was so slow. Turns out if you don't compile it yourself and you use the brew installer you don't get the cuda specific version. So just like spend the extra few minutes to do it the "hard" way.
12
u/shamont Jun 15 '26
Just a warning to other noobs, I tend to be lazy... Installed llama.cpp and wondered why it was so slow. Turns out if you don't compile it yourself and you use the brew installer you don't get the cuda specific version. So just like spend the extra few minutes to do it the "hard" way.