How to build and install a BLAS-enabled llama-cpp-python (GGML_BLAS=ON) on...

drywall_dan

I’m trying to install a BLAS-enabled version of llama-cpp-python on WSL so that the GGML library uses OpenBLAS. I attempted two different pip install invocations with CMAKE_ARGS , but the module imports without any visible BLAS confirmation and I’m not sure whether BLAS actually got enabled. I have used the particular commands # Try 1: request OpenBLAS vendor explicitly CMAKE_ARGS="-DGGML_BLAS=ON -DGGML_BLAS_VENDOR=OpenBLAS" \ pip install...

Originally asked by Kunal Gupta on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Good thread on this — worth a read before you pay anyone to build it.

Discussion: https://stackoverflow.com/questions/79844758/how-to-build-and-install-a-blas-enabled-llama-cpp-python-ggml-blas-on-on-wsl.

Want it set up for you? UphillTech.