CMAKE in requirements.txt file: Install llama-cpp-python for Mac

distro_dave

I have put my application into a Docker and therefore I have created a requirements.txt file. Now I need to install llama-cpp-python for Mac, as I am loading my LLM with from langchain.llms import LlamaCpp. My installation command specifically for Mac is: "CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python" But it does not work if I put this in my "requirements.txt" file. My requirements.txt file looks as follows:...

Originally asked by Maxl Gemeinderat on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

I finally found a solution: In your Dockerfile add the llama-cpp-python installation for MAc like this: FROM python:3.11.5 WORKDIR /app COPY . . ENV RUN CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 RUN pip install llama-cpp-python RUN pip3 install -r requirements.txt EXPOSE 8501 HEALTHCHECK CMD curl --fail http://localhost:8501/_stcore/health ENTRYPOINT ["streamlit", "run", "streamlit_app.py", "--server.port=8501", "--server.address=0.0.0.0"]

Full answer by Maxl Gemeinderat: https://stackoverflow.stackexchange.com/a/77759527 (CC BY-SA 4.0).

Need it done for your business? UphillTech.