I am following the instructions from the official documentation on how to install llama-cpp with GPU support in Apple silicon Mac. Here is my Dockerfile: FROM python:3.11-slim WORKDIR /code RUN pip uninstall llama-cpp-python -y ENV CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 RUN pip install -U llama-cpp-python --no-cache-dir RUN pip install 'llama-cpp-python[server]' COPY ./requirements.txt /code/requirements.txt RUN pip install --no-cache-dir...
Originally asked by Kristada673 on Stack Exchange (stackoverflow) (CC BY-SA 4.0).
