How to pass a script/multiple commands to a service in Gitlab CI/CD

fixit_fiona

I want to run Ollama as a service to use in a Gitlab CI/CD job. For example, this works: ollama: services: - name: ollama/ollama alias: ollama command: ["serve"] script: | curl -s -S ollama:11434 I get the default ollama response Ollama is running . The problem is, the ollama service hasn't pulled down any models. If I try to generate a prompt it fails: curl -s -S ollama:11434/api/generate -X POST -d '{ "model": "llama3.2", "stream": false,...

Originally asked by jeremywat on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

Okay I've gotten it working by querying the pull endpoint of the Ollama API in my before_script : variables: MODEL: llama3.2 ollama: services: - name: ollama/ollama alias: ollama command: ["serve"] pull_policy: if-not-present before_script: - curl ollama:11434/api/pull -sS -X POST -d "{\"model\":\"$MODEL\",\"stream\":false}" script: curl -sS ollama:11434/api/tags #...

Full answer by jeremywat: https://stackoverflow.stackexchange.com/a/79405531 (CC BY-SA 4.0).

Need it done for your business? UphillTech.