Ollama Python Unable to set Client host, httpx.ConnectError

pasta_paul

I'm trying to run an instance of ollama Client and set the host. As shown in the documentation Docs I see the code should work, but prociding any host but the OLLAMA_HOST environment variable (or 11434 as default if OLLAMA_HOST does not exist): client = Client(host='http://localhost:11435') gives me httpx.ConnectError: [Errno 111] Connection refused I found about this problem after I started using langchain for Python and stumbled accross this...

Originally asked by tdimitch on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

Fix for the Ubuntu Machine before running the python script please make sure to install ollama in your machine using the below command sudo snap install ollama After installing the ollama pull the model that you want to load. In my case I am using llama3.1 so I run the below command to load the model: ollama run llama3.1 After loading the model try to run the python script will run without the Connection Error.

Full answer by Arunisto: https://stackoverflow.stackexchange.com/a/79271483 (CC BY-SA 4.0).

Need it done for your business? UphillTech.