Ollama Status Code 404 Error when trying to run with LangChain

distro_dave

I am getting the following error when trying to run Ollama with LLama3 and invoking the model from LangChain (python) langchain_community.llms.ollama.OllamaEndpointNotFoundError: Ollama call failed with status code 404. Maybe your model is not found and you should pull the model with `ollama pull llama3`. Context: Running on MacOs Code: from langchain_community.llms import Ollama llm = Ollama(model="llama3", base_url="http://localhost:11434/")...

Originally asked by Parvez Shah on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

I did faced the same issue with both llama3 and llama2 on my Mac Here is how it got resolved- Remove the ending slash from the base URL param llm = Ollama(model="llama3", base_url="http://localhost:11434") Restart the Jupytar karnel. Run all the cells again.

Full answer by Pavan Gupta: https://stackoverflow.stackexchange.com/a/78824657 (CC BY-SA 4.0).

Need it done for your business? UphillTech.