localhost:11434/api/generate return error 404

reno_rita

I have an installation of Ollama that is working properly. When I send a request to it at localhost:11434/api/generate using curl, I get a proper response. However, when I try to call it via haystack_integrations.components.generators.ollama.OllamaGenerator , I get error 404. If I point the OllamaGenerator to localhost:11434 , I get some responses, but they are not in the proper format, so I think the function works properly. What could be the...

Originally asked by mans on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

Culprit seems to be upgrading to ollama-haystack==1.0.0 You might want to roll back the version to a previous one. I am using ollama-haystack==0.0.7 and it is able to generate the answers without throwing the said error for me.

Full answer by Bhavpreet: https://stackoverflow.stackexchange.com/a/79001275 (CC BY-SA 4.0).

Need it done for your business? UphillTech.