I made a simple demo for a chatbox interface in Godot, using which you can chat with a language model, which runs using Ollama . Currently, the interface between Godot and the language model is based on the Ollama API. The response time is about 30 seconds. If I chat directly with the LM using the Ollama CLI, the response time is much lower (less than 1 sec), and it's noticeably lower even if I interact with the API using Curl ( curl...
Originally asked by albusdemens on Stack Exchange (stackoverflow) (CC BY-SA 4.0).
