Great question — answering as the UphillTech team:
Install the below in virtual environment pip install llama-index qdrant_client torch transformers pip install llama-index-llms-ollama Sample code : # Just runs .complete to make sure the LLM is listening from llama_index.llms.ollama import Ollama from llama_index.core import Settings llm = Ollama(model="mistral") response = llm.complete("Who is Laurie Voss? write in 10 words") print(response)
Full answer by Joseph Kiran: https://stackoverflow.stackexchange.com/a/78251461 (CC BY-SA 4.0).
Need it done for your business? UphillTech.
