I am teaching myself LLM programming by developing a RAG application. I am running Llama 3.2 on my laptop using Ollama, and using a mix of SQLite and langchain. I can pass a context to the llm along with my question so the model uses the context for generating an answer. The code is like so const model = 'llama3.2:latest'; const temperature = 0; const llm = new ChatOllama({ model, temperature }); const messages = await promptTemplate.invoke({...
Originally asked by punkish on Stack Exchange (stackoverflow) (CC BY-SA 4.0).