I'm trying to get the hang of creating chat agents with langchain using locally hosted LLMs. I've downloaded the flan-t5-base model weights from huggingface and I have them stored locally on my ubuntu server 18.04 LTS. I've adapted the code I found in this example creating a chat agent using gpt-3.5-turbo from openai: https://github.com/samwit/langchain-tutorials/blob/main/tools/YT_LangChain_Custom_Tools_%26_Agents.ipynb to instead use the...
Originally asked by user3476463 on Stack Exchange (stackoverflow) (CC BY-SA 4.0).