Parse Json Langchain stream result to text

reno_rita

i have a streamlit app with langchain and im using a ConversationChain. Since i want to stream the result to a chat, i only want to get the " response " field from the output, e.g. { "input": "hallo", "history": "", "response": "Hello there!" <---- response i want to get back for streaming } Im only using the StrOutputParser, but this just results in printing out the whole json. from openai import OpenAI from dotenv import load_dotenv import...

Originally asked by MartinL on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

to stream the final output you can use a RunnableGenerator: from openai import OpenAI from dotenv import load_dotenv import streamlit as st from langchain.memory import ConversationBufferMemory from langchain_openai import ChatOpenAI from langchain_core.output_parsers import StrOutputParser from langchain_core.prompts import ChatPromptTemplate, MessagesPlaceholder, PromptTemplate from langchain.chains.llm import LLMChain from langchain.schema import ( SystemMessage, HumanMessage, AIMessage ) from langchain.chains.conversation.base import ConversationChain from langchain.chains.conversation.memory import ConversationStringBufferMemory from langchain.schema.runnable import RunnableGenerator...

Full answer by ThomaS: https://stackoverflow.stackexchange.com/a/78297146 (CC BY-SA 4.0).

Need it done for your business? UphillTech.