llama-cpp-python Log printing on Ubuntu

ubuntu_ulysses

I use llama-cpp-python to run LLMs locally on Ubuntu . While generating responses it prints its logs. How to stop printing of logs?? I found a way to stop log printing for llama.cpp but not for llama-cpp-python. I just want to print the generated response.

Originally asked by San Vik on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

You can stop printing logs by setting verbose=False An example is as follows: from langchain_community.llms import LlamaCpp llm = LlamaCpp( model_path="app/resources/llama-7b-chat-q4/llama-2-7b-chat.Q4_0.gguf", temperature=0.01, top_p=1, verbose=False )

Full answer by Ranul Navojith Dayarathne: https://stackoverflow.stackexchange.com/a/78324896 (CC BY-SA 4.0).

Need it done for your business? UphillTech.