I am new to this. I have been trying but could not make the the model answer on images. from llama_cpp import Llama import torch from PIL import Image import base64 llm = Llama( model_path='Holo1-7B.i1-Q5_K_M.gguf', n_gpu_layers=-1, ) def image_to_base64_data_uri(file_path): with open(file_path, "rb") as img_file: base64_data = base64.b64encode(img_file.read()).decode('utf-8') return f"data:image/png;base64,{base64_data}" # Replace...
Originally asked by Abhash Rai on Stack Exchange (stackoverflow) (CC BY-SA 4.0).