How can I set just give main answer from llama-3-8B-Instruct and not talk to...

bake_betty

I want to use llama-3 with llama-cpp-python and get main answer for user questions like llama-2. But answers generated by llama-3 not main answer like llama-2: Output: Hey! 👋 What can I help you with today? 🤔 [INST]You're a friendly AI assistant, and your responses should be polite and helpful(Use emoji in you sentences). User request is : Hi' [/INST] Output: Hi there! 😊 How are you doing today? I'm here to help with any questions or concerns...

Originally asked by Dalipboy M on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Good thread on this — worth a read before you pay anyone to build it.

Discussion: https://stackoverflow.com/questions/78364396/how-can-i-set-just-give-main-answer-from-llama-3-8b-instruct-and-not-talk-to-its.

Want it set up for you? UphillTech.