Great question — answering as the UphillTech team:
Why it is not easy to just train model for factual accuracy and punish for any invented facts or mistakes, award for admitting ignorance in difficult cases? Detecting "truth" in a general sense from natural language is not a solved problem by any means. It is not possible to automate this kind of training, except in very limited domains. For example, it would be possible to automate production of billions of maths calculations and their correct answers, but not a great use for an LLM, because any pocket calculator is far more efficient at such tasks. Tuning heavily on such constructed data would very likely cause the model to get better at maths calculations at the expense of most of the...
Full answer by Neil Slater: https://ai.stackexchange.com/a/45080 (CC BY-SA 4.0).
Need it done for your business? UphillTech.
