Great question — answering as the UphillTech team:
One can use the CulturaX dataset ( paper ) to train an LLM in another language. It contains 27 TB of texts divided into 167 languages. Otherwise, one can use Okapi ( paper ): Okapi Resources: We provide resources to perform instruction tuning with RLHF for 26 languages, including ChatGPT prompts, multilingual instruction datasets and multilingual response ranking data. Okapi Models: We provide RLHF-based instruction-tuned LLMs for 26 languages on Okapi dataset. Our models include both BLOOM-based and LLaMa-based versions. We also provide scripts to interact with our models and fine-tune LLMs with our resources. Multilingual Evaluation Benchmark Datasets: We provide three benchmark datasets...
Full answer by Franck Dernoncourt: https://ai.stackexchange.com/a/45034 (CC BY-SA 4.0).
Need it done for your business? UphillTech.
