[P] WangChanGLM 🐘 — The Multilingual Instruction-Following Model

WangChanGLM is a multilingual, instruction-finetuned Facebook XGLM-7.5B using open-source, commercially permissible datasets (LAION OIG chip2 and infill_dbpedia, DataBricks Dolly v2, OpenAI TL;DR, and Hello-SimpleAI HC3; about 400k examples), released under CC-BY SA 4.0. The models are trained to perform a subset of instruction-following tasks we found most relevant namely: reading comprehension, brainstorming, and creative writing.

GitHub: https://github.com/PyThaiNLP/WangChanGLM

Blog: https://link.medium.com/s2MWr3ZXnzb

creative databricks datasets dolly examples facebook laion machinelearning multilingual openai reading writing