Advancing Generative AI for Portuguese with Open Decoder Gerv\'asio PT*

arXiv:2402.18766v1 Announce Type: new
Abstract: To advance the neural decoding of Portuguese, in this paper we present a fully open Transformer-based, instruction-tuned decoder model that sets a new state of the art in this respect. To develop this decoder, which we named Gerv\'asio PT*, a strong LLaMA~2 7B model was used as a starting point, and its further improvement through additional training was done over language resources that include new instruction data sets of Portuguese prepared for this purpose, which …

abstract advance art arxiv cs.cl decoder decoding generative instruction-tuned llama paper state state of the art transformer type