[R] Introducing The Vault: A new multilingual dataset for advancing code understanding and generation.

We are releasing a new dataset for code understanding and generation in the same vein as the Pile (Eleuther AI) and The Stack (BigCode Project). However, we put in a lot of effort to make the data much cleaner by writing parsers that extract the code comment (docstring) and code into high quality pairs.

Read more about the Vault in our technical report: [https://arxiv.org/abs/2305.06156](https://arxiv.org/abs/2305.06156)

Github page: [https://github.com/FSoft-AI4Code/TheVault](https://github.com/FSoft-AI4Code/TheVault)

bigcode code data dataset extract machinelearning multilingual project stack the pile understanding writing