MPIrigen: MPI Code Generation through Domain-Specific Language Models

arXiv:2402.09126v1 Announce Type: cross
Abstract: The imperative need to scale computation across numerous nodes highlights the significance of efficient parallel computing, particularly in the realm of Message Passing Interface (MPI) integration. The challenging parallel programming task of generating MPI-based parallel programs has remained unexplored. This study first investigates the performance of state-of-the-art language models in generating MPI-based parallel programs. Findings reveal that widely used models such as GPT-3.5 and PolyCoder (specialized multi-lingual code models) exhibit notable performance degradation, when generating …

arxiv code code generation cs.ai cs.cl cs.dc cs.lg cs.se domain language language models mpi through type