[D] Which is the best model ( Multi modal or LM) under 3B parameters w.r.t good training vs performance tradeoff? (i.e good parameter efficiency)

Which model right now has best performance with reasonable dataset size and parameter count. I am asking it in terms of efficiency of architecture since I am planning on training from scratch on a different task and might not be able to afford the volume of dataset that was used by SOTA models.

Edit: If only decoder only models are considered, which would you prefer? And if it was encoder-decoder only which would prefer?

architecture count dataset efficiency good machinelearning modal parameters performance planning scratch terms training