GO4Align: Group Optimization for Multi-Task Alignment

arXiv:2404.06486v1 Announce Type: new
Abstract: This paper proposes \textit{GO4Align}, a multi-task optimization approach that tackles task imbalance by explicitly aligning the optimization across tasks. To achieve this, we design an adaptive group risk minimization strategy, compromising two crucial techniques in implementation: (i) dynamical group assignment, which clusters similar tasks based on task interactions; (ii) risk-guided group indicators, which exploit consistent task correlations with risk information from previous iterations. Comprehensive experimental results on diverse typical benchmarks demonstrate our method's performance superiority …

abstract alignment arxiv cs.lg design implementation interactions optimization paper risk strategy tasks type