COCOLA: Coherence-Oriented Contrastive Learning of Musical Audio Representations

arXiv:2404.16969v1 Announce Type: cross
Abstract: We present COCOLA (Coherence-Oriented Contrastive Learning for Audio), a contrastive learning method for musical audio representations that captures the harmonic and rhythmic coherence between samples. Our method operates at the level of stems (or their combinations) composing music tracks and allows the objective evaluation of compositional models for music in the task of accompaniment generation. We also introduce a new baseline for compositional music generation called CompoNet, based on ControlNet \cite{zhang2023adding}, generalizing the tasks of …

abstract arxiv audio cs.lg cs.sd eess.as evaluation music samples type