Web: http://arxiv.org/abs/2205.05448

Sept. 19, 2022, 1:12 a.m. | Jiafeng Liu, Yuanliang Dong, Zehua Cheng, Xinran Zhang, Xiaobing Li, Feng Yu, Maosong Sun

cs.LG updates on arXiv.org arxiv.org

In this work, we propose a permutation invariant language model, SymphonyNet,
as a solution for symbolic symphony music generation. We propose a novel
Multi-track Multi-instrument Repeatable (MMR) representation for symphonic
music and model the music sequence using a Transformer-based auto-regressive
language model with specific 3-D positional embedding. To overcome length
overflow when modeling extra-long symphony tokens, we also propose a modified
Byte Pair Encoding algorithm (Music BPE) for music tokens and introduce a novel
linear transformer decoder architecture as a …

arxiv language language model

More from arxiv.org / cs.LG updates on arXiv.org

Postdoctoral Fellow: ML for autonomous materials discovery

@ Lawrence Berkeley National Lab | Berkeley, CA

Research Scientists

@ ODU Research Foundation | Norfolk, Virginia

Embedded Systems Engineer (Robotics)

@ Neo Cybernetica | Bedford, New Hampshire

2023 Luis J. Alvarez and Admiral Grace M. Hopper Postdoc Fellowship in Computing Sciences

@ Lawrence Berkeley National Lab | San Francisco, CA

Senior Manager Data Scientist

@ NAV | Remote, US

Senior AI Research Scientist

@ Earth Species Project | Remote anywhere

Research Fellow- Center for Security and Emerging Technology (Multiple Opportunities)

@ University of California Davis | Washington, DC

Staff Fellow - Data Scientist

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Staff Fellow - Senior Data Engineer

@ U.S. FDA/Center for Devices and Radiological Health | Silver Spring, Maryland

Software Engineer II, Data Pipeline

@ Amplitude | San Francisco, CA

Data Operations Researcher

@ Cognism | Skopje, Greater Skopje, North Macedonia

Data Engineer - Commodities

@ DRW | Chicago and London