all AI news
[R] A Roundup of Privacy-Related Research from NeurIPS 2021
As we think about generative synthetic data for more modalities, diffusion models have emerged as a potential strong contender for images and audio with DN21 showing superior performance over GANs. SDME21 and others also show nice progress in being able to work with these models and their likelihood.
Many papers such as MKWZMMZ21 worked to extend language model performance to longer and longer sequence lengths. This is still an open problem, but much exciting progress in factorization, kernel methods, …