[D] Unsupervised representation learning

Hi folks, I have few million images in anomaly detection domain and want to build a base model for representation learning for downstream tasks. I was thinking of training a vq-vae with maybe some conditional training tasks like in-painting. Is this a good approach for representation learning? Are there any good unsupervised approaches for representation learning?

anomaly anomaly detection build detection good images machinelearning painting representation representation learning tasks thinking training unsupervised vae