[D]Are there any other non trivial use cases of Transformers?

Seq2Seq prediction architectures were designed for sequence prediction and are naturally SOTA in text generations, but are there any other non trivial tasks where we can use them? Like MeshGPT uses a gpt model for mesh generation, and diffusion transformer are also now being studied infact sora uses one. Are there many other applications where these models might be efficient and scalable ?

architectures cases diffusion gpt machinelearning mesh prediction seq2seq sora sota tasks text them transformer transformers use cases