Large sequence models for sequential decision-making

Transformer architectures have facilitated the development of large-scale and general-purpose sequence models for prediction tasks in natural language processing and computer vision, for example, GPT-3 and Swin Transformer.

architectures computer computer sciences computer vision decision development example general gpt gpt-3 language language processing making natural natural language natural language processing prediction processing scale swin swin transformer tasks transformer vision