SketchGPT: Autoregressive Modeling for Sketch Generation and Recognition

arXiv:2405.03099v1 Announce Type: new
Abstract: We present SketchGPT, a flexible framework that employs a sequence-to-sequence autoregressive model for sketch generation, and completion, and an interpretation case study for sketch recognition. By mapping complex sketches into simplified sequences of abstract primitives, our approach significantly streamlines the input for autoregressive modeling. SketchGPT leverages the next token prediction objective strategy to understand sketch patterns, facilitating the creation and completion of drawings and also categorizing them accurately. This proposed sketch representation strategy aids in …

abstract arxiv autoregressive autoregressive model case case study cs.cv framework interpretation mapping modeling recognition simplified sketches study type