Tokensome: Towards a Genetic Vision-Language GPT for Explainable and Cognitive Karyotyping

arXiv:2403.11073v1 Announce Type: new
Abstract: Automatic karyotype analysis is often defined as a visual perception task focused solely on chromosomal object-level modeling. This definition has led most existing methods to overlook componential and holistic information, significantly constraining model performance. Moreover, the lack of interpretability in current technologies hinders clinical adoption. In this paper, we introduce Tokensome, a novel vision-language model based on chromosome tokenization for explainable and cognitive karyotyping. Tokensome elevates the method from the conventional visual perception layer to …

abstract analysis arxiv clinical cognitive cs.ai cs.cv current definition gpt information interpretability language modeling object perception performance technologies type vision visual