Psychometry: An Omnifit Model for Image Reconstruction from Human Brain Activity

arXiv:2403.20022v1 Announce Type: new
Abstract: Reconstructing the viewed images from human brain activity bridges human and computer vision through the Brain-Computer Interface. The inherent variability in brain function between individuals leads existing literature to focus on acquiring separate models for each individual using their respective brain signal data, ignoring commonalities between these data. In this article, we devise Psychometry, an omnifit model for reconstructing images from functional Magnetic Resonance Imaging (fMRI) obtained from different subjects. Psychometry incorporates an omni mixture-of-experts …

abstract arxiv brain brain activity brain-computer interface computer computer vision cs.cv data focus function human image images leads literature signal through type vision