NeuralDiffuser: Controllable fMRI Reconstruction with Primary Visual Feature Guided Diffusion

arXiv:2402.13809v1 Announce Type: cross
Abstract: Reconstructing visual stimuli from functional Magnetic Resonance Imaging (fMRI) based on Latent Diffusion Models (LDM) provides a fine-grained retrieval of the brain. A challenge persists in reconstructing a cohesive alignment of details (such as structure, background, texture, color, etc.). Moreover, LDMs would generate different image results even under the same conditions. For these, we first uncover the neuroscientific perspective of LDM-based methods that is top-down creation based on pre-trained knowledge from massive images but lack …

abstract alignment arxiv brain challenge color cs.ai cs.cv cs.ne diffusion diffusion models etc feature fine-grained fmri functional generate image imaging latent diffusion models ldm retrieval texture type visual