Multimodal registration of FISH and nanoSIMS images using convolutional neural network models. (arXiv:2201.05545v1 [cs.CV])

Nanoscale secondary ion mass spectrometry (nanoSIMS) and fluorescence in situ
hybridization (FISH) microscopy provide high-resolution, multimodal image
representations of the identity and cell activity respectively of targeted
microbial communities in microbiological research. Despite its importance to
microbiologists, multimodal registration of FISH and nanoSIMS images is
challenging given the morphological distortion and background noise in both
images. In this study, we use convolutional neural networks (CNNs) for
multiscale feature extraction, shape context for computation of the minimum
transformation cost feature matching …

arxiv convolutional neural network cv images multimodal network neural network