Enhancing Apparent Personality Trait Analysis with Cross-Modal Embeddings

arXiv:2405.03846v1 Announce Type: new
Abstract: Automatic personality trait assessment is essential for high-quality human-machine interactions. Systems capable of human behavior analysis could be used for self-driving cars, medical research, and surveillance, among many others. We present a multimodal deep neural network with a Siamese extension for apparent personality trait prediction trained on short video recordings and exploiting modality invariant embeddings. Acoustic, visual, and textual information are utilized to reach high-performance solutions in this task. Due to the highly centralized target …

abstract analysis arxiv assessment behavior behavior analysis cars cs.cv cs.hc deep neural network driving embeddings extension human interactions machine medical medical research modal multimodal network neural network personality prediction quality research self-driving surveillance systems type