CustomListener: Text-guided Responsive Interaction for User-friendly Listening Head Generation

arXiv:2403.00274v1 Announce Type: new
Abstract: Listening head generation aims to synthesize a non-verbal responsive listener head by modeling the correlation between the speaker and the listener in dynamic conversion.The applications of listener agent generation in virtual interaction have promoted many works achieving the diverse and fine-grained motion generation. However, they can only manipulate motions through simple emotional labels, but cannot freely control the listener's motions. Since listener agents should have human-like attributes (e.g. identity, personality) which can be freely customized …

abstract agent applications arxiv conversion correlation cs.cv cs.sd diverse dynamic eess.as fine-grained head modeling promoted responsive speaker text type verbal virtual