DragAnything: Motion Control for Anything using Entity Representation

arXiv:2403.07420v2 Announce Type: replace
Abstract: We introduce DragAnything, which utilizes a entity representation to achieve motion control for any object in controllable video generation. Comparison to existing motion control methods, DragAnything offers several advantages. Firstly, trajectory-based is more userfriendly for interaction, when acquiring other guidance signals (e.g., masks, depth maps) is labor-intensive. Users only need to draw a line (trajectory) during interaction. Secondly, our entity representation serves as an open-domain embedding capable of representing any object, enabling the control of …

abstract advantages arxiv comparison control cs.cv guidance labor maps masks object representation trajectory type video video generation