CLIPSwarm: Generating Drone Shows from Text Prompts with Vision-Language Models

arXiv:2403.13467v1 Announce Type: cross
Abstract: This paper introduces CLIPSwarm, a new algorithm designed to automate the modeling of swarm drone formations based on natural language. The algorithm begins by enriching a provided word, to compose a text prompt that serves as input to an iterative approach to find the formation that best matches the provided word. The algorithm iteratively refines formations of robots to align with the textual description, employing different steps for "exploration" and "exploitation". Our framework is currently …

abstract algorithm arxiv automate cs.cv cs.ro drone iterative language language models modeling natural natural language paper prompt prompts shows text the algorithm type vision vision-language models word