Large Language Model-empowered multimodal strain sensory system for shape recognition, monitoring, and human interaction of tensegrity

arXiv:2406.10264v1 Announce Type: cross
Abstract: A tensegrity-based system is a promising approach for dynamic exploration of uneven and unpredictable environments, particularly, space exploration. However, implementing such systems presents challenges in terms of intelligent aspects: state recognition, wireless monitoring, human interaction, and smart analyzing and advising function. Here, we introduce a 6-strut tensegrity integrate with 24 multimodal strain sensors by leveraging both deep learning model and large language models to realize smart tensegrity. Using conductive flexible tendons assisted by long short-term …

abstract arxiv challenges cs.cl cs.ro dynamic environments exploration however human intelligent language language model large language large language model monitoring multimodal recognition sensory shape smart space state systems terms type wireless