Continuous Object State Recognition for Cooking Robots Using Pre-Trained Vision-Language Models and Black-box Optimization

arXiv:2403.08239v1 Announce Type: cross
Abstract: The state recognition of the environment and objects by robots is generally based on the judgement of the current state as a classification problem. On the other hand, state changes of food in cooking happen continuously and need to be captured not only at a certain time point but also continuously over time. In addition, the state changes of food are complex and cannot be easily described by manual programming. Therefore, we propose a method …

abstract arxiv box classification continuous cooking cs.cv cs.lg cs.ro current environment food judgement language language models object objects optimization recognition robots state the environment type vision vision-language models