PREGO: online mistake detection in PRocedural EGOcentric videos

arXiv:2404.01933v2 Announce Type: replace
Abstract: Promptly identifying procedural errors from egocentric videos in an online setting is highly challenging and valuable for detecting mistakes as soon as they happen. This capability has a wide range of applications across various fields, such as manufacturing and healthcare. The nature of procedural mistakes is open-set since novel types of failures might occur, which calls for one-class classifiers trained on correctly executed procedures. However, no technique can currently detect open-set procedural mistakes online. We …

abstract applications arxiv capability cs.cv detection errors fields healthcare manufacturing mistakes nature replace set type videos