FINO-net

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Arda Inceoglu, Eren Erdal Aksoy, Abdullah Cihan Ak, Sanem Sariel
PDF link

Multimodal Detection and Classification of Robot Manipulation Failures
IEEE Robotics and Automation Letters, Volume 9, Issue 2, pp. 1396 - 1403, 2024
Arda Inceoglu, Eren Erdal Aksoy, Sanem Sariel
PDF link

Video

Citation

@inproceedings{inceoglu2020fino,
  title={FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection},
  author={Inceoglu, Arda and Aksoy, Eren Erdal and Ak, Abdullah Cihan and Sariel, Sanem},
  booktitle={IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  year={2021},
}

@article{inceoglu2024multimodal,
  title={Multimodal Detection and Classification of Robot Manipulation Failures},
  author={Arda Inceoglu, Eren Erdal Aksoy, Sanem Sariel},
  journal={IEEE Robotics and Automation Letters (RA-L)},
  volume={9},
  issue={2},
  pages={1396-1403},
  year={2024},
  publisher={IEEE}
}

FAILURE Dataset

Download Data (~9.5GB compressed, ~20GB decompressed)

Download Annotations

Sample executions from the dataset:

	Place	Pour	Put-In	Put-On	Push
Success
Failure