Abstract
The TrackDLO algorithm estimates the shape of a Deformable Linear Object (DLO) under occlusion from a sequence of RGB-D images. TrackDLO is vision-only and runs in real-time. It requires no external state information from physics modeling, simulation, visual markers, or contact as input. The algorithm improves on previous approaches by addressing three common scenarios which cause tracking failure: tip occlusion, mid-section occlusion, and self-occlusion. This is achieved through the application of Motion Coherence Theory to impute the spatial velocity of occluded nodes, the use of the topological geodesic distance to track self-occluding DLOs, and the introduction of a non-Gaussian kernel that only penalizes lower-order spatial displacement derivatives to reflect DLO physics. Improved real-time DLO tracking under mid-section occlusion, tip occlusion,and self-occlusion is demonstrated experimentally. The source code and demonstration data are publicly released.
Original language | English (US) |
---|---|
Pages (from-to) | 6179-6186 |
Number of pages | 8 |
Journal | IEEE Robotics and Automation Letters |
Volume | 8 |
Issue number | 10 |
DOIs | |
State | Published - Oct 1 2023 |
Keywords
- Perception for grasping and manipulation
- RGB-D perception
- visual tracking
ASJC Scopus subject areas
- Mechanical Engineering
- Control and Optimization
- Artificial Intelligence
- Human-Computer Interaction
- Control and Systems Engineering
- Computer Vision and Pattern Recognition
- Biomedical Engineering
- Computer Science Applications