Skip to main navigation Skip to search Skip to main content

Investigating sensors and methods in grasp state classification in agricultural manipulation

Research output: Contribution to journal › Article › peer-review

Abstract

Accurate grasp state classification is essential for effective and efficient agricultural manipulation and harvesting. The agricultural environment presents unique challenges, including clutter, occlusion, and the physical attachment of fruit to plants, which necessitate precise separation during harvesting. This study investigates the integration of multiple sensor modalities, including inertial measurement units (IMUs), infrared (IR) reflectance, tension sensors, tactile sensors, and RGB cameras, into a compliant gripper to classify grasp states. We evaluate the individual contributions of each sensor and compare the performance of two widely used classification models: Random Forest and Long Short-Term Memory (LSTM) networks. While most sensors offer only marginal improvements in detecting grasp anomalies such as slip and failure, the inclusion of a tension sensor significantly enhances the detection of sustained successful picks, improving classification accuracy from 10 percent to 80 percent. Furthermore, we identify a minimal viable sensor combination consisting of IMU and tension sensors that achieves robust grasp state classification. This enables real-time feedback for planning corrective actions, thereby improving the reliability and efficiency of autonomous fruit harvesting operations.

Original languageEnglish (US)
Article number101533
JournalSmart Agricultural Technology
Volume12
DOIs
StatePublished - Dec 2025

Keywords

  • Agricultural manipulation
  • Grasp state
  • LSTM
  • Random forest
  • Slip detection

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • General Agricultural and Biological Sciences
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Investigating sensors and methods in grasp state classification in agricultural manipulation'. Together they form a unique fingerprint.

Cite this