Skip to content

V2F: Vision-Informed Grasp Force Prediction for Damage-Aware Robotic Handling of Date Fruits

Jul 2026 · arXiv.org · Vol abs/2607.19804 · 0 citations · 32 references
Computer Science

TL;DR

Results show that pre-emptive, vision-driven force estimation% can replace slow and potentially damaging tactile exploration, enabling safer robotic handling of fragile fruits.

Abstract

This paper presents a vision-informed grasp force prediction framework for robotic handling of date fruits. Addressing the dual challenge of high detachment forces and low bruise thresholds, we first conduct mechanical characterization on date samples to define a safe grasping envelope and quantify the relationship between fruit geometry and bioyield stress. In this work, we develop a Vision-to-Force (V2F) pipeline that combines computer vision-based segmentation, active-contour refinement, and geometric feature extraction with a physics-informed residual neural network that augments a Hertz contact equation. The resulting model maps non-contact visual descriptors and cultivar metadata to predict a safe grasp force with mean validation performance of $R^2 \approx 0.7$ across unseen cultivar groups, which is a good result given the inherent mechanical variability of biological tissue. Experimental validation using a gripper and load cell indicates that the predicted forces enable stable manipulation of different types of date fruits, with residual deformations below 1 mm and no observable damage. These results show that pre-emptive, vision-driven force estimation% can replace slow and potentially damaging tactile exploration , enabling safer robotic handling of fragile fruits.

View source

Similar papers

Open access Sep 2026

Vision-Based 6-DoF Grasp Pose Estimation for Robot Cloth Unfolding

This work proposes center direction regression network (CeDiRNet)-6DoF, a deep learning framework that jointly predicts effective grasp points and the complete 6-DoF grasp pose from the observed cloth configuration by integrating dense 3-D grasp regression with segmentation and sine-cosine-encoded Euler angles.

Domen Tabernik, Peter Nimac, Jan Jerićević et al. · 0 citations
Preprint Sep 2026

ZeroTouch: Tactile-Supervised Visual Contact Estimation for Contact-Rich Manipulation

Reliable robotic grasping benefits from estimating the evolving physical interaction and selecting a grasp-dependent compression target. Tactile sensors provide direct interaction measurements but require dedicated hardware at deployment. We introduce ZeroTouch, a tactile-supervised framework that predicts dense contac...

D. Kosenkov, Daniia Zinniatullina, Miguel Altamirano Cabrera et al. · 0 citations
Conference Aug 2026

Real-Time 3-DoF Robotic Grasp Detection via Keypoint Regression

Although vision-based grasping methods demonstrate strong perceptual capabilities in robotic grasping tasks, they often require direct regression of the grasp angle. Such regression is susceptible to the angle’s periodicity and discontinuity, leading to unstable model training. To address this issue, this paper propose...

Xiao-Yu Xia, Cheng-Cheng Hu, Le-Yi Liu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Training-free Suction Grasp Detection for Deformed Aseptic Cartons Using Vision-Language Models and Geometric Surface Scoring

This work presents a training-free suction grasping system for sorting deformed aseptic beverage cartons, decoupling target identification from grasp-point selection, and compares three geometric methods: k-nearest-neighbour PCA, Sobel cross-product, and RANSAC plane fitting.

Marin Maletic, G. Vasiljević · 0 citations
Open access Sep 2026

From Vision to Grasp: TCP Dynamic Realignment Using Embedded Sensors

The integration of robotics into agriculture addresses challenges such as labour shortages and sustainable production. Handling delicate and irregular natural products remains difficult for conventional grippers. This paper presents a baromorphic end-effector as a proof-of-concept platform for validating a perception-s...

N. Al Khatib, D. Cafolla · 0 citations
Preprint Sep 2026

Before the Tipping Point: Force-Guided Active Perception for Shape-Agnostic Estimation of 3D Centers of Mass

A force-based method that estimates CoM height and mass from a single sub-critical tipping experiment by a robot manipulator, which informs and enables reliable non-prehensile manipulation and robotic grasping of challenging objects that were previously infeasible.

Steven M. Hyland, Xiao Jing, Cagdas D. Onal · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.