MEGA Hub

Representation-Aligned Tactile Grounding for Contact-Rich Robotic Manipulation

Authors

Do you know Ruilin Chen?You can claim authorship or link another user.Do you know Jingkai Jia?You can claim authorship or link another user.Do you know Tong Yang?You can claim authorship or link another user.Do you know Xinyu Zhou?You can claim authorship or link another user.Do you know Qiao Sun?You can claim authorship or link another user.Do you know Jiangwei Zhong?You can claim authorship or link another user.Do you know Shizeng Zhang?You can claim authorship or link another user.Do you know Nuo Chen?You can claim authorship or link another user.Do you know Bailin He?You can claim authorship or link another user.Do you know Wei Li?You can claim authorship or link another user.Do you know Wenqiang Zhang?You can claim authorship or link another user.

Abstract

Tactile-enhanced vision-language-action (VLA) policies have been introduced for contact-rich manipulation, where critical interaction states are often hidden from vision. Future tactile prediction is a promising way to use touch because it turns tactile outcomes into supervision for action-induced contact dynamics. Yet VLA policies contain representations with different roles, from perceptual encoding to motor prediction, making it unclear where this supervision should be applied. We study this as a representation-alignment problem. Through a linear probe analysis, we find that future tactile states are most predictable from intermediate action-expert features, rather than from vision-language features or final action states. Motivated by this observation, we introduce a lightweight Latent Tactile Predictor (LTP), which predicts compact future tactile embeddings from the identified intermediate representation. By avoiding direct prediction of noisy raw tactile signals, LTP provides an action-outcome grounding signal that aligns intermediate action representations with future contact consequences. Experiments on real-world contact-rich manipulation tasks show that representation-aligned tactile grounding outperforms less aligned or multi-interface tactile prediction, highlighting the importance of where tactile supervision is applied.

Community

00