Talking Tennis: Language Feedback from 3D Biomechanical Action Recognition
By: Arushi Dashore , Aryan Anumala , Emily Hui and more
Potential Business Impact:
Helps tennis players improve by explaining their swings.
Automated tennis stroke analysis has advanced significantly with the integration of biomechanical motion cues alongside deep learning techniques, enhancing stroke classification accuracy and player performance evaluation. Despite these advancements, existing systems often fail to connect biomechanical insights with actionable language feedback that is both accessible and meaningful to players and coaches. This research project addresses this gap by developing a novel framework that extracts key biomechanical features (such as joint angles, limb velocities, and kinetic chain patterns) from motion data using Convolutional Neural Network Long Short-Term Memory (CNN-LSTM)-based models. These features are analyzed for relationships influencing stroke effectiveness and injury risk, forming the basis for feedback generation using large language models (LLMs). Leveraging the THETIS dataset and feature extraction techniques, our approach aims to produce feedback that is technically accurate, biomechanically grounded, and actionable for end-users. The experimental setup evaluates this framework on classification performance and interpretability, bridging the gap between explainable AI and sports biomechanics.
Similar Papers
TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?
CV and Pattern Recognition
Helps computers understand fast sports like tennis.
TT3D: Table Tennis 3D Reconstruction
CV and Pattern Recognition
Tracks table tennis balls in 3D, even spin.
Biomechanically consistent real-time action recognition for human-robot interaction
Robotics
Helps robots understand what people are doing.