XR Rhythm Coach
A VR wrist handtracking and AI coach platform that help amateur musicians build polyrhythmic drumming skills. Used a Fast-Fourier Transform approach on wrist coordinate data retrieved from a Meta Quest 3 to analyze user rhythmic stability and accuracy. A UCSB Human-AI Integration Lab research project.
View project
The challenge
What the project set out to solve
Give developing musicians useful feedback on polyrhythmic timing inside a spatial, hands-on practice environment.
The approach
How it was built
Translate Quest 3 wrist-tracking coordinates into a signal that can be evaluated for rhythmic stability and accuracy.
Core capabilities
What the experience includes
- Wrist-based hand tracking
- Fast Fourier Transform analysis
- In-experience AI coaching
Technology
The implementation stack
