3D rock-climbing analysis with iPhone LiDAR
The creator says the demo shows distance traveled in meters and visualizes which hand or foot activated each climbing hold.
TLDR
A developer shared a 3D climbing-analysis demo built with video and LiDAR depth data captured through their iPhone 15 Pro app. They say they ran the remaining analysis on a computer, using ViTPose+ Large for pose estimation and SAM 3.1 to segment climbing holds. The creator considers the demo an improvement because it shows real-world distance traveled and hand and foot activity on the holds. They say the analysis code is open-source on GitHub.
