• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Pablo Vela shares exo-calib for uncalibrated video tracking

    Pablo Vela describes progress on person tracking with time-synced uncalibrated videos at rerundotio.

    PV
    1 Source, 27d ago, first seen 27d ago

    TLDR

    Pablo Vela posted on X that he has long struggled to make person tracking work from synchronized but uncalibrated videos. He stated that tools like vggt left residual error that produced poor results. He said his new version inside rerundotio now accepts time-synced sparse videos and outputs calibrated, gravity-aligned videos within reasonable error. A diagram titled exo-calib shows four input panels of uncalibrated videos with yellow stick-figure people; he explained that blue cameras mark the result after the optimization pipeline. He credits kornia-rs bundle adjustment and says more Gradio spaces are coming.

    Combined views

    8.5K

    1 Source, first seen 27d ago

    Combined views

    8.5K

    1 Source, first seen 27d ago

    81 likes
    81 likes
    2 comments
    69 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 comments
    69 saves
    7 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 Source

    @pablovelagomez1Next up, something I haven't REALLY managed to get working for a long time is synchronized, uncalibrated videos for person tracking. Whenever I used something like vggt, there was just enough residual error that it didn't work and gave crap results. I have a version now in @rerundotio that takes time-synced, but uncalibrated sparse videos -> calibrated, gravity-aligned videos within a reasonable error. Yellow cameras are basically the naive vggt cameras (actually g3t in this case), and blue ones are after running the optimization post-processing pipeline. @kornia_foss has been shipping some cool stuff recently; in particular, they have an easy-to-use bundle adjustment pipeline in rust with kornia-rs. I was trying to use pycolmap but I kept having issues with it so it was a really nice alternative. I'm going to be pumping out more huggingface @Gradio spaces soon so this will be the next one 🫡 Fable has gotten really good at making images. its a TLDR on how it works

    1 Source

    @pablovelagomez1Next up, something I haven't REALLY managed to get working for a long time is synchronized, uncalibrated videos for person tracking. Whenever I used something like vggt, there was just enough residual error that it didn't work and gave crap results. I have a version now in @rerundotio that takes time-synced, but uncalibrated sparse videos -> calibrated, gravity-aligned videos within a reasonable error. Yellow cameras are basically the naive vggt cameras (actually g3t in this case), and blue ones are after running the optimization post-processing pipeline. @kornia_foss has been shipping some cool stuff recently; in particular, they have an easy-to-use bundle adjustment pipeline in rust with kornia-rs. I was trying to use pycolmap but I kept having issues with it so it was a really nice alternative. I'm going to be pumping out more huggingface @Gradio spaces soon so this will be the next one 🫡 Fable has gotten really good at making images. its a TLDR on how it works