This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!
Users praise the weekend build fusing Meta Ray-Ban footage into 4D tactical replay because it makes advanced experiments feel accessible, fun, and sci-fi-like in just a weekend.
No Digg Deeper questions have been answered for this story yet.
I used fable to improve my old shot counter project from last year - ended up implementing my whole future roadmap in two nights. Pretty wild. Here’s the old project which used sound and visual cues to count and classify shots:
Used gemini 2.5 pro to build a shot counter for myself + write an after effects script to create this AR style HUD overlay.
Footage captured w/ my meta rayban glasses. Insane how much better 2.5 pro is at media understanding vs 1.5 pro (when I last tried this).
Using both video + audio to reason about hits/misses is a superpower. Can't wait till this tech can run reliably in realtime on our glasses.
@bilawalsidhu How did you get the shots and hit markers captured on the map??? Wild.
@bilawalsidhu Holy shit, this reminds me of Brain Dances from Cyberpunk 2077
@bilawalsidhu Thanks for you sharing all of these wild explorations. You help make every day an adventure!
@vaibcode Queued up a bunch of experiments last night to test out my ideas and select the right primitives. Then just a few hours today. So much fun
@bilawalsidhu how long did this take to make? I've been finding fable quite good for performance work (with steering).
@bilawalsidhu did you reconstruct the scene prior ?
@Jyunnie3102 Nope, all from the meta glasses
@bilawalsidhu The 2A community would love this shit
@Shiffo12 Hah yeah they use the point cloud aesthetic beautifully in that game! Basically a 4d replay of reality
@bilawalsidhu could raise a pretty penny on this alone these days lol
@bilawalsidhu This is amazing
@bilawalsidhu Bravooooo
@The_Don06 That was the fun part - nice mix of classical and ml. Will do another post with a proper breakdown
@andrew_holdun Mad science experiments are so much fun
@bilawalsidhu My kind of weekend project. Would've been a SIGGRAPH paper a few years ago. Today it's two pairs of glasses and a weekend. The compression curve is absurd.