Fun weekend project: using @AIatMeta Sam3 to segment objects inside a @SpAItial_AI scene.

Pipeline: -> Generate a world on @SpAItial_AI app and export as .ply -> @playcanvas viewer to render splat + a uniform spatial grid over splat centers -> Capture frames + camera pose, POST to a local SAM3 server -> Lift each 2D mask → 3D: frustum-cull splats via the grid, reproject with the pose -> Recolor / isolate the segmented Gaussians

This is all running locally on my Mac. Static scene, segment once, reuse persisted mask.

All open source (link in comment), you can clone and build on top of this 👇🏽