• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Astra user reports turning a home scan into an editable 3D scene

    A user says they used roughly 400 photos of their parents’ old home as the starting point, then lowered gravity and opened a portal in the resulting scene.

    BS
    1 Source, 24d ago, first seen 24d ago

    TLDR

    A user says they ran roughly 400 photos taken in 2019 through RealityScan to create a 3D mesh of their parents’ old home. They then brought that mesh into Blender and used Astra to turn it into a cleaned-up, fully editable scene. The user calls the result good but imperfect: some errors, including problems with a bird statue’s legs and furniture contours, were inherited from the original mesh.

    Combined views

    44.1K

    1 Source, first seen 24d ago

    Combined views

    44.1K

    1 Source, first seen 24d ago

    541 likes
    541 likes
    24 comments
    344 saves
    53 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    24 comments
    344 saves
    53 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 Source

    @bilawalsidhuGave Astra a 3D scan of my parents old home to make it an editable scene. Then I turned down gravity and opened a portal. Turns out multimodal LLMs might have crossed the chasm on inverse graphics. Tremendous implications for everything from VFX and AR/VR to robotics. Process: ~400 2D photos I took in 2019 went through RealityScan and became a photogrammetry mesh. That’s the classical reconstruction step. Then I dropped that mesh into Blender and used Astra to turn it into a fully editable, cleaned up 3D scene. Asked it to use textures from my photo scan and create procedural 3D shaders for the rest. It's good but it’s definitely not perfect -- funny thing is some of the mistakes are inherited from the reference mesh RealityScan produced i.e. the bird statue’s legs, contours of the furniture etc. This is where humans still have much better “spatial autocomplete” and can take an output like this all the way. My next step will be to see if I can let it use CUA with the photoscan software to interactively reference the source pixel imagery and refine its work in Blender and get even closer to reality.

    1 Source

    @bilawalsidhuGave Astra a 3D scan of my parents old home to make it an editable scene. Then I turned down gravity and opened a portal. Turns out multimodal LLMs might have crossed the chasm on inverse graphics. Tremendous implications for everything from VFX and AR/VR to robotics. Process: ~400 2D photos I took in 2019 went through RealityScan and became a photogrammetry mesh. That’s the classical reconstruction step. Then I dropped that mesh into Blender and used Astra to turn it into a fully editable, cleaned up 3D scene. Asked it to use textures from my photo scan and create procedural 3D shaders for the rest. It's good but it’s definitely not perfect -- funny thing is some of the mistakes are inherited from the reference mesh RealityScan produced i.e. the bird statue’s legs, contours of the furniture etc. This is where humans still have much better “spatial autocomplete” and can take an output like this all the way. My next step will be to see if I can let it use CUA with the photoscan software to interactively reference the source pixel imagery and refine its work in Blender and get even closer to reality.