@giffmana @teortaxesTex Again, I have trained eyeballs with simple RNNs in simulators to point around and only render a few pixels to bring down compute costs
Ahh if only SpatialTransformerNet (not a transformer lol) actually worked at scale. They are the perfect match for this in theory, and beautiful.
In practice instead we have VLMs going "hmm thinking hmmm let me use my zoom and crop tool here hmmm"
