Builder Recommends Dedicated Computers for AI Agents in End-to-End Testing

The best part: IT WILL CLICK ON ALL THE ANNOYING MACOS ALERTS FOR YOU

@steipete Giving the Model Full COntrol is Pretty Dangerous without sandboxing and the Context Poisoning will Catch up.

Better Way of Doing This with a Proper Control and Visibility.

Github: https://github.com/zeenie-ai/MachinaOS

@chaitanyad0208 @steipete Better Way of Doing This with a Proper Control and Visibility.

Checkout Github: https://github.com/zeenie-ai/MachinaOS

@steipete is this using crabbox? i've been diving down the rabbit hole of letting agents test better and there's so much to build it's really cool

@RhysSullivan yup. crabbox has a parallels backend even!

@chaitanyad0208 codex + computer use works amazing

@steipete i call them minions, one of them pulls the CI and the rest test it with computer-use end-to-end.

@steipete Need something like this but for mobile app testing

@steipete I was inspired by crabbox and built something similar just for developing my smart glasses openclaw client (OcuClaw) including sim. I threw together a page outlining the whole flow. I love that I can just build this level of tooling for a user base of 1. https://ocuclaw.com/fleet-control-centre.html

@steipete Why a computer?

Dulus Os solve that

@danny_salzman codex + gpt /fast

@chaitanyad0208 @steipete There is one More App which you can Pair with Machinaos through QR Scan and it gives Machinaos the Control to your Android Mobile.

Tell Machinaos to Install and Test the APP with Proper Guidelines.

Soon Opensourcing the Android Control App.

@steipete Is this on VPS? What is that screen login or where you see it?

@steipete from day one

@chaitanyad0208 @steipete Chaitanya, give Revyl another shot we released remote builds which will be very useful for a flutter app

@RohithThakurwar @steipete How will this help in mobile testing though?

@LandseerEnga @steipete What mobile testing world needs is exactly a fast and cost effective Revyl.

Happy to give it another shot.

@chaitanyad0208 @SwichLabs @steipete Use autoglm by http://z.ai it's specific model for mobile agent use

An better toolchain ecosystem makes it better

It's an model launched 2 months ago i think

https://docs.z.ai/guides/vlm/autoglm-phone-multilingual

@steipete Not really, it’s 50% there I guess but still struggles a lot with properly scrolling on iOS simulator. And then doesn’t really understand if it is the app that is stuck or it can’t scroll itself properly.

And even when it works it is super slow right now.

@__r17x @steipete Oh… ini… Boleh juga 👀