Anthropic Claude Computer Lets You Control an iPhone with AI
0
Anthropic announced a bunch of new updates recently, including new models. What has most people excited is computer use, which allows you to control computer applications with AI. I recently had a chance to try it in a virtual environment. I managed to get Claude to open a browser and visit my site. As it turns out, it is possible to get it outside the sandbox. This video from Mckay Wrigley shows how Claude can control an iPhone:
Anthropic computer use API + iPhone mirroring to a Mac = AI controlled phone.
Watch Claude control my phone and successfully look up stats in my Sports app.
I even got it to play a game in the Chess app against another AI – pretty crazy.
And this is the worst it’ll ever be. pic.twitter.com/35mh7T6PPs
— Mckay Wrigley (@mckaywrigley) October 23, 2024
As he explains, he got Claude to control an iPhone by mirroring it to a Mac. This AI was used to look up stats in a sports app. He also got to play a game of chess against another AI. You are going to need an API key and plenty of credits to pull something like this off. The code for this is expected to be released in the future. If you have Cursor, you can always rely on it to come up with your own custom code.
