DEDUPED Hot AI repos, turned into use cases Get 5 a day

What you can do with Esp32 Iphone Agent

An ESP32-S3 board that acts as an AirPlay screen mirror and USB mouse and keyboard, paired with an iPhone app that lets a vision model see and operate the phone.

Trended earlier

onehumanbeing/esp32-iphone-agent on GitHub

Third-party repos we don't own or vouch for. AI-generated use cases can be wrong: review everything and run at your own risk.

Authorization notice. This tool is dual-use. Only use it on software, sites and systems you own or have explicit permission to test, and follow the relevant licenses and terms of service.

What do you want to do?

5 use cases

  • Have an AI model complete a task on a real iPhone

    Give a plain-language goal and let a vision model tap, swipe and type on the phone until done.

    View prompt
    Using the repo onehumanbeing/esp32-iphone-agent, guide me through the four setup steps in its README for the iPhone at <device name>. Expected output: a checklist showing which of the four setup steps are complete. Verify that AssistiveTouch is on and the pointer calibration has finished before any task is started.

  • Replay and export phone agent runs for analysis

    Review each step of an agent run and export screenshots and actions for another agent to analyze.

    View prompt
    Using the repo onehumanbeing/esp32-iphone-agent, take the exported trace from <run folder> and list every step where the taps or swipes did not change the screen. Expected output: a table of step number, action and whether the screen changed. Verify that each row matches a screenshot in the trace.

  • Start saved phone tasks from Siri or Shortcuts

    Trigger a saved agent task with a voice command or a shortcut instead of opening the app.

    View prompt
    Using the repo onehumanbeing/esp32-iphone-agent, check that a saved task named <task name> can be started from Shortcuts on the iPhone at <device name>. Expected output: a yes or no with the Shortcuts action used. Verify the Dynamic Island shows the run after it starts.

  • Edit the planner and actor prompts for a custom workflow

    Change the plain-text prompts in the repo and rebuild the app to tune how the agent behaves.

    View prompt
    Using the repo onehumanbeing/esp32-iphone-agent, read the planner and actor prompts in prompts/ and propose one edit for <target app or workflow>. Expected output: the changed prompt text as a diff. Verify that the edit keeps the existing action names so the app still parses the model reply.

  • Test the ESP32 board over BLE from a Mac

    Play the app's role from a Mac to check the board's BLE link, hotspot and HID output.

    View prompt
    Using the repo onehumanbeing/esp32-iphone-agent, run hardware/tools/board_test.py against the board at <serial port> and summarize each BLE command it sends. Expected output: a list of commands with pass or fail. Verify the protocol names match docs/ble-protocol.md.

How to use Esp32 Iphone Agent

  1. Check you have what it needs: An ESP32-S3 board, tested with a Seeed Studio XIAO ESP32S3 (plain version, 8 MB PSRAM); An iPhone on iOS 18 or later with cellular data; An OpenAI-compatible vision model endpoint and API key.
  2. Open onehumanbeing/esp32-iphone-agent on GitHub and read the README and license.
  3. Install arduino-cli, the ESP32 core 3.3.x and NimBLE-Arduino 2.5.x, then run arduino-cli lib install "[email protected]".
  4. Plug the board into the Mac and run hardware/flash.sh.
  5. Run cp ios/Config/Local.xcconfig.example ios/Config/Local.xcconfig, set DEVELOPMENT_TEAM and IA_BUNDLE_ID, then run open ios/IPhoneAgent.xcodeproj and launch the IPhoneAgent scheme on the iPhone.
  6. In the app, complete setup: pair the board, join its Wi-Fi and enable Screen Mirroring to ESP32 Agent, turn on AssistiveTouch, then enter your model endpoint and key and choose a vision model.

These steps come from our top use case, Have an AI model complete a task on a real iPhone, which also has a copy-paste agent prompt.

Esp32 Iphone Agent alternatives · Best AI repos for Software and DevOps

About this repo

Requirements

  • An ESP32-S3 board, tested with a Seeed Studio XIAO ESP32S3 (plain version, 8 MB PSRAM)
  • An iPhone on iOS 18 or later with cellular data
  • An OpenAI-compatible vision model endpoint and API key
  • A Mac with Xcode, needed once to flash the board and build the app
Maintain Esp32 Iphone Agent? Add the Featured on Deduped badge

Paste this into your README:

[![Featured on Deduped](https://dedupedai.com/badge/onehumanbeing-esp32-iphone-agent.svg)](https://dedupedai.com/use-cases/onehumanbeing-esp32-iphone-agent/?ref=badge)

More badge styles and HTML

Questions about Esp32 Iphone Agent

What is Esp32 Iphone Agent?

An ESP32-S3 board that acts as an AirPlay screen mirror and USB mouse and keyboard, paired with an iPhone app that lets a vision model see and operate the phone. It is an open-source project on GitHub: https://github.com/onehumanbeing/esp32-iphone-agent.

Who is Esp32 Iphone Agent for?

Developers and automation builders who want an AI model to operate a real iPhone without a computer in the loop at run time.

What can I do with Esp32 Iphone Agent?

5 use cases so far, for example: Have an AI model complete a task on a real iPhone; Replay and export phone agent runs for analysis; Start saved phone tasks from Siri or Shortcuts. Each has steps and a copy-paste agent prompt.

What do I need to run Esp32 Iphone Agent?

An ESP32-S3 board, tested with a Seeed Studio XIAO ESP32S3 (plain version, 8 MB PSRAM); An iPhone on iOS 18 or later with cellular data; An OpenAI-compatible vision model endpoint and API key; A Mac with Xcode, needed once to flash the board and build the app.

What are alternatives to Esp32 Iphone Agent?

Other hot AI repos in Software and DevOps: Harness2, iFixAi, Orca, Diagram Design, AI Memory.

Is Esp32 Iphone Agent safe to run?

Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.