DEDUPED Hot AI repos, turned into use cases Get 5 a day

How to start saved phone tasks from Siri or Shortcuts with Esp32 Iphone Agent

Trigger a saved agent task with a voice command or a shortcut instead of opening the app.

Authorization notice. Esp32 Iphone Agent is dual-use. Only use it on software, sites and systems you own or have explicit permission to test.

dual-use. A task started from Siri or a widget runs without a fresh prompt, so check the saved goal before you trigger it.

Who it is forA user who already runs the agent on their own iPhone and wants to start a repeated task without opening the app each time.

The problemOpening the app and typing the goal again for a routine task is slow and repetitive.

The outcomeA saved task starts from Siri, Shortcuts, a widget or Control Center, and the run appears on the Dynamic Island.

What you need first

  • An ESP32-S3 board, tested with a Seeed Studio XIAO ESP32S3 (plain version, 8 MB PSRAM)
  • An iPhone on iOS 18 or later with cellular data
  • An OpenAI-compatible vision model endpoint and API key
  • A Mac with Xcode, needed once to flash the board and build the app

Steps

  1. Finish the one-time setup in the app so the board, mirroring and AssistiveTouch are working.
  2. Save a task in the app with the goal you want to repeat.
  3. Add the saved task to Shortcuts, a widget or Control Center, as the app supports.
  4. Start the task from Siri or the chosen control.
  5. Watch the Dynamic Island and stop the run from there if it goes wrong.

Prompt for your agent

Using the repo onehumanbeing/esp32-iphone-agent, check that a saved task named <task name> can be started from Shortcuts on the iPhone at <device name>. Expected output: a yes or no with the Shortcuts action used. Verify the Dynamic Island shows the run after it starts.

Caveat. The README says these controls can run saved tasks but does not describe the exact Shortcuts setup, so follow the app screens for that step.

Share: X LinkedIn Hacker News Email Copy link

Disclaimer

Deduped lists open-source repositories that belong to other people. We do not own, maintain, audit, or vouch for any of them, and a repo appearing here is not an endorsement or a safety check. The use cases, steps, and prompts are written by AI and may be incomplete, outdated, or just wrong. Where a use case is marked "Seen in the wild", we link to public posts where someone described something similar, but we have not verified those posts and the use case itself is still our AI's own write-up. Use all of this at your own risk. Only run code, commands, or agents on systems and accounts you are authorized to use, and read the code and every command before you run it, especially anything that touches credentials, files, or the network. Nothing here is professional, security, legal, or financial advice. All trademarks and project names belong to their respective owners, and their use here does not imply affiliation. Content is provided as is, without warranties of any kind. Found a mistake, a safety problem, or something you want removed? Email [email protected] and we will look at it promptly. Full disclaimer page