Who it is forA person with busy hands or limited mobility who wants to finish app tasks such as shopping, settings changes or smart home controls by speaking.
The problemMany everyday tasks need several taps across apps, which is hard when hands are full or movement is limited.
The outcomeYou say or type the task, Buddy reads the screen and performs the steps, and it asks you before anything is bought, sent or deleted.
What you need first
- A 64-bit Android 11+ phone (tested on a OnePlus 12 with Android 16)
- A Claude Pro or Max plan, or a ChatGPT plan for Codex, or no plan for OpenCode's free models
- Wi-Fi for the agent installs (about 150 to 235 MB each)
- The Buddy APK from the GitHub Releases page
Steps
- Install buddy.apk and turn on Buddy assistant under Accessibility in the setup guide.
- Sign in to Claude Code or Codex, or pick OpenCode and use its free models with no account.
- Tap New chat, then tap the mic and speak a task, for example adding an item to your Amazon cart.
- When Buddy shows an Approve, Deny or Change card, check the details before tapping Approve.
- Open Settings, then Voice, and pick the recognizer you want to use for later tasks.
Prompt for your agent
Using the buddy-android repo at https://github.com/ghorbelhamdi/buddy-android, ask Buddy in a new chat to <task in one sentence>, and approve only the final step. Expected output: the task completed in the target app with a short summary in the chat. Verify that the approval card showed the exact item and quantity before you approved.
Caveat. Buddy works through the accessibility service, so tasks in apps with unusual screens may need a retry or a clearer instruction.
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer