claude-in-mobile（Claude IN mobile 搜索）

claude-in-mobile CLI

Fast CLI for mobile device automation across Android (via ADB), iOS (via simctl), Aurora OS (via audb), and Desktop (via companion JSON-RPC app).

Binary: claude-in-mobile (ensure it's in PATH or use full path to the built binary).

Common Flags

Most commands accept platform-specific device selectors:

Commands Reference

devices

List connected devices across platforms.

claude-in-mobile devices              # All platforms
claude-in-mobile devices android      # Android only
claude-in-mobile devices ios          # iOS simulators only
claude-in-mobile devices aurora       # Aurora devices only

Platforms: Android, iOS, Aurora

screenshot

Capture a screenshot. Outputs base64 to stdout by default, or save to file with -o.

claude-in-mobile screenshot android
claude-in-mobile screenshot ios
claude-in-mobile screenshot aurora
claude-in-mobile screenshot desktop --companion-path /path/to/companion

# Save to file
claude-in-mobile screenshot android -o screen.png

# Compress for LLM (resize + JPEG quality reduction)
claude-in-mobile screenshot android --compress --max-width 800 --quality 60

Platforms: Android, iOS, Aurora, Desktop

annotate

Capture screenshot with UI element bounding boxes drawn over it. Useful for visual debugging and identifying tap targets.

claude-in-mobile annotate android -o annotated.png
claude-in-mobile annotate ios -o annotated.png

Platforms: Android, iOS

analyze-screen

Parse current screen and return categorized interactive elements as structured JSON. Groups elements into buttons, inputs, texts, etc. Useful for automated test flows.

claude-in-mobile analyze-screen
claude-in-mobile analyze-screen --device emulator-5554

Platforms: Android only

screen-size

Get screen resolution in pixels.

claude-in-mobile screen-size android
claude-in-mobile screen-size ios

Platforms: Android, iOS

tap

Tap at exact coordinates, or by text/resource-id/index.

# By coordinates
claude-in-mobile tap android 500 800
claude-in-mobile tap ios 200 400
claude-in-mobile tap aurora 300 600
claude-in-mobile tap desktop 100 200 --companion-path /path/to/companion

# By text (searches UI tree, finds element, taps center)
claude-in-mobile tap android 0 0 --text "Login"
claude-in-mobile tap desktop 0 0 --text "Submit" --companion-path /path/to/companion

# By resource-id (Android)
claude-in-mobile tap android 0 0 --resource-id "btn_login"

# By element index from ui-dump (Android)
claude-in-mobile tap android 0 0 --index 5

Platforms: Android, iOS, Aurora, Desktop

tap-text

Find an element by text, resource-id, or content-desc in the UI hierarchy and tap it. Shortcut for find + tap.

claude-in-mobile tap-text android "Submit"
claude-in-mobile tap-text ios "Login"

Platforms: Android, iOS

find

Search UI hierarchy for an element by text, resource-id, or content-desc. Returns element coordinates and bounds.

claude-in-mobile find android "Login"
claude-in-mobile find ios "Submit"

Platforms: Android, iOS

find-and-tap

Fuzzy-match an element by description and tap it. Uses confidence scoring for inexact matches.

claude-in-mobile find-and-tap "Submit Order" --min-confidence 50
claude-in-mobile find-and-tap "Cancel" --min-confidence 30

Platforms: Android only

long-press

Long press at coordinates or by text. Duration configurable in milliseconds.

# By coordinates
claude-in-mobile long-press android 500 800 -d 2000
claude-in-mobile long-press ios 300 600
claude-in-mobile long-press aurora 400 700

# By text (Android: finds element, long presses at center)
claude-in-mobile long-press android 0 0 --text "Delete"

Platforms: Android, iOS, Aurora

swipe

Swipe gesture between coordinates, or by named direction (up/down/left/right).

# By coordinates (x1 y1 x2 y2)
claude-in-mobile swipe android 500 1500 500 500 -d 300

# By direction (uses screen center, swipes 400px)
claude-in-mobile swipe android 0 0 0 0 --direction up
claude-in-mobile swipe ios 0 0 0 0 --direction left
claude-in-mobile swipe aurora 0 0 0 0 --direction down

Platforms: Android, iOS, Aurora

input

Type text into the currently focused field.

claude-in-mobile input android "Hello world"
claude-in-mobile input ios "Search query"
claude-in-mobile input aurora "user@example.com"
claude-in-mobile input desktop "text" --companion-path /path/to/companion

Platforms: Android, iOS, Aurora, Desktop

key

Press a hardware/software key or button.

claude-in-mobile key android back
claude-in-mobile key android home
claude-in-mobile key android enter
claude-in-mobile key android power
claude-in-mobile key ios home
claude-in-mobile key aurora back
claude-in-mobile key desktop enter --companion-path /path/to/companion

Common keys: home, back, enter, power, volume_up, volume_down, tab, delete.

Platforms: Android, iOS, Aurora, Desktop

ui-dump

Dump the current UI hierarchy. Default format is JSON; also supports XML for Android.

claude-in-mobile ui-dump android
claude-in-mobile ui-dump android -f xml
claude-in-mobile ui-dump ios
claude-in-mobile ui-dump desktop --companion-path /path/to/companion

Platforms: Android, iOS, Desktop

apps

List installed applications, optionally filtered by name.

claude-in-mobile apps android
claude-in-mobile apps android -f "myapp"
claude-in-mobile apps ios
claude-in-mobile apps aurora

Platforms: Android, iOS, Aurora

launch

Launch an application by package name, bundle ID, or path.

claude-in-mobile launch android com.example.app
claude-in-mobile launch ios com.example.app
claude-in-mobile launch aurora harbour-myapp
claude-in-mobile launch desktop /path/to/app --companion-path /path/to/companion

Platforms: Android, iOS, Aurora, Desktop

stop

Force-stop/kill an application.

claude-in-mobile stop android com.example.app
claude-in-mobile stop ios com.example.app
claude-in-mobile stop aurora harbour-myapp
claude-in-mobile stop desktop "AppName" --companion-path /path/to/companion

Platforms: Android, iOS, Aurora, Desktop

install

Install an application package onto the device.

claude-in-mobile install android /path/to/app.apk
claude-in-mobile install ios /path/to/app.app
claude-in-mobile install aurora /path/to/app.rpm

Platforms: Android, iOS, Aurora

uninstall

Remove an installed application from the device.

claude-in-mobile uninstall android com.example.app
claude-in-mobile uninstall ios com.example.app
claude-in-mobile uninstall aurora harbour-myapp

Platforms: Android, iOS, Aurora

push-file

Copy a local file to the device filesystem.

claude-in-mobile push-file android /local/path /sdcard/remote/path
claude-in-mobile push-file aurora /local/file /home/user/file

Platforms: Android, Aurora

pull-file

Copy a file from device filesystem to local machine.

claude-in-mobile pull-file android /sdcard/remote/file /local/path
claude-in-mobile pull-file aurora /home/user/file /local/file

Platforms: Android, Aurora

get-clipboard

Read current clipboard content from the device.

claude-in-mobile get-clipboard android
claude-in-mobile get-clipboard ios
claude-in-mobile get-clipboard desktop --companion-path /path/to/companion

Platforms: Android, iOS, Desktop

set-clipboard

Set clipboard content on the device.

claude-in-mobile set-clipboard android "copied text"
claude-in-mobile set-clipboard ios "copied text"
claude-in-mobile set-clipboard desktop "text" --companion-path /path/to/companion

Platforms: Android, iOS, Desktop

logs

Retrieve device logs. Supports line limit and filtering.

claude-in-mobile logs android -l 50
claude-in-mobile logs android -f "MyTag"
claude-in-mobile logs ios -l 200
claude-in-mobile logs aurora -l 100

Platforms: Android, iOS, Aurora

clear-logs

Clear all device logs.

claude-in-mobile clear-logs android
claude-in-mobile clear-logs ios
claude-in-mobile clear-logs aurora

Platforms: Android, iOS, Aurora

system-info

Get device system information (battery, memory, OS version, etc.).

claude-in-mobile system-info android
claude-in-mobile system-info ios
claude-in-mobile system-info aurora

Platforms: Android, iOS, Aurora

current-activity

Get the currently displayed activity or foreground app.

claude-in-mobile current-activity android
claude-in-mobile current-activity ios

Platforms: Android, iOS

reboot

Reboot the device or restart the simulator.

claude-in-mobile reboot android
claude-in-mobile reboot ios

Platforms: Android, iOS

screen

Control screen power state (turn display on/off).

claude-in-mobile screen on
claude-in-mobile screen off

Platforms: Android only

open-url

Open a URL in the device's default browser.

claude-in-mobile open-url android "https://example.com"
claude-in-mobile open-url ios "https://example.com"
claude-in-mobile open-url aurora "https://example.com"

Platforms: Android, iOS, Aurora

shell

Execute an arbitrary shell command on the device.

claude-in-mobile shell android "ls /sdcard"
claude-in-mobile shell ios "ls ~/Documents"
claude-in-mobile shell aurora "uname -a"

Platforms: Android, iOS, Aurora

wait

Pause execution for a specified duration. Useful in automation scripts between actions.

claude-in-mobile wait 2000    # wait 2 seconds
claude-in-mobile wait 500     # wait 500ms

Platforms: cross-platform (no device interaction)

get-window-info

List all open desktop windows with their IDs, titles, positions, and sizes.

claude-in-mobile get-window-info --companion-path /path/to/companion

Platforms: Desktop only

focus-window

Bring a desktop window to front by its ID (from get-window-info).

claude-in-mobile focus-window "window-id" --companion-path /path/to/companion

Platforms: Desktop only

resize-window

Resize a desktop window to specified width and height.

claude-in-mobile resize-window "window-id" 800 600 --companion-path /path/to/companion

Platforms: Desktop only

launch-desktop-app

Launch a desktop application by path.

claude-in-mobile launch-desktop-app /path/to/app --companion-path /path/to/companion

Platforms: Desktop only

stop-desktop-app

Stop a running desktop application by name.

claude-in-mobile stop-desktop-app "AppName" --companion-path /path/to/companion

Platforms: Desktop only

get-performance-metrics

Get CPU/memory usage metrics for running desktop applications.

claude-in-mobile get-performance-metrics --companion-path /path/to/companion

Platforms: Desktop only

get-monitors

List connected monitors with resolutions and positions.

claude-in-mobile get-monitors --companion-path /path/to/companion

Platforms: Desktop only

Additional Resources

For full platform support matrix and per-platform details (backends, supported/unsupported commands), see references/platform-support.md.

Tips

• Use --compress on screenshots when sending to LLM — reduces token usage significantly
• analyze-screen gives structured JSON of buttons/inputs/texts — useful for automated testing
• find-and-tap uses fuzzy matching with confidence scoring — good for flaky element names
• Aurora commands use audb (Aurora Debug Bridge) — similar to ADB
• Desktop commands communicate via JSON-RPC with a companion app over stdin/stdout
• Combine ui-dump + tap --index N for reliable element interaction by index
• Use wait between actions in automation scripts to allow UI transitions