Android · Reference
Controlling a Phone Hands-Free
Voice control, switch access and gesture control are built in and free. What each one is for, and how far they actually go.
Both major mobile platforms include comprehensive alternative input methods. They were built for people who cannot use a touchscreen, and several are useful to anyone with their hands full.
Voice control
Full device control by voice is available on both platforms, and it goes considerably beyond a voice assistant.
iOS Voice Control — Settings, Accessibility, Voice Control. Once enabled, you can say "open Messages", "tap send", "scroll down", "go back". Saying "show numbers" overlays a number on every tappable element so you can say a number instead of naming a control. "Show grid" divides the screen into a numbered grid for precise positioning.
It works entirely on the device and does not require a connection.
Android Voice Access — a separate application from Google, enabled in Accessibility settings. It works the same way, with numbered overlays and grid positioning.
Both allow custom commands, so a frequent sequence becomes one phrase.
Beyond accessibility: cooking, working on a car, holding a baby, or any situation where your hands are occupied.
Face and head gestures
Android's Camera Switches — Settings, Accessibility, Switch Access, then camera switches. The front camera detects facial gestures: open mouth, smile, raise eyebrows, look left, look right, look up. Each can be assigned an action.
Someone with very limited movement can navigate an entire phone this way.
iOS Head Tracking on supported devices moves a pointer with head movement, with dwell selection.
Practical setup: two gestures are usually enough to start — one to move the selection, one to activate — and more can be added as it becomes familiar.
Switch access
For anyone using a physical switch — a button, a sip-and-puff device, a head switch.
Both platforms support external switches over Bluetooth or USB, and can also use the device's own volume buttons as switches.
Scanning moves a highlight through interface elements automatically; the user activates the switch when the desired element is highlighted. Timing is adjustable, which matters enormously for usability.
Point scanning moves a crosshair across the screen instead, for interfaces that do not expose their elements well.
Assistive touch and gesture replacement
iOS AssistiveTouch puts a floating button on screen that provides gestures — pinch, rotate, multi-finger taps, and hardware button functions — through a menu. Essential for anyone who cannot perform multi-touch gestures or press physical buttons.
It also supports pointer devices, so a mouse or trackpad can control an iPhone.
Android supports mice and keyboards over Bluetooth or USB, and the accessibility menu provides a similar on-screen control panel.
Dwell control
For pointer users who cannot click: the pointer resting in one place for a set time counts as a tap. Available on both platforms, with adjustable timing.
Combined with head tracking, this allows full control with head movement alone.
Making it practical
The accessibility shortcut is what turns these from a settings page into something usable. Both platforms allow a triple-press of the side or home button to toggle a chosen feature.
Set this up, or the feature will be buried when it is needed.
Combine features. Voice control for navigation with switch access as a fallback, for example. They coexist.
Adjust the timing. Default scanning and dwell speeds suit nobody in particular. Time spent tuning these is the difference between frustrating and usable.
Practise before you need it. If you are setting a phone up for someone else, sit with them and go through common tasks together.
Related settings worth knowing
Touch and hold delay adjustment, for tremor or slower movement.
Ignore repeated touches, which filters accidental double-taps.
Touch accommodations on iOS, which change how the system interprets a touch — useful for tremor.
Reachability for one-handed use on large phones.
Interaction control on Android, which disables parts of the screen or specific hardware buttons — useful for a phone handed to a child, or for someone who triggers controls accidentally.
Where to find it all
Android: Settings, Accessibility. Interaction controls and the Switch Access section.
iOS: Settings, Accessibility. Physical and Motor section.
Both platforms have improved this area substantially in recent years, and almost none of it is discoverable without going and looking. If you are helping someone who is struggling with a phone, an hour in these settings is likely to be the most useful hour you spend.
Mistakes people make
Not knowing it exists. Full voice control, face gestures, switch access and head tracking are all built in and free, and almost none of it is discoverable without going to look.
Confusing voice control with a voice assistant. Voice Control and Voice Access navigate the entire interface — "show numbers" puts a number on every tappable element.
Leaving default timings. Scanning and dwell speeds suit nobody in particular, and tuning them is the difference between frustrating and usable.
Not setting the accessibility shortcut. A feature three menus deep will not be used when it is needed.
Setting it up for someone without them. Sit together and work through the tasks they actually do.
The short answer
Android: Settings, Accessibility, then Voice Access and Switch Access with camera switches. iOS: Settings, Accessibility, then Voice Control, AssistiveTouch and Head Tracking. Set the triple-press shortcut, then spend twenty minutes tuning the timing.