AI Services Market
AI Services Market › Use cases › Games & Simulations
Games & SimulationsDone with Gemini Aug 20, 2026

Play a mobile game round on Android by screen control

The poster says Gemini computer use on Android played a round of Fire Emblem Heroes by reading the screen and moving characters to fight. · Aug 20, 2026

Play a mobile game round on Android by screen control preview
What They Did
The poster built an Android app in AI Studio to give Gemini tool use on the phone: it could open apps, tap and swipe the screen, and interact with XML UI elements. With that setup, Gemini 3.7 Flash read the Fire Emblem Heroes screen, recognized the turn-based state, and moved the poster's strong characters through a round on its own.
How It Went
It completed a round, which the poster says earlier Gemini 3.6 could not do and instead tapped around menus before giving up. The poster says the play was not optimal, simple tasks still took a minute or two, and the behavior was inconsistent.
Worth Knowing
The clearest catch is speed and reliability: even simple tasks took a minute or two, and the poster says the computer-use behavior was still inconsistent.
Try it yourself with Gemini

Use computer use on my Android phone to open [mobile game] and play one round of [mode or level]. Read the screen each turn, move my characters sensibly toward [goal, e.g. winning the battle], and don't spend money or make in-app purchases. Stop when the round ends and tell me the result and the moves that mattered most.

Read the original ↗