I’m testing Claude’s computer-use feature on a desktop app whose window size and display scaling can change. Some controls shift position between runs, so I’m wondering how robust the interaction is when it relies on screenshots and coordinates.

Does Claude have a way to use accessibility information or another stable description of the interface, or should I design the workflow around fixed window dimensions? I’d be interested to hear what has worked for people using computer use beyond a simple browser demo.