Skip to main content
Devin has access to a full Linux desktop environment — not just a browser. It can move the mouse, click on UI elements, type on the keyboard, take screenshots, and interact with any application that runs on a Linux desktop. This capability is called Computer Use, and it allows Devin to test and interact with your software the same way a human would.

​
What Is Computer Use?

Computer Use gives Devin direct access to a graphical desktop environment with a mouse and keyboard. This goes beyond browser automation — Devin can interact with any application that renders on screen, including:
  • Web applications in Chrome (clicking buttons, filling forms, navigating pages)
  • Desktop applications that run on Linux (Electron apps, native GUIs, IDEs)
  • Terminal-based UIs (TUI programs, interactive CLIs)
  • Any visual interface that can be displayed on the desktop
Devin sees the screen as a 1024×768 pixel display and can perform actions like clicking, typing, scrolling, dragging, and taking screenshots — just like a human sitting at the computer.

​
How to Enable It

Computer Use is controlled by the Desktop mode setting in your organization’s customization options.
  1. Go to Settings > Customization
  2. Find the Enable desktop mode toggle
  3. Enable it
Once enabled, Devin will use its desktop environment during sessions — particularly during testing workflows where it needs to interact with your application’s UI.
Desktop mode is available on all plans. Only organization admins can change this setting.

​
When Computer Use Runs

Once Desktop mode is enabled, Computer Use is available in every session. There are three ways it gets used:

​
After creating a PR

When Devin creates a PR, it offers a Test the app button. Clicking it triggers the full testing workflow — Devin starts your app, uses Computer Use to interact with the desktop, tests the changes, and sends you a recording.
Test the app button

​
On request during a session

You can ask Devin to test at any point during a session — no special syntax needed, just natural language. For example:
  • “Test the changes you just made and send me a recording”
  • “Open the app in the browser and verify the login page works”
  • “Launch the desktop app and check that the new menu item appears”

​
Autonomously when appropriate

Devin decides on its own when desktop interaction is the right tool for the job. If a task involves clicking UI elements, navigating an app, filling out forms, or visually verifying something, Devin will use Computer Use without being explicitly asked. You don’t need to tell Devin how to interact with the screen — just tell it what to accomplish.

​
What Devin Can Do with Computer Use

​
Test web applications end-to-end

Devin can start your app locally, open it in Chrome, and click through entire user flows — login, navigation, form submission, checkout — verifying that everything works as expected.

​
Test desktop applications

Any application that runs on Linux can be tested. Devin can launch the app, interact with its GUI, and verify behavior. This includes Electron apps, Java Swing/AWT applications, GTK/Qt apps, and more.

​
Visual verification

Devin can take screenshots at specific points during testing to verify that layouts, styling, and UI elements look correct. It can compare what it sees on screen against expected behavior and flag visual issues.

​
Interact with complex UI flows

Some testing scenarios require multi-step GUI interactions that go beyond simple API calls or browser automation — things like drag-and-drop, context menus, keyboard shortcuts, or navigating between multiple windows. Computer Use handles all of these.

​
Record testing sessions

Devin can record its screen while testing, annotating key moments in the video. The recording is then processed and sent to you so you can watch Devin interact with your app and confirm the changes work. See Testing & Video Recordings for full details on the recording workflow.

​
How Computer Use Works

When Devin uses Computer Use during a session, it follows this process:
  1. Takes a screenshot of the current screen to understand what’s visible
  2. Identifies interactive elements — buttons, text fields, menus, links — and decides what to interact with
  3. Performs an action — clicks, types, scrolls, or uses keyboard shortcuts
  4. Waits and observes — takes another screenshot to see the result of the action
  5. Repeats until the task is complete
This screenshot-action loop allows Devin to adapt to whatever is on screen, handling dynamic content, loading states, pop-ups, and unexpected dialogs just like a human would.

​
Computer Use and Testing

Computer Use is the foundation of Devin’s testing and recording workflow. When Devin tests your application after creating a PR:
  1. Setup — Devin installs dependencies, starts your app, and prepares the environment
  2. Test planning — Devin reads the diff and creates a focused test plan
  3. Execution via Computer Use — Devin uses its desktop to interact with your app, following the test plan step by step
  4. Recording — The entire process is captured on video with annotations, then sent to you for review
The key difference between Computer Use and the Testing & Recordings workflow is scope: Computer Use is the underlying capability (desktop interaction), while Testing & Recordings is the structured workflow that uses Computer Use to test your PRs and deliver video proof.

​
Tips for Getting the Best Results

Be specific about what to test

  • “Open the app, click the Settings button in the top-right, toggle dark mode, and verify all text remains readable”
  • “Launch the Electron app, create a new document, type some text, and verify it saves when you close the window”

Tell Devin what success looks like

  • “The dashboard should show three charts with no error messages”
  • “After submitting the form, a green success banner should appear at the top of the page”

​
Pre-configure access

If your app requires authentication, set up secrets ahead of time so Devin can log in without asking you during the session. Complete Repo Setup to ensure Devin can install dependencies and start your app without issues.

​
Create testing skills

For apps you test frequently, create a Skill that tells Devin exactly how to set up and test your application. This saves time on repeated sessions and ensures consistent testing. See Testing & Video Recordings — Skill Suggestions for examples.

​
Troubleshooting

​
Devin can’t find a UI element

If Devin is unable to locate a button or element on screen, try being more specific in your instructions — describe the element’s location, label, or surrounding context. For example, “click the blue Save button at the bottom-right of the modal” is better than “click Save.”

​
The app doesn’t render on Devin’s desktop

Devin runs a Linux environment. If your application only runs on macOS or Windows, it won’t be available for desktop testing. Web applications work regardless of platform since they run in Chrome. For desktop apps, ensure they have a Linux build.

​
Devin is clicking the wrong things

If Devin is misinteracting with your UI, provide a Skill or Knowledge entry with specific navigation instructions for your app. Describing the exact steps (“click the hamburger menu in the top-left, then click Settings in the dropdown”) reduces ambiguity.