Skip to main content

Desktop Application Automation

Click, type, get text from desktop elements; launch/terminate apps (Windows only)

ActivityWhat it does
Check Element ExistsChecks if a desktop element exists on desktop. If it does, the output will be true; otherwise, it will be false.
Collapse ElementCollapses a tree node, dropdown or menu via the UIA ExpandCollapsePattern (Windows only). No-op if the element is alread
Copy to ClipboardWrites plain text to the operating system clipboard. Overwrites any existing clipboard contents.
Double ClickDouble clicks on a specified desktop element.
Expand ElementExpands a tree node, dropdown or menu via the UIA ExpandCollapsePattern (Windows only). No-op if the element is already
Get ChildrenTargets a specified desktop element and gets the children from it (Windows only).
Get Desktop Table Row (by index)Returns all cells in a single grid / table row as a JSON array of strings (Windows only). Useful when the column count i
Get Desktop Table Rows (all)Returns every cell in the grid / table as a JSON 2-D array — one inner array per row, one string per cell (Windows only)
Get DetailsTargets a specified desktop element and gets the details from it (Windows only).
Get Element ValueReads the value of a text input, combobox or range element via the UIA ValuePattern (Windows only). Complements 'Get Tex
Get Selected ItemReads the currently selected item from a combobox, list or tree via the UIA SelectionPattern (Windows only). Returns the
Get Table CellReads the value of a single grid / table cell at the given row and column (0-based) via the UIA GridPattern (Windows onl
Get Table Cell By HeadersReads the value of a grid / table cell at the intersection of the given row-header and column-header text (Windows only)
Get Table Column CountReturns the number of columns in a grid / table via the UIA GridPattern (Windows only).
Get Table Column HeadersReturns the column header names of a grid / table as a JSON array of strings (Windows only). Uses the UIA TablePattern;
Get Table Row CountReturns the number of rows in a grid / table via the UIA GridPattern (Windows only).
Get TextTargets a specified desktop element and gets the text from it (Windows only).
Get Toggle StateReads the current state of a checkbox, radio button or toggle button (Windows only). Uses the UIA TogglePattern; returns
HoverHovers over a specified desktop element.
Keyboard InputTargets a specified desktop element and sends a keyboard input to it.
Launch ApplicationLaunch/start/run an external application or program from a specified file path and capture its process ID.
Left ClickClicks on a specified desktop element.
Mouse DragTargets a specified desktop element and drags it.
Read ClipboardReads the current plain text contents of the operating system clipboard.
Right ClickRight clicks on a specified desktop element.
ScrollScrolls a specified desktop element.
Scroll Into ViewScrolls a list / grid item into the visible viewport via the UIA ScrollItemPattern (Windows only). Useful before clickin
Select Combobox ItemSelects an item by visible text in a combobox or list (Windows only). Expands the combobox if collapsed and uses the UIA
Set Input ValueSets the value of a text input or editable combobox. Uses the UIA ValuePattern when possible (instant, off-screen safe);
Set Table Cell ValueSets the value of a grid / table cell at the given row and column (0-based) via the UIA ValuePattern (Windows only). Som
Set Table Cell Value By HeadersSets the value of a grid / table cell at the intersection of the given row-header and column-header text (Windows only).
Take Desktop ScreenshotCaptures a full-page screenshot of the desktop and saves it to a specified directory. The screenshot can be named option
Take Element ScreenshotCaptures a screenshot of a desktop element and saves it to a specified directory.
Terminate ApplicationStop/terminate/kill a running application process using its process ID (PID) or process name.
Toggle ElementFlips the state of a checkbox / radio / toggle button via the UIA TogglePattern (Windows only). Cleaner than a coordinat