Keyboard & Mouse

Keyboard

browser_press_key

Press a key on the keyboard. The key is pressed on the page, not on a specific element — focus the element first (for example with browser_click) if it matters.

Parameter	Type	Required	Description
key	string	yes	Name of the key to press or a character to generate, such as ArrowLeft or a

Common keys: Enter, Tab, Escape, Backspace, Delete, ArrowUp, ArrowDown, ArrowLeft, ArrowRight, Home, End, PageUp, PageDown

Key combinations: Control+a, Control+c, Control+v, Shift+Tab, Alt+F4

→ browser_press_key { key: "Enter" }         // submit form
→ browser_press_key { key: "Tab" }           // move to next field
→ browser_press_key { key: "Escape" }        // close modal
→ browser_press_key { key: "Control+a" }     // select all text
→ browser_press_key { key: "ArrowDown" }     // navigate dropdown

browser_type

Type text into an element. See Forms for details.

To type key by key rather than filling the whole value at once, use browser_type with slowly: true.

Mouse (Vision mode)

These tools are available when the vision capability is enabled (--caps=vision). They use pixel coordinates from screenshots rather than element refs from snapshots.

browser_mouse_move_xy

Parameter	Type	Required	Description
x	number	yes	X coordinate
y	number	yes	Y coordinate

browser_mouse_down / browser_mouse_up

Press or release a mouse button at the current position.

Parameter	Type	Required	Description
button	string	no	left (default), right, or middle

browser_mouse_wheel

Parameter	Type	Required	Description
deltaX	number	no	Horizontal scroll, defaults to 0
deltaY	number	no	Vertical scroll, defaults to 0 (positive = down)

browser_mouse_click_xy

Click at specific coordinates without needing to move first.

Parameter	Type	Required	Description
x	number	yes	X coordinate
y	number	yes	Y coordinate
button	string	no	left (default), right, or middle
clickCount	number	no	Number of clicks, defaults to 1
delay	number	no	Time between mouse down and mouse up in milliseconds, defaults to 0

→ browser_mouse_click_xy { x: 150, y: 300 }
→ browser_mouse_click_xy { x: 150, y: 300, clickCount: 2 }  // double-click

browser_mouse_drag_xy

Drag the left mouse button from one position to another.

Parameter	Type	Required	Description
startX	number	yes	Start X coordinate
startY	number	yes	Start Y coordinate
endX	number	yes	End X coordinate
endY	number	yes	End Y coordinate

→ browser_mouse_drag_xy { startX: 100, startY: 200, endX: 400, endY: 200 }

tip

Pass boxes: true to browser_snapshot (or start the server with --snapshot-boxes) to get each element's [box=x,y,width,height] in the snapshot. That gives coordinates without a screenshot round-trip.

When to use mouse tools

Scenario	Use
Clicking a button, link, or form element	browser_click with a ref (default)
Canvas-based apps (drawing, maps)	Mouse tools with vision
Custom UI controls without accessibility	Mouse tools with vision
Drag interactions on pixel-precise targets	Mouse tools with vision

For most web applications, refs from accessibility snapshots are more reliable than coordinates. Use mouse tools only when the accessibility tree doesn't expose the elements you need.