mait.sh1.142.0

Private beta: features and content may change. No warranty; use at your own risk.

MCP RDP

Lets your agent see and drive a remote desktop, and record what happens on it with picture and sound together.

Start here: what it does, why use it, and how it fits.

Beta
What it does

Eyes, hands and ears on any remote desktop.

Some programs can only be used by looking at the screen and clicking. MCP RDP gives your agent exactly that on a remote desktop: it can see the screen, move the pointer, type, press keys, and record a video of the desktop with the sound it plays.

It works with Windows machines, GNOME desktops and the private desktops that MCP XSession creates for your agent. So the agent can check what an application really shows, and bring back proof.

Your agentDesktophelperRemotedesktopPicture andsound1asks2drives3recordsYour agentDesktop helperRemote desktopPicture and sound1asks2drives3records
  1. Step 1: Your agent asks Desktop helper.
  2. Step 2: Desktop helper drives Remote desktop.
  3. Step 3: Remote desktop records Picture and sound.
A desktop seen through mcp-rdp: a Chromium window open on a small test page, on a private mcp-xsession desktop
A real capture: the first screenshot of a 1280 by 720 desktop, with a Chromium window on a small test page.
A real condensed recording, 19.7 seconds long, with the machine's sound: the agent types a note in Notepad and plays a system alarm.
Why use it

What you gain over scripting each application.

An agent that can only use an application's own interface cannot check what a person would see. With a real picture of the desktop and real input, it can work with any program and show what happened.

Usability

Any application, no integration

Nothing to write or maintain for each application

Typical alternative
A separate automation script for each program
Here
The agent looks at the screen and uses the pointer and keyboard, so it can drive whatever a person can
Usability

One approach for many desktops

The agent learns one way of working and uses it everywhere

Typical alternative
A different remote tool for each operating system
Here
Windows, GNOME and agent-owned desktops are all reached the same way, with settings tuned for each
Reliability

Picture and sound together

You get evidence of what happened, not only a claim

Typical alternative
Silent recordings, or screenshots only
Here
One video file carries the desktop's sound, and you are told whether any sound was captured
Experience

Hearing and speaking

The agent can test what an application plays and what it listens to

Typical alternative
No sound at all
Here
The agent can save what the desktop plays and send a prepared audio file into its microphone
Speed

Recordings that are quick to review

Reviewing a long run takes minutes, not the length of the run

Typical alternative
Hours of video to scrub through
Here
A condensed mode keeps the moments where the screen changes and adds a screenshot and a note for each
Security

Passwords stay out of the chat

Secrets are not repeated through the conversation

Typical alternative
Credentials typed into every request
Here
An account is prepared once on the server, and requests only name it
Out of the box

Ready in the image, one command to start.

The service comes with the MAIT image and updates with it (mait-image). Each connection belongs to the conversation that opened it.

It needs no setup of its own, only a desktop to connect to. It does not create a desktop, switch remote access on or make an account. For a Linux desktop of the agent's own, ask MCP XSession; for a Windows or GNOME machine, use a host and account you are approved to use, ideally prepared once on the server.

You can also place it behind MCP Registry, so one entry in your agent's app reaches it.

Where it fits

Where it sits in the MAIT toolkit.

It is the screen, keyboard and speakers for your agent, and it pairs with a desktop provider.

Installed bymait-image ships the service
Used withMCP XSession for a desktop of the agent's own, MCP Registry to reach it from one entry in your agent's app
Alternative toMCP VNC when the desktop speaks VNC instead of RDP; only RDP carries sound
Learn more

Where to read on.