UnrealAgentPlayer

UnrealAgentPlayer is a toolset designed to enable AI coding agents (such as Claude Code, Cursor, or Claude Desktop) to interact with the Unreal Editor autonomously. It consists of a C++ editor plugin and a Python MCP (Model Context Protocol) server, allowing agents to execute a full cycle of editing, compiling, playing, and verifying changes without human intervention. Key capabilities include: - PIE Control: Start, stop, pause, and resume Play-In-Editor sessions. - Input Injection: Inject keyboard, mouse, gamepad, and VR controller inputs directly into the game viewport, independent of window focus. - Observation: Capture logs with filtering, read on-screen UMG UI text, and take viewport screenshots. - Introspection: Find actors, get/set properties, and execute arbitrary Python editor scripts or console commands. - Performance Tracking: Read real-time draw/GPU timings and save/compare performance baselines to detect regressions. - Testing Framework: Auto-discover project-specific Blueprint/C++ test helpers and generate detailed HTML run reports. - Editor Automation: Drive native editor menus via Windows UIAutomation. The system supports Unreal Engine 5.6, 5.7, and 5.8 (including the Meta 5.7 fork) on Windows. It utilizes Remote Control HTTP and Python Remote Execution for communication between the MCP server and the editor.