Generate and edit Draw.io, Mermaid, and Excalidraw diagrams from natural language using a structured JSON spec.
Integrations
Smseow Peekaboo
Try it(Simon专属) 桌面控制 skill - AI 操控电脑。macOS 用 Peekaboo,Linux 用 MCP 工具。
What it does
桌面控制 (Desktop Control) AI 操控电脑 - macOS / Linux / WSL2
The skill document
桌面控制 (Desktop Control)
AI 操控电脑 - macOS / Linux / WSL2
概述
让 AI 能"看"屏幕、"动"桌面。
| 系统 | 工具 | GitHub |
|---|---|---|
| macOS 15+ | Peekaboo | openclaw/Peekaboo |
| Linux | Ubuntu Desktop Control MCP | charettep/... |
| WSL2 | python-xlib + X server | - |
触发词
桌面控制 / 操控电脑 / 截屏 / desktop
🖥️ macOS (Peekaboo)
安装
npx -y @steipete/peekaboo
# 授权
peekaboo permissions grant
命令
# 截图
peekaboo image --mode screen
# 点击
peekaboo click --on "按钮文字"
# 输入
peekaboo type --text "内容"
# 快捷键
peekaboo hotkey cmd,c
🐧 Linux (桌面 MCP)
方案1: Ubuntu Desktop Control MCP
# 安装
pip install mcp-desktop-control
# 运行
mcp-desktop-control
方案2: mcp-desktop-pro (跨平台)
# 安装运行
npx -y mcp-desktop-pro serve
# 截图
# mcp-desktop-pro screenshot
# 点击
# mcp-desktop-pro click --x 100 --y 200
方案3: kwin-mcp (KDE Wayland)
git clone https://github.com/bhyoo/kwin-mcp
cd kwin-mcp
python kwin-mcp.py
💻 WSL2 方案
1. 安装 X server (Windows)
下载安装 VcXsrv
2. WSL2 配置
# .bashrc 添加
export DISPLAY=localhost:0
# 安装依赖
sudo apt install python3-xlib flameshot scrot
3. Python 自动化
from pymouse import PyMouse
from pykeyboard import PyKeyboard
m = PyMouse()
k = PyKeyboard()
# 点击
m.click(100, 200)
# 输入
k.type_string("Hello")
# 快捷键
k.press_key('ctrl')
k.tap_key('c')
k.release_key('ctrl')
使用示例
macOS
你说:打开Safari去openclaw官网
我 → peekaboo app launch Safari
→ peekaboo type --text "openclaw.ai"
→ peekaboo press return
Linux
你说:截个图
我 → mcp-desktop-control screenshot
WSL2
你说:点击这个按钮
我 → 用坐标点击
注意事项
- ⚠️ macOS 需要 15+,授权辅助功能
- ⚠️ Linux 需要 X server 或 Wayland
- ⚠️ WSL2 需要 VcXsrv
桌面控制 | AI 操控电脑
Related skills
Join a video meeting as an AI bot with voice, avatar, and screenshare across four operating modes.
Stores durable facts in a categorized, plain-markdown vault on disk, alongside your agent's built-in memory.
Fetch raw ad creative, app, ranking, and revenue data from AdMapix as structured JSON.
Find why your productivity system keeps failing, then apply the smallest fix — capacity math, bottleneck routing, durable local notes.
Write, debug, and tune Playwright specs with locator strategy, trace diagnosis, and CI-aware timeouts.
More from smseow001
Browse all skillsAI architecture diagram generator supporting Mermaid charts. Generate system architecture, cloud architecture, neural network, graph theory, flowchart, ER di...
让AI代理控制浏览器自动化网页操作。支持 Claude/GPT/Gemini/Ollama,可执行填表、购物、搜索等任务。
谷歌开源 AI 编程工作流 - 从需求到代码的快速转化。包含20个专项技能、规范开发流程、7大实战案例。
ComfyUI V8 秋叶中文版 全流程助手。提供安装检测、一键启动、工作流生成(文生图/图生图/ControlNet/InstantID等)、参数优化、故障排查、批量生成、模型管理等功能。All-in-one assistant for ComfyUI V8 (Aki bundle) with workflow...
硅谷多智能体量化交易系统 - 三级架构(研究员/分析师/交易员)+ 完整量化流程 + 新手平台推荐 + 策略指南。
将 OpenClaw 升级为 Claude-Code 引擎架构 - 并发执行/自我反思/向量检索/子代理系统/上下文压缩