Integrations

Smseow Peekaboo

Try it

(Simon专属) 桌面控制 skill - AI 操控电脑。macOS 用 Peekaboo,Linux 用 MCP 工具。

What it does

桌面控制 (Desktop Control) AI 操控电脑 - macOS / Linux / WSL2

The skill document

桌面控制 (Desktop Control)

AI 操控电脑 - macOS / Linux / WSL2


概述

让 AI 能"看"屏幕、"动"桌面。

系统工具GitHub
macOS 15+Peekabooopenclaw/Peekaboo
LinuxUbuntu Desktop Control MCPcharettep/...
WSL2python-xlib + X server-

触发词

桌面控制 / 操控电脑 / 截屏 / desktop


🖥️ macOS (Peekaboo)

安装

npx -y @steipete/peekaboo

# 授权
peekaboo permissions grant

命令

# 截图
peekaboo image --mode screen

# 点击
peekaboo click --on "按钮文字"

# 输入
peekaboo type --text "内容"

# 快捷键
peekaboo hotkey cmd,c

🐧 Linux (桌面 MCP)

方案1: Ubuntu Desktop Control MCP

# 安装
pip install mcp-desktop-control

# 运行
mcp-desktop-control

方案2: mcp-desktop-pro (跨平台)

# 安装运行
npx -y mcp-desktop-pro serve

# 截图
# mcp-desktop-pro screenshot

# 点击
# mcp-desktop-pro click --x 100 --y 200

方案3: kwin-mcp (KDE Wayland)

git clone https://github.com/bhyoo/kwin-mcp
cd kwin-mcp
python kwin-mcp.py

💻 WSL2 方案

1. 安装 X server (Windows)

下载安装 VcXsrv

2. WSL2 配置

# .bashrc 添加
export DISPLAY=localhost:0

# 安装依赖
sudo apt install python3-xlib flameshot scrot

3. Python 自动化

from pymouse import PyMouse
from pykeyboard import PyKeyboard

m = PyMouse()
k = PyKeyboard()

# 点击
m.click(100, 200)

# 输入
k.type_string("Hello")

# 快捷键
k.press_key('ctrl')
k.tap_key('c')
k.release_key('ctrl')

使用示例

macOS

你说:打开Safari去openclaw官网
我 → peekaboo app launch Safari
   → peekaboo type --text "openclaw.ai"
   → peekaboo press return

Linux

你说:截个图
我 → mcp-desktop-control screenshot

WSL2

你说:点击这个按钮
我 → 用坐标点击

注意事项

  • ⚠️ macOS 需要 15+,授权辅助功能
  • ⚠️ Linux 需要 X server 或 Wayland
  • ⚠️ WSL2 需要 VcXsrv

桌面控制 | AI 操控电脑

Related skills

Generate and edit Draw.io, Mermaid, and Excalidraw diagrams from natural language using a structured JSON spec.

by nssa.io1.0k installs47 stars

Join a video meeting as an AI bot with voice, avatar, and screenshare across four operating modes.

by johnpatternai22 installs8 stars

Stores durable facts in a categorized, plain-markdown vault on disk, alongside your agent's built-in memory.

by Iván559 installs18 stars

Fetch raw ad creative, app, ranking, and revenue data from AdMapix as structured JSON.

by fly0pants4.3k installs296 stars

Find why your productivity system keeps failing, then apply the smallest fix — capacity math, bottleneck routing, durable local notes.

by Iván855 installs69 stars

More from smseow001

Browse all skills

AI architecture diagram generator supporting Mermaid charts. Generate system architecture, cloud architecture, neural network, graph theory, flowchart, ER di...

by SMS41 installs1 stars

让AI代理控制浏览器自动化网页操作。支持 Claude/GPT/Gemini/Ollama,可执行填表、购物、搜索等任务。

by smseow00120 installs

谷歌开源 AI 编程工作流 - 从需求到代码的快速转化。包含20个专项技能、规范开发流程、7大实战案例。

by smseow00117 installs

ComfyUI V8 秋叶中文版 全流程助手。提供安装检测、一键启动、工作流生成(文生图/图生图/ControlNet/InstantID等)、参数优化、故障排查、批量生成、模型管理等功能。All-in-one assistant for ComfyUI V8 (Aki bundle) with workflow...

by smseow00117 installs

硅谷多智能体量化交易系统 - 三级架构(研究员/分析师/交易员)+ 完整量化流程 + 新手平台推荐 + 策略指南。

by smseow00114 installs

将 OpenClaw 升级为 Claude-Code 引擎架构 - 并发执行/自我反思/向量检索/子代理系统/上下文压缩

by smseow00114 installs