Write, debug, and tune Playwright specs with locator strategy, trace diagnosis, and CI-aware timeouts.
by ivangdavila1.3k installs129 stars
Browser
Scraper
Try itStructured extraction and cleanup for public, user-authorized web pages. Use when the user wants to collect, clean, summarize, or transform content from acce...
What it does
Turn messy public pages into clean, reusable data.
The skill document
Scraper
Turn messy public pages into clean, reusable data.
Core Purpose
Scraper is a safe extraction skill for public, user-authorized pages. It helps the agent:
- fetch page content from a URL
- extract readable text
- strip boilerplate where possible
- save clean output locally
- prepare content for later summarization or analysis
Safety Boundaries
- Only use on public or user-authorized pages
- Do not bypass logins, paywalls, captchas, robots restrictions, or rate limits
- Do not request or store credentials
- Do not perform stealth scraping, account creation, or identity evasion
- Save outputs locally only
Runtime Requirements
- Python 3 must be available as
python3 - No external packages required
Local Storage
All outputs are stored locally under:
~/.openclaw/workspace/memory/scraper/jobs.json~/.openclaw/workspace/memory/scraper/output/
Key Workflows
- Capture a page:
fetch_page.py --url "https://example.com" - Extract readable text:
extract_text.py --url "https://example.com" - Save cleaned content:
save_output.py --url "https://example.com" --title "Example" - List prior jobs:
list_jobs.py
Scripts
| Script | Purpose |
|---|---|
init_storage.py | Initialize scraper storage |
fetch_page.py | Download a page with standard headers |
extract_text.py | Convert HTML into cleaned plain text |
save_output.py | Save extracted output and register a job |
list_jobs.py | Show past scraping jobs |
Related skills
playwright-interactive
OfficialPersistent browser and Electron interaction through `js_repl` for fast iterative UI debugging.
by OpenAI27.5k stars
webapp-testing
OfficialToolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser l
by Anthropic177.5k stars
playwright
OfficialUse when the task requires automating a real browser from the terminal (navigation, form filling, snapshots, screenshots, data extraction, UI-flow debugging) via `playwright-cli` or the bundled wrappe
by OpenAI27.5k stars
More from agistack
Browse all skillsThe final publishing layer for anything you write. Paste messy text and get something clear, strong, and ready to send.
by agistack35 installs1 stars
Local-first health record management with strict privacy boundaries. Organize what happened, what you take, what changed, and what to bring to your doctor —...
by agistack57 installs1 stars
The most comprehensive proactive life management skill for AI agents. Covers morning intelligence briefings, email and message triage, follow-up tracking, su...
by agistack36 installs
A comprehensive AI agent skill for building and optimizing marketing and sales funnels. Helps SaaS founders, marketers, and growth teams design conversion pa...
by agistack34 installs
A comprehensive AI agent skill for acquiring, onboarding, retaining, and growing customers. Helps customer success teams reduce churn, expand revenue, and tu...
by agistack33 installs
A comprehensive AI agent skill that handles every stage of the meeting lifecycle. Prepares you before every meeting with context, attendee backgrounds, and t...
by agistack33 installs