Browser

X News Crawler

Try it

Crawl X (Twitter) search results through a local CLI that wraps `abs` (agent-browser). Use when the user asks to scrape X posts by keyword, collect Top/Lates...

What it does

Crawl X (Twitter) search results through a local CLI that wraps `abs` (agent-browser). Use when the user asks to scrape X posts by keyword, collect Top/Lates...

The skill document

X News Crawler

Use this skill to run one command and get structured X news JSON.

Prerequisites (Required)

Before any crawl command, run:

pnpm add -g agent-browser-stealth
pnpm approve-builds -g

Run Chrome with CDP on the regular profile before crawling:

/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome --remote-debugging-port=9333

Do not use --user-data-dir in that Chrome launch command.

Workflow

  1. Run the CLI, not raw abs commands.
  2. Use --mode hybrid by default: fetch top first, then latest, then sort by time and dedupe.
  3. Read JSON output and summarize signal/noise for the user.

Commands

From repository root, run:

./bin/x-news-crawler --query "openclaw" --mode hybrid --since-hours 72 --limit 30 --output .tmp/openclaw-news.json

Quick probes:

./bin/x-news-crawler --query "openclaw" --mode top --limit 10
./bin/x-news-crawler --query "openclaw" --mode latest --since-hours 24 --limit 20
./bin/x-news-crawler --query "openclaw" --cdp 9333 --limit 20

Output Contract

The CLI returns JSON with:

  • fetched_at
  • query
  • mode
  • count
  • warnings[]
  • failed_sources[]
  • rows[] with: source, datetime, status_url, user, text, replies, reposts, likes

Guardrails

  • Prefer hybrid unless the user explicitly asks only top or latest.
  • Keep since-hours small (24-168) to avoid stale content.
  • Treat unverified rumor posts as low confidence even with high engagement.

Reference

See cli.md for full flags.

Related skills

Twitter/X scraper with Apify actors

Use this skill when the user needs Twitter/X audience collection through Apify actors (followers/following/both) with optional email enrichment, username ext...

32 installs1 stars

Claw Web Fetch

Thin OpenClaw and ClawHub wrapper for the published clawfetch npm CLI, used to fetch web pages, GitHub READMEs, and Reddit threads as markdown.

30 installs

OpenTweet X Poster

Post, schedule, and publish to X via the OpenTweet REST API — tweets, threads, X Articles, and AI-generated media.

84 installs2 stars

x-grok-to-obsidian

Export Grok conversations from X (x.com) via browser-network capture and convert them into Obsidian-ready Markdown files. Use when a user wants to back up Grok chat history, preserve User vs Grok turns, and generate Markdown notes with YAML frontmatter (URL, created) from captured JSON.

29 installs

SocialClaw CLI

Use Social Flow as an agentic control plane for Meta operations via the installed `social` CLI and Gateway API. Ideal when the user asks for multi-step execu...

36 installs1 stars

Scrapling

Web scraping and data extraction using the Python Scrapling library. Use to scrape static HTML pages, JavaScript-rendered pages (Playwright), and anti-bot or...

43 installs1 stars