文档

defuddle-web-cleaner

Extract and clean readable article content, metadata, and markdown from URLs or HTML for research, note taking, and web scraping.

它能做什么

Extract and clean readable article content, metadata, and markdown from URLs or HTML for research, note taking, and web scraping.

技能文档


name: defuddle-web-cleaner description: extract clean article content from web pages using defuddle. use when a user provides a url or html and wants the readable article text, markdown version, or structured metadata. helpful for web scraping, research workflows, note taking, obsidian clipping, and converting web pages to markdown.

Defuddle Web Cleaner

Extract the main readable content from a web page.

This skill removes unnecessary elements such as:

  • navigation bars
  • sidebars
  • ads
  • comments
  • footers
  • social buttons

The result is clean article content.

Supported Inputs

  1. URL
  2. Raw HTML
  3. Web page text

Output Format

Default output:

Title
Author
Site
Published date

Markdown article content

Alternative output (JSON):

{ title, author, site, description, published, content, contentMarkdown }

Processing Steps

  1. Detect input type
  2. Load page HTML
  3. Run Defuddle parser
  4. Extract metadata
  5. Convert to Markdown if requested
  6. Return clean content

Example

Input:

https://example.com/blog/ai

Output:

Title: AI is Changing Everything
Author: Jane Smith
Site: Example Blog

Markdown:

AI is Changing Everything

Artificial intelligence is transforming industries...

Tips

Use this skill when:

  • saving articles to Obsidian
  • building research datasets
  • cleaning webpages for LLM processing
  • summarizing articles

相关技能

为单篇或一批 ArXiv 论文下载源文件与 PDF,再通读全文并按指定语言生成结构化的 summary.md。

116 次安装1 星标

压缩任意来源,保留每一条论断、对冲、数值与归属。

239 次安装4 星标

把 YouTube 视频整理成带章节、时间戳和要点的 Markdown 摘要

59 次安装1 星标

由模型规划查询并判断相关性,将多轮 arXiv 结果合并去重,最终产出可直接使用的主题论文集。

97 次安装

通过 md2wechat CLI 把 Markdown 转为微信公众号 HTML、封面、信息图和图文帖。

65 次安装4 星标

汇总过去 30 天 Reddit、X、YouTube 和网页上关于某个话题的真实讨论。

110 次安装