web-scraper
Skill: web-scraper
When to Use
Use this skill when the user asks to:
- Scrape or fetch content from a URL
- Extract text from a webpage
- Read an article from a link
- Get the content of a website
- Download and convert a webpage to text/markdown
- Summarize a web page
Input Parameters
| Parameter | Required | Description | Example |
|---|---|---|---|
url |
Yes | URL to scrape | https://example.com/article |
format |
No | Output format: markdown (default), text, html |
markdown |
output |
No | Save output to file path | article.md |
Procedure
-
Get the URL from the user's request
-
Run the bundled script:
# Fetch and extract as markdown (default) python3 skills/web-scraper/scripts/scrape.py "https://example.com/article" # Extract as plain text python3 skills/web-scraper/scripts/scrape.py "https://example.com" --format text # Save to file python3 skills/web-scraper/scripts/scrape.py "https://example.com" --output article.md -
The script auto-installs
trafilaturaandrequestsif needed -
Present the extracted content to the user
Bundled Scripts
| Script | Type | Description |
|---|---|---|
scripts/scrape.py |
Python | Fetch URL and extract clean content |
Script Usage
# Extract article content as markdown
python3 scripts/scrape.py "https://example.com/blog-post"
# Extract as plain text
python3 scripts/scrape.py "https://example.com" --format text
# Keep raw HTML
python3 scripts/scrape.py "https://example.com" --format html
# Save to file
python3 scripts/scrape.py "https://example.com" --output page.md
# Include metadata (title, author, date)
python3 scripts/scrape.py "https://example.com/article" --metadata
Example
scrape this URL: https://example.com/article
extract the text from this webpage
fetch the content of this link and save it
read this article: https://blog.example.com/post-1
get the content from this website
More from dalehurley/phpbot
desktop-control
Control the mouse, keyboard, and read screen content via accessibility. Use this skill when the user asks to click somewhere on screen, type text into an app, move the mouse, press keyboard shortcuts, read what's on screen, get the accessibility tree of the current window, automate desktop interactions, or control the computer.
39open-application
Open or launch applications on your computer by name. Use this skill when the user asks to open, launch, or start an application like Mail, Finder, Safari, Chrome, or any other installed macOS application. Works with both built-in and third-party applications.
10image-tools
Resize, compress, convert, crop, and inspect images. Use this skill when the user asks to resize an image, compress a photo, convert image format (PNG to JPG etc), crop an image, get image dimensions/info, or optimize images for web.
7summarize-pdf-aloud
Find PDF documents on your computer, extract and summarize their content, and read the summary aloud using text-to-speech. Use this skill when the user asks to read a PDF summary out loud, speak a document summary, or have a PDF summarized verbally. Automatically searches common directories (Desktop, Downloads, current directory) and uses OCR/text extraction to process the PDF content.
6text-to-speech
Produce actual audio output from the computer's speakers using text-to-speech. Use this skill when the user asks to speak, say something out loud, talk, vocalize, read aloud, announce, play audio from text, or produce voice output. Can use OS-native commands (macOS say, Linux espeak) or high-quality API-based TTS (OpenAI). The key point: this MUST produce real sound, not just text.
6retrieve-and-analyze-notes
Retrieve and analyze notes from Apple Notes by searching for specific note names or keywords. Use this skill when the user asks to read, retrieve, find, or get a note from Apple Notes, or when they want analysis or feedback on content stored in their notes. Supports fuzzy matching on note names and returns the full note content for review or further processing.
5