fetch-url
Fetch URL
Extract text from any webpage. Works globally.
Usage
fetch-url "https://example.com" # Auto-selects best tool
fetch-url "https://reddit.com/r/python" # Works on blocked sites
fetch-url "URL" -v # Verbose (show tool used)
Options
| Option | Description |
|---|---|
--tool NAME |
jina, chrome, markdown, w3m, lynx, chawan |
-v, --verbose |
Show which tool selected |
--no-clean |
Keep empty lines |
Tools (Auto-Selected)
| Tool | Best For |
|---|---|
| jina | Docs, blogs, arXiv, Medium (default) |
| chrome | Cloudflare/JS-protected sites (firmenabc.at, etc.) |
| w3m | Reddit, Hacker News |
| markdown | Fallback, GitHub |
Edge Cases
- Cloudflare-protected sites (firmenabc.at, etc.): Auto-detected, uses
chromeheadless to solve JS challenges - Reddit:
w3mmay only return navigation elements; try--tool jinafor post content - StackOverflow: May redirect to different questions; verify URL is canonical
- Wikipedia: Can return empty results; try
--tool w3mas fallback
Credentials (Optional)
Only needed for --tool api mode. Most users don't need this.
credgoo add FETCH_URL_BEARER
Install
cd ~/.pi/agent/skills/fetch-url
./install.sh
ln -sf $(pwd)/fetch-url ~/.local/bin/fetch-url # Make global
More from devskale/skale-skills
markdown-converter
Convert documents to Markdown using markitdown. Use when you need to extract text and convert PDF, Word, PowerPoint, Excel, HTML, CSV, JSON, XML, images (with EXIF/OCR), audio, ZIP archives, YouTube URLs, or EPUBs to Markdown format for LLM processing or text analysis.
9rodney
Chrome automation from CLI using rodney tool. Drive headless Chrome for web scraping, testing, screenshots, form filling, navigation, and accessibility checks. Use when user wants to automate browser interactions, scrape websites, take screenshots, test web pages, fill forms, or check accessibility. Supports persistent Chrome sessions, multi-step workflows, and shell scripting integration.
7xlsx
Comprehensive spreadsheet creation, editing, and analysis with support for formulas, formatting, data analysis, and visualization. When Claude needs to work with spreadsheets (.xlsx, .xlsm, .csv, .tsv, etc) for: (1) Creating new spreadsheets with formulas and formatting, (2) Reading or analyzing data, (3) Modify existing spreadsheets while preserving formulas, (4) Data analysis and visualization in spreadsheets, or (5) Recalculating formulas
6improve-skill
Analyze coding agent session transcripts to improve existing skills or create new ones. Use when asked to improve a skill based on a session, or extract a new skill from session history.
6agents-md-writer
Create and optimize AGENTS.md files for AI coding agents. Use this skill when users ask to create, write, generate, improve, or update an AGENTS.md file for their project, or when they need guidance on making their codebase more agent-friendly. Also use when users ask about agent context files, documentation for AI agents, or improving agent performance in their repository.
6oebb-scotty
Austrian rail travel planner (ÖBB Scotty). Use when planning train journeys in Austria, checking departures/arrivals at stations, or looking for service disruptions. Covers ÖBB trains, S-Bahn, regional trains, and connections to neighboring countries.
6