Web Scraper

Fetch web page content and convert to clean markdown format.

Usage

Run the fetch script to get web content:

python3 scripts/fetch_url.py <url> [options]

Options

• --timeout <seconds>: Request timeout (default: 30)
• --max-length <chars>: Maximum output length (default: 100000)
• --raw: Output raw HTML instead of markdown

Examples