skills/firecrawl/cli/firecrawl-scrape

firecrawl-scrape

SKILL.md

firecrawl scrape

Scrape one or more URLs. Returns clean, LLM-optimized markdown. Multiple URLs are scraped concurrently.

When to use

  • You have a specific URL and want its content
  • The page is static or JS-rendered (SPA)
  • Step 2 in the workflow escalation pattern: search → scrape → map → crawl → browser

Quick start

# Basic markdown extraction
firecrawl scrape "<url>" -o .firecrawl/page.md

# Main content only, no nav/footer
firecrawl scrape "<url>" --only-main-content -o .firecrawl/page.md

# Wait for JS to render, then scrape
firecrawl scrape "<url>" --wait-for 3000 -o .firecrawl/page.md

# Multiple URLs (each saved to .firecrawl/)
firecrawl scrape https://example.com https://example.com/blog https://example.com/docs

# Get markdown and links together
firecrawl scrape "<url>" --format markdown,links -o .firecrawl/page.json

Options

Option Description
-f, --format <formats> Output formats: markdown, html, rawHtml, links, screenshot, json
-H Include HTTP headers in output
--only-main-content Strip nav, footer, sidebar — main content only
--wait-for <ms> Wait for JS rendering before scraping
--include-tags <tags> Only include these HTML tags
--exclude-tags <tags> Exclude these HTML tags
-o, --output <path> Output file path

Tips

  • Try scrape before browser. Scrape handles static pages and JS-rendered SPAs. Only escalate to browser when you need interaction (clicks, form fills, pagination).
  • Multiple URLs are scraped concurrently — check firecrawl --status for your concurrency limit.
  • Single format outputs raw content. Multiple formats (e.g., --format markdown,links) output JSON.
  • Always quote URLs — shell interprets ? and & as special characters.
  • Naming convention: .firecrawl/{site}-{path}.md

See also

Weekly Installs
708
Repository
firecrawl/cli
GitHub Stars
156
First Seen
2 days ago
Installed on
codex703
gemini-cli702
amp702
cline702
github-copilot702
opencode702