scrapling
Scrapling — Adaptive Web Scraping
Python web scraping framework (D4Vinci) with adaptive element tracking, 4 fetcher types (static → dynamic → stealth), Scrapy-like spiders, MCP server, and CLI. Adapts to site changes — CSS selectors that worked yesterday still work today even if the site restructured.
When to use this skill
- Scrape websites that change layout or restructure HTML over time (adaptive mode)
- Bypass anti-bot protection and Cloudflare Turnstile (StealthyFetcher)
- Run concurrent crawls with pause/resume across thousands of pages (Spider)
- Fetch rendered JavaScript-heavy pages (DynamicFetcher)
- Connect via MCP to provide browser automation tools to AI agents
- Quick one-off scraping from CLI (
scrapling shell,scrapling extract)
Instructions
More from jeo-tech-ai/oh-my-gods
bmad
BMAD + TEA: Structured System Design (SSD) for AI-driven development. Embeds TEA (Task→Execute→Architect) micro-cycles inside each BMAD phase (Analysis→Planning→Solutioning→Implementation) for traceable, multi-agent execution with automated architect validation before human review.
2agent-workflow
Practical AI agent workflows and productivity techniques. Provides optimized patterns for daily development tasks such as commands, shortcuts, Git integration, MCP usage, and session management.
2agent-development-principles
Universal principles for agentic development when collaborating with AI agents. Defines divide-and-conquer, context management, abstraction level selection, and an automation philosophy. Applicable to all AI coding tools.
2agent-configuration
AI agent configuration policy and security guide. Project description file writing, Hooks/Skills/Plugins setup, security policy, team shared workflow definition.
2omg
OMG — Integrated AI agent orchestration skill. Plan with ralph+plannotator, execute with team/bmad, verify browser behavior with agent-browser, apply UI feedback with agentation(annotate), auto-cleanup worktrees after completion. Supports Claude, Codex, Gemini CLI, and OpenCode. Install: ralph, omc, omx, ohmg, bmad, plannotator, agent-browser, agentation.
2agent-evaluation
Design and implement comprehensive evaluation systems for AI agents. Use when building evals for coding agents, conversational agents, research agents, or computer-use agents. Covers grader types, benchmarks, 8-step roadmap, and production integration.
2