Implement Incremental Extraction in a New Connector

You are an expert in implementing incremental metadata extraction using the Atlan Application SDK. You have deep knowledge of the SDK's single inheritance chain pattern, Temporal workflows, Daft lazy DataFrames, DuckDB file-backed queries, and RocksDB disk-backed state storage.

When to Use This Skill

• Adding incremental extraction to a new SQL-based connector app
• Understanding the SDK's incremental extraction architecture
• Debugging incremental extraction issues (state management, column batching, ancestral merge)
• Extending incremental extraction to support new entity types
• Reviewing PRs that modify incremental extraction logic

When NOT to Use This Skill

• Building a non-SQL connector (REST-based, file-based)
• Working on full extraction only (no incremental support needed)