data-observability

More from dtsong/data-engineering-skills

• event-streaming

  Use this skill when building real-time or near-real-time data pipelines. Covers Kafka, Flink, Spark Streaming, Snowpipe, BigQuery streaming, materialized views, and batch-vs-streaming decisions. Common phrases: \"real-time pipeline\", \"Kafka consumer\", \"streaming vs batch\", \"low latency ingestion\". Do NOT use for batch integration patterns (use data-integration) or pipeline orchestration (use data-pipelines).

  2

• tsfm-forecast

  Use this skill when generating time-series forecasting pipelines using foundation models. Covers TimesFM, Chronos, MOIRAI, and Lag-Llama model selection, DuckDB-based preprocessing code, Python inference generation, backtesting harnesses, multi-model comparison, and client forecast deliverables. Common phrases: \"time-series forecast\", \"demand forecasting\", \"TimesFM\", \"Chronos\", \"predict future values\", \"zero-shot forecast\". Do NOT use for ML model training or fine-tuning (use python-data-engineering), real-time/streaming forecasts (use event-streaming), or pipeline scheduling (use data-pipelines).

  2

• data-integration

  Use this skill when designing data integrations or connecting systems. Covers iPaaS platforms (Workato, MuleSoft, Boomi), dlt pipelines, API patterns, CDC, webhooks, and Reverse ETL. Common phrases: \"connect these systems\", \"build a dlt pipeline\", \"event-driven architecture\", \"change data capture\". Do NOT use for stream processing frameworks (use event-streaming) or pipeline scheduling (use data-pipelines).

  2

• integration-patterns-skill

  Use this skill when designing data integrations or connecting systems. Covers iPaaS platforms (Workato, MuleSoft, Boomi), dlt pipelines, API patterns, CDC, webhooks, and Reverse ETL. Common phrases: \"connect these systems\", \"build a dlt pipeline\", \"event-driven architecture\", \"change data capture\". Do NOT use for stream processing frameworks (use streaming-data-skill) or pipeline scheduling (use data-orchestration-skill).

  2