skills/posthog/ai-plugin/cleaning-up-stale-feature-flags

cleaning-up-stale-feature-flags

Originally fromposthog/skills
Installation
SKILL.md

Cleaning up stale feature flags

This skill guides you through finding feature flags that are no longer serving a purpose and safely removing them.

When to use this skill

  • The user asks to clean up, audit, or review their feature flags
  • The user wants to find flags that are stale, unused, or fully rolled out
  • The user asks "which feature flags can I remove?" or similar
  • The user wants to reduce tech debt from old feature flags

What makes a flag stale

A feature flag is considered stale when it's no longer doing useful work. PostHog tracks this with two signals:

  1. Usage-based staleness: The flag has last_called_at data, but hasn't been evaluated in 30+ days. This is the strongest signal — the SDKs are no longer checking this flag.
  2. Configuration-based staleness: The flag has no usage data (last_called_at is null), is 30+ days old, and is 100% rolled out (boolean at 100% with no property filters, or a multivariate flag with one variant at 100%). A fully rolled out flag with no conditions is equivalent to a hardcoded value — it can be replaced by removing the flag check from code.

Disabled flags (active: false) are not considered stale — they were intentionally turned off and may be kept for reactivation.

Workflow

1. List stale flags

Call posthog:feature-flag-get-all with active: "STALE". This returns all stale flags in a single request — PostHog handles the staleness detection server-side using the criteria described above.

2. Assess each candidate

For each stale flag, gather context before recommending action:

Check if it's tied to an experiment:

The posthog:feature-flag-get-definition tool returns an experiment_set field. If non-empty, the flag is used by an experiment — check the experiment status before touching it.

Check if other flags depend on it:

Feature flags can have dependencies (flag B only evaluates when flag A is true). The flag definition includes dependency information in its filters. Look for flag_key references in other flags' filter groups.

Check when it was last modified:

A flag last updated years ago with no recent calls is a stronger removal candidate than one updated last month with no calls (it might be newly deployed and waiting for a release).

Summarize for the user:

For each stale flag, present:

  • Flag key and description
  • Why it's considered stale (no calls in N days, or fully rolled out for N days)
  • Whether it's tied to experiments
  • When it was created and last modified
  • A recommended action (clean up from code and disable, or keep with explanation)

3. Generate code cleanup instructions

Generate a cleanup prompt the user can run in their code editor or coding agent. The cleanup instructions must be tailored to each flag's rollout state, because the rollout state determines which code path to keep. This list also serves as the approval checklist — if the user says their code is already cleaned up, they review it and confirm which flags to disable.

Classify each flag into one of three rollout states based on its definition:

  • fully_rolled_out: A boolean flag with a release condition at 100% rollout and no property filters, or a multivariate flag where one variant is at 100%. Record which variant was active (for multivariate flags).
  • not_rolled_out: All release conditions are at 0%, or the flag has no release conditions at all.
  • partial: Everything else — the flag had some targeting but wasn't fully rolled out or fully off.

Then generate instructions following this structure:

For fully rolled out boolean flags — remove the flag check but keep the enabled code path:

Search for: isFeatureEnabled, useFeatureFlag, getFeatureFlag, posthog.isFeatureEnabled, posthog.getFeatureFlag

For flag "example-flag":
- Remove the if-check, keep the body
- If there is an else branch, remove the else branch entirely

For fully rolled out multivariate flags — keep only the winning variant's code:

For flag "example-flag" (keep variant: "winning-variant"):
- For if/else chains: keep only the branch matching "winning-variant", remove the flag check
- For switch statements: keep only the winning variant's case, remove the switch

For not-rolled-out flags — remove the entire flag check AND the enabled code path:

For flag "example-flag":
- Remove the if-check AND its body (the feature was never active)
- If there is an else branch, keep only the else body

For partial rollout flags — flag these for manual review:

For flag "example-flag":
- This flag had a partial rollout — check the flag's intent to determine which code path to keep
- Then remove the flag check

End the instructions with: "After cleanup, remove any dead code branches and unused imports."

Present the full cleanup prompt in a copyable format so the user can paste it directly into Claude Code, Cursor, Copilot, or any other AI code editor.

4. Disable flags after code changes are deployed

Never disable flags before the code changes are deployed. Disabling a fully rolled out flag while code still checks it will cause that code path to stop working — a production regression.

Never disable flags without explicit user approval. Always present the list and recommendations first, then ask which flags to act on.

Present the user with both options and their tradeoffs:

  • Disable (active: false) via posthog:update-feature-flag: The flag stops being evaluated but the configuration is preserved. If something was missed in the code cleanup, re-enabling is instant. Recommended as the default.
  • Delete via posthog:delete-feature-flag: A soft-delete — the flag is marked as deleted but not physically removed. Keeps the flag list clean, but re-enabling requires recreating the flag. Better for flags the user is confident they'll never need again.

Once the user has chosen and confirms their code changes are deployed, apply the chosen action one flag at a time. Confirm each action so it's easy to stop if something goes wrong.

Example interaction

User: "Can you help me clean up our stale feature flags?"

Agent steps:
- Call posthog:feature-flag-get-all with active: "STALE" to get all stale flags in one request
- For each stale flag, call posthog:feature-flag-get-definition to check experiment_set and dependencies
- Present findings:

   "I found 7 stale feature flags in your project:

   | Flag | Last called | Reason | Recommendation |
   |------|-------------|--------|----------------|
   | old-checkout-flow | 45 days ago | No evaluations in 45 days | Clean up and disable |
   | beta-dashboard-v2 | Never | 100% rolled out, created 3 months ago | Clean up and disable |
   | holiday-promo-2024 | 90 days ago | No evaluations in 90 days | Clean up and disable |
   | new-pricing-page | 60 days ago | No evaluations in 60 days, tied to experiment #42 | Check experiment first |
   ...

   Want me to generate cleanup instructions for any of these? I'd recommend
   starting with old-checkout-flow and beta-dashboard-v2 since they have no dependencies."

- User confirms: "Yes, do old-checkout-flow and beta-dashboard-v2"
- Classify rollout states from the flag definitions:
   - old-checkout-flow: fully_rolled_out (boolean, 100% rollout, no conditions)
   - beta-dashboard-v2: fully_rolled_out (boolean, 100% rollout, no conditions)
- Generate and present cleanup prompt:

   "Here's a cleanup prompt you can paste into your code editor:

   ---
   Find and remove all references to these feature flags in the codebase.
   For each flag, search for all usages: isFeatureEnabled, useFeatureFlag,
   getFeatureFlag, posthog.isFeatureEnabled, posthog.getFeatureFlag, etc.

   ## Flags that were rolled out to 100%
   These flags were fully rolled out. Remove the flag check but KEEP the enabled code path.

   Boolean flags (remove the if-check, keep the body):
   - old-checkout-flow
   - beta-dashboard-v2

   If there is an else branch, remove the else branch entirely.
   After cleanup, remove any dead code branches and unused imports.
   ---

   Once you've cleaned up your code and deployed, let me know.
   Would you like to disable or delete these flags?
   - Disable (recommended): keeps the config, re-enabling is instant
   - Delete: removes from the list, but you'd need to recreate if needed"

- User confirms: "Disable them, code is deployed"
- Disable each flag using posthog:update-feature-flag (active: false)
- Confirm: "Both flags are now disabled in PostHog."

Important notes

  • Code first, then disable. Disabling a flag while code still references it causes the enabled code path to silently stop working. Always clean up code and deploy before disabling.
  • Prefer disable over delete. Disabling is instantly reversible. Deletion is not — re-enabling requires recreating the flag. Always present both options with tradeoffs and let the user choose.
  • Always confirm before acting. This skill involves disabling flags, which can affect production behavior. Never disable without explicit user approval.
  • Disabled flags are not stale. Don't recommend disabling flags that are already intentionally disabled — they may be kept for emergency reactivation.
  • Experiment flags need extra care. If a flag is tied to an active or recently completed experiment, the user likely wants to keep it until they've analyzed results.
  • Seasonal flags may return. Flags like "black-friday-sale" might look stale but are intentionally reused. Ask the user before removing these.
  • Code cleanup is the real win. Removing the flag from PostHog is the easy part. The value comes from removing the dead code paths.

Related tools

  • posthog:feature-flag-get-all: List and search feature flags (supports active: "STALE" filter)
  • posthog:feature-flag-get-definition: Get full flag details including experiment associations
  • posthog:feature-flags-status-retrieve: Get the status and reason for a single flag
  • posthog:update-feature-flag: Disable a flag by setting active: false
  • posthog:delete-feature-flag: Soft-delete a flag
Weekly Installs
34
GitHub Stars
26
First Seen
Today