Skip to main content
The Health menu helps you monitor your experiment’s data reliability. It automatically runs a series of checks to detect potential issues in tracking, traffic balance, or data collection, giving you greater confidence in your experiment results. The Overview menu and the Experiments homepage also display a health status badge, so you can quickly see if everything is running smoothly.

​
What are Health Checks?

Health Checks are automated diagnostics that monitor your experiment’s overall health. They run hourly during the first 24 hours after you activate an experiment, and daily afterward for all active experiments. You can also trigger them manually each time you open the Results page.
These checks help you:
  • Detect tracking or data anomalies early.
  • Confirm that your experiment is still collecting data as expected.
  • Identify potential biases that could affect your results.
There are four core checks:

​
Health Check thresholds

Each Health Check uses specific thresholds to determine its status. Understanding these thresholds helps you interpret the severity of any detected issues.

​
Sample ratio mismatch check

This check uses a Chi-squared test to calculate a p-value that measures how closely your actual traffic distribution matches the expected split.

​
Overlapping exposure check

The overlapping exposure check identifies the percentage of users who see different variations of the same experiment across multiple visits. An overlap occurs when a user sees one variation during an initial visit and a different variation in a subsequent visit. The system calculates the rate using the following formula: (users exposed to more than one variation) ÷ (total users in the test).

​
Conversion tracking check

This check monitors whether your goals are actively receiving conversions.

​
Visitor tracking check

This check verifies that new visitors are still entering the experiment.

​
Health summary in the Overview menu

At the top of the Overview menu, you’ll find a Health summary badge showing your experiment’s overall health at a glance.
  • The badge color represents the current status across all checks:
    • Red: Failed check
    • Yellow: Warning
    • Gray: Pending
    • Green: All checks passed
  • The text inside the badge displays the number of non-passing checks (red + yellow + gray), or All passed if everything is green.
Hover over the badge to see a tooltip listing all four checks with their individual statuses. At the bottom of the tooltip, click View full health report to open the Health menu.

​
Health status on the Experiments homepage

The Health Checks block on the Experiments homepage gives you a fleet-level view of data-quality issues across all your active experiments, without having to open each one individually. The block shows four counters that summarize the overall health of your active experiments:
  • Passed: All checks are healthy
  • Warning: At least one check needs review
  • Failed: At least one check has failed
  • Pending: Checks have not yet run
Only experiments with warnings or failed checks appear in this block. The Currently live section lists healthy experiments separately. Hover over an experiment’s status to see a tooltip listing individual check results and the timestamp of the last evaluation. Click any experiment row to open the full Health menu for that experiment. The Health menu provides a detailed, interactive view of all checks and their results.

​
Top banner

At the top of the menu, you’ll see:
  • X/Y checks run: Number of checks completed (X) out of the total (Y).
  • Last updated: The most recent evaluation time.
  • Status breakdown: A count of checks by status: Passed, Warning, Failed, or Pending.

​
Check details

This tab has two sections:
  • Left column:
    • A clickable list of the four Health Checks, each showing its current status icon.
  • Right column:
    • A detailed description of the selected check, including:
      • What it monitors
      • What the current status means
      • Recommended Next Steps if the check has a Warning or Failed status
For the Conversion Tracking Check, you’ll also see a table listing all goals in your experiment, along with their individual statuses and the timestamp of their last recorded conversion.

​
Special cases

​
Pending status

The Pending status appears only when the experiment has just launched and no Health Check job has run yet. This state is temporary and automatically resolves once the system completes the first evaluation (hourly or manual).

​
Paused or stopped experiments

When you pause or stop an experiment, the Health menu becomes disabled, and the Overview menu hides the Health summary badge to keep the Results page clear.

​
Data updates and refresh

  • Health Checks run hourly during the first 24 hours after activation, then daily for all active experiments.
  • When you open the Results page, Kameleoon refreshes checks on demand.
  • Cached results display instantly and automatically update once new data arrives.

​
Compatibility

Health Checks are available for all experiment types:
  • A/B tests
  • Feature flags
  • Personalization campaigns