Skip to main content
Experiment tools cover the Web Experiment lifecycle. Your assistant can create a test, write the code for each variation, set the traffic split and goals, start the test, and check its health and results.

Tools

experiment_create accepts MVT and SDK_HYBRID as valid type values, but this tool can’t actually create either one. MVT always fails because the API requires mvtVariations (sections and variations) on creation, and no MCP tool exposes that field. SDK_HYBRID always fails with an “Incorrect Experiments type” error, regardless of payload. AI, CLASSIC, DEVELOPER, and PROMPT all create successfully. To create an MVT experiment, call the Automation API directly and follow the steps in Create a multivariate experiment.
The variation tools don’t support stopped, MVT, or feature-flag experiments. For feature flag variations, use feature_flag_variation_create. You can’t change the traffic split of a running experiment, or of one that uses a bandit allocation method, through the MCP server.

Check experiment health

Ask your assistant to run the Health tab checks before you act on a test’s results.
  • Is the test healthy? experiment_health_check_get runs the checks of the Health tab: visit and conversion tracking, sample ratio mismatch, and overlapping exposure.

Parameters

Use the exact parameter names that tools/list returns. Accepted enum values: experiment_lifecycle_update.status is started, resumed, paused, stopped, or deleted. Experiment type is AI, CLASSIC, DEVELOPER, MVT, PROMPT, or SDK_HYBRID. trafficAllocationMethod is MANUAL (default), MULTI_ARMED_BANDIT, or CONTEXTUAL_BANDIT. audienceBasis is VISITORS (default) or VISITS.

Results settings

Read an experiment’s results with experiment_results_get. For experiment_results_get, feature_flag_experiment_results_get, and transpose_winning_experiment, the goalResults array covers every goal attached to the experiment, which includes primary and secondary goals. Kameleoon computes a winner verdict for the primary goal only. Secondary goals return the same statistical figures as guardrail metrics, without a verdict. experiment_results_get and feature_flag_experiment_results_get accept these optional settings:
  • breakdown: splits the results. DAY, WEEK, and MONTH show a trend over time. HOUR shows a trend over a dateFrom and dateTo window of at most 2 days. DEVICE_TYPE, BROWSER, OS, and NEW_VISITOR return one bucket per value. Period buckets carry audience, conversions, and conversion rate only. Improvement and reliability stay in the summary for the whole run.
  • filters: a list of strings, or one string with ; between filters. Kameleoon combines the filters with AND. Each filter has the format DIMENSION=V1,V2 or DIMENSION!=V1,V2. The dimensions and values are DEVICE_TYPE (DESKTOP, TABLET, PHONE), BROWSER (CHROME, EDGE, FIREFOX, SAFARI, OPERA, OTHERS), OS (WINDOWS, MAC_OS, I_OS, LINUX, ANDROID, WINDOWS_PHONE, OTHERS), and NEW_VISITOR (NEW, RETURNING). A breakdown by DEVICE_TYPE can show an OTHERS bucket, but you can’t filter on DEVICE_TYPE=OTHERS.
  • dateFrom and dateTo: a specific period, as YYYY-MM-DD dates in the account time zone. dateTo is inclusive. Set them only when you need a specific period. A narrower window gives noisier figures, so don’t call a winner from a short window.
  • statisticalMethod: FREQUENTIST (default), SEQUENTIAL, BAYESIAN, or CUPED. With BAYESIAN, reliabilityRate becomes the probability to beat the reference. CUPED applies to whole-run figures only, and breakdown buckets stay frequentist. The tool rejects a method that your plan doesn’t include.
  • conversionType: CONVERTED (default) counts each converting visitor once. ALL counts every conversion, so the rate can exceed 100%. Improvement and reliability follow it: with ALL they compare conversions per visitor.
  • referenceVariationId: the variation that the others compare against. Pass a variation ID, or 0 for the original. For feature flags, pass a variation ID or key, or 0 or off for the off variation. The default is the experiment’s saved reference, or the original if the experiment has none.
The response states the settings it applied in appliedOptions and adds notes where a figure needs context. The response leaves out figures that the engine didn’t compute, for example because of too little data or a reference without conversions, and adds a note for each one. Results compare against the reference saved on the experiment, as the results screen does. Experiments that Kameleoon builds from a prompt, and feature flag experiments whose off variation gets 0% of the traffic, don’t return improvement and reliability.

Tutorials