Measurement and maintenance · Branch M.D, Referrals, multimodal and the experiment loop
M-13 Use a platform-aware experiment loop instead of assuming a single AI rank
Because AI visibility changes by model, engine, time and retrieval context, it must be managed with a loop of hypothesis, change, measurement and decision.
- Scope
- All public content
- Priority
- High priority.
- Quality bucket
- Measurement and experiment readiness
- Legacy coverage
- GEO-60
Why it matters
There is no single AI rank to look up, because what an answer engine shows depends on the model, the engine, the moment and the retrieval context. A one-off run can mislead, and platform behaviour can shift without warning. Treating visibility as a series of recorded experiments lets a team learn what works and stay aligned with official documentation.
How to implement
- Keep engine, model and date metadata with every benchmark result.
- Set a fixed benchmark cadence, either monthly or fortnightly.
- Use enough samples and repeats rather than relying on one run.
- Monitor platform documentation and policy changelogs for changes.
- Log each experiment as hypothesis, change, measurement and decision, and check it against official telemetry and business outcomes.
Checklist
- Keep engine, model and date metadata.
- Set a fixed monthly or fortnightly benchmark cadence.
- Use enough samples and repeats instead of a single run.
- Monitor platform documentation and policy changelogs.
- Record experiments as hypothesis, change, measurement, decision.
How to audit
- Benchmark reproducibility.
- Experiment log.
- Official telemetry and business outcomes.
How UltimateSEO checks this automatically
This control needs human evidence: the experiment log showing platform-aware tests rather than a single AI rank assumption.
States used: PASS, FAIL, UNKNOWN, NOT_APPLICABLE or BLOCKED. UNKNOWN is never shown as a pass. How states work.
Myth guards that reference this control
Sources
Part of The UltimateSEO Framework v4.1, revised 2026-10-07. Evidence states, control states and the publish gate are explained on the hub.