Marketing experimentation
The practice of running marketing decisions as experiments rather than as opinions. The discipline of testing, measuring, and either shipping or killing each idea.
Marketing experimentation is the practice. The experiment OS is the system that supports it. The marketing experiment is the unit of work.
A team practices marketing experimentation when every nontrivial idea passes through the contract: hypothesis, metric, thresholds, dates, verdict. The opposite of marketing experimentation is opinion-driven marketing, which is what most teams default to.
When to use it
Adopt it when the cost of being wrong on the next marketing decision is bigger than the cost of testing it first — which, for most teams shipping new positioning, channels, or pricing, is most of the time.
What this looks like in practice
Marketing experimentation sits between two failure modes. On one side, opinion-driven marketing: the loudest stakeholder picks the campaign, results are explained after the fact, nothing repeats. On the other side, statistical-rigor theatre: every change demands a six-week A/B test, decisions stall, the team ships almost nothing. The practice is the middle path — write the contract, set the thresholds, decide on the date, move on.
Adopting the practice changes how meetings sound. Instead of "I think we should…" you hear "the contract says…" Instead of post-hoc rationalization, you hear verdicts. Instead of revisiting the same debate, you check the archive. The cultural shift is bigger than the tooling shift.
Marketing experimentation does not mean every decision needs an experiment. Trivial, fully reversible, or one-way-door decisions skip the contract. The discipline is reserved for decisions where the cost of being wrong outweighs the cost of writing four lines of contract before starting.
Common mistakes
- Mistaking activity for the practice.Running tests is not enough. The practice requires the contract: a written hypothesis, metric, and threshold before the test starts.
- Demanding statistical significance for every decision.Most marketing decisions run on small N. The contract — not the p-value — is what protects the team from drift.
- Practicing it in pockets.If only the growth team writes contracts and the brand team launches by gut, the archive is partial and the org never compounds.
Related terms
Pick a hypothesis. Vocabulary done.
The fastest way to learn this vocabulary is to commit one experiment. The contract takes about five minutes to write.