Validation guide

What actually counts as an edge.

A repeatable pattern with returns above chance, and above what the market does anyway. Most ideas are neither.

VARRD Validation · Updated September 2026

An edge is a pattern that beats chance and beats the market, and nothing less counts. Everything else, the setups, the indicators, the feel of a chart, is just a way of stating a hypothesis that might have one.

What an edge actually is

A pattern that fires a few times and "worked" most of those times is not an edge. It is an anecdote. An edge survives a statistical test: are the returns after this pattern unlikely to be random, and do those returns beat what the market was doing anyway over the same stretch. Both questions have to hold.

Most trading ideas never get tested this way. Someone sees a pattern that looks good, trades it, and is surprised when it stops working. It most likely never worked. It just had not been tested yet.

The two tests behind every verdict

Validation checks every idea against two separate baselines.

  • Significant versus zero. Is there a real return here at all, or are these numbers indistinguishable from noise.
  • Significant versus the market. Does the pattern beat what the market does on its own, or is it just riding the market's natural drift.

An idea that only clears the first bar has found something real, but that something might just be market exposure wearing a costume.

Four verdicts

VerdictVs zeroVs marketWhat it means
Strong edgeYesYesReal returns that also beat the market.
MarginalYesNoA real signal, without a clear edge over market drift.
PinnedNoYesFlat but different from the market, useful for hedging.
No edgeNoNoNot distinguishable from noise.

Strong edge is the outcome everyone is chasing: a pattern that is both real and better than what the market hands you for free. Marginal still has a real signal inside it, but you cannot tell it apart from ordinary market exposure. Pinned looks unremarkable on returns alone, yet it moves differently from the market, which matters more for hedging than for a standalone trade. No edge is the most common outcome, and the one that saves the most money.

Why most edges are noise

Three things quietly manufacture fake edges. Testing many variations of an idea and keeping the best one, without counting how many you tried and without correcting the bar for calling something significant, is the biggest one. A formula that uses information it would not have had in real time is another. And a pattern built on too small a sample can look convincing purely by luck.

Guardrails handle each of these directly: every test counted with a correction applied, lookahead detection built into the formula check, and tests sized honestly to the sample they actually have. See how the guardrails stop overfitting for the full list.

The mindset shift

Most ideas fail this process, and that is the point. Ruling out an idea with a real test is progress, not a wasted afternoon. The question worth asking is not whether a chart looks good, it is whether the pattern would survive data it has never seen. Validation gives you that answer directly instead of leaving you to guess, following the same ten-step process every time. Its out-of-sample step is enforced as a one-shot lock, so a strong edge verdict actually means something.

Testing your own ideas

Describe an idea in plain language in the app, or hand it to your own agent over MCP, REST or the command line. Either way, the same two tests and the same four verdicts apply, with no shortcuts for a person and none for an agent.

Questions people ask

What is an edge in trading?
A repeatable pattern that produces returns above what chance would produce, and above what the market delivers on its own. It is not a feeling or a single good backtest. It is a claim that survives a real statistical test.
What are the four verdicts Validation can return?
Strong edge means the pattern beats both zero and the market. Marginal means it beats zero but not the market's own drift. Pinned means it differs from the market without beating zero, which can still be useful for hedging. No edge means neither test passed.
Why do most trading ideas turn out to have no edge?
Testing enough variations of an idea will produce something that looks significant by chance alone, unless every test is counted and corrected for. Small samples and formulas that quietly use future information add to the problem. Most ideas are noise once these are accounted for, and that is expected, not a failure.
How does VARRD Validation decide if an idea has an edge?
It tests the pattern's returns against zero and separately against the market baseline, corrects for every variation tested along the way, and locks in an out-of-sample check before calling anything real. The result is one of four verdicts, with the full test behind it available to review.

Describe an idea in plain English and get a verdict: strong edge, marginal, pinned or no edge. $2 free credit to start.