Strategy Review, explained
Strategy Review is a way to evaluate how a trading approach performed by comparing what was done (decisions, rules, and execution) with what happened (outcomes). It usually focuses on measurable quantities such as entry/exit timing, trade frequency, drawdowns, and whether results match the stated purpose of the approach. The key idea is comparison: you assess decisions against results using a defined method.
A limitation starts immediately: “performance” is only as meaningful as the definitions behind it. If different people measure the same concept differently (for example, what counts as a “strategy” versus discretionary overlays, or whether costs are included), the review can reach incompatible conclusions.
How Strategy Review works—and where uncertainty enters
Most reviews follow a pattern: choose a timeframe, define the rules under evaluation, compile the outcomes, and compute metrics. Even if you assume no real-time market data is involved, the review can still be uncertain because the inputs are not fixed.
Common sources of uncertainty include:
- Missing or inconsistent records (e.g., partial trade logs, unclear changes to rules).
- Uncertain cost modeling (for example, whether spreads, commissions, financing, and slippage are included in the same way across trades).
- Execution differences (the same decision rule can lead to different fills depending on order handling and liquidity).
To illustrate the assumption issue without using live prices: if two reviewers analyze “net return” but one subtracts modeled trading costs while the other uses gross prices, they may disagree even when evaluating the same trades. The disagreement is about measurement choices, not the underlying strategy.
Failure modes and limitations
Strategy Review is less useful when its core assumptions break. Material failure modes include:
-
Past results do not establish future relationships Even when a strategy shows stable performance historically, historical relationships can weaken. Market structure, participant behavior, and volatility regimes change over time, so a review that extrapolates can be misleading.
-
Selection effects and survivorship bias A review might focus on periods or instruments where trading “worked,” while excluding similar periods where records are missing or the approach was not used. That can make the strategy look more consistent than it is.
-
Model mismatch between rules and implementation A strategy can be defined one way on paper but implemented differently in practice. A Strategy Review can miss this if it only grades outcomes, not the actual rule compliance (for example, whether every trigger condition was satisfied, and whether discretionary deviations occurred).
-
Costs and execution can dominate Net outcomes can be heavily influenced by costs and execution quality. If your review does not capture those elements consistently, the evaluated performance may not represent what would happen under comparable conditions.
-
Metrics can hide important risk details Some metrics summarize results (averages, win rates, or simple return measures). These can mask tail risk, concentration, and path-dependent effects. A strategy might look acceptable by a headline metric while still producing severe drawdowns under plausible conditions.
What you can verify independently
The most verifiable part of Strategy Review is the method itself, not the optimism of conclusions. You can independently check whether a review is robust by asking:
- Are the definitions consistent (strategy rules, discretionary overlays, and measurement boundaries)?
- Are costs and execution assumptions documented and applied the same way across trades?
- Are the underlying records complete and reproducible?
- Do conclusions rely on a single period, or are they examined across different conditions?
A limitation remains: without reliable and complete inputs, Strategy Review cannot eliminate uncertainty. It can narrow questions and highlight where evidence is weak, but it cannot guarantee predictive accuracy.
If you want to go further, a practical next question is how to ensure your review captures the full cost and execution picture consistently, since those factors often determine whether “good decisions” translate into “good net outcomes.”