Direct answer: the main limitations
Drawdown Review is a way to examine the size and shape of declines in performance (for example, how far an equity value drops from a previous high). Its limitations come from measurement choices, incomplete information about what caused the decline, and the fact that past drawdowns do not reliably forecast future outcomes. Because it focuses on what happened, it can hide uncertainty about why it happened and how costs and conditions may differ going forward.
Definition and mechanics (what it is really measuring)
Drawdown Review typically relies on a performance time series such as equity or account value over time. A drawdown is often computed relative to a “peak-to-trough” reference: the value drops from the highest point seen so far to a later lower point, and the drawdown magnitude reflects that decline.
To perform any calculation, you must assume specific inputs:
- What series is used (equity, balance, or another metric).
- How time is sampled (daily, hourly, or tick-level).
- How “peak” and “trough” are detected and whether events within the sampling interval are missed.
- Whether costs (spreads, commissions, financing) are included in the performance series.
Those mechanics are stable in concept, but the exact outcome depends on the chosen inputs. If two people use different assumptions, they can produce different drawdown results even when they start from the “same” general performance story.
Evidence and example: where it can break in practice
Consider two datasets describing the same general trading history. Dataset A includes all execution costs and uses frequent sampling; dataset B uses a cleaner, lower-cost backtest series or a coarser sampling interval. Both may show “drawdowns occurred,” but the measured drawdown depth and duration can differ.
A second example is comparison. If one performance series reflects execution under one set of conditions (such as different liquidity or different cost regimes) and another series reflects execution under different conditions, then drawdown differences may reflect those conditions rather than the underlying risk behavior. In this sense, Drawdown Review may evaluate the reporting and environment more than the decision-making quality.
Limitations and risks: failure modes to watch for
-
Definition mismatch: If the drawdown metric is defined differently (for example, how peak resets, how time is sampled, or which cost components are included), the review can become non-comparable. What looks like “less drawdown” may be a measurement artifact.
-
Cause ambiguity: Drawdown size alone does not identify whether the decline came from market moves, execution issues, gaps between pricing and fills, position sizing changes, or risk management choices. Without causal context, the review may over-interpret correlation as explanation.
-
Uncertainty about future similarity: Markets change. Even if drawdowns were frequent in the past, historical relationships do not establish that future drawdowns will follow the same patterns or magnitudes.
-
Selection and survivorship effects: If the data used for the review is not representative (for example, only certain periods are shown), the drawdown experience can be biased. This can make Drawdown Review appear more stable or more controlled than it would be under a fuller history.
-
Cross-jurisdiction and cost differences: Even when mechanics are similar, costs and trading conditions can vary across providers and jurisdictions. Those differences can materially affect realized drawdowns, making the concept less useful as a universal comparison tool.
Verification and next questions
To use Drawdown Review responsibly, you can independently verify what it assumes:
- Does the calculation method specify the exact performance series and sampling interval?
- Are execution costs included in the reported equity (not just idealized price movement)?
- Are results presented consistently across periods, or are selective intervals used?
- Do you have enough context to distinguish market-driven declines from execution-driven declines?
A useful next question is not only “How large were the drawdowns?” but also “What inputs and conditions produced them, and would the same inputs likely exist in the future?” That shift highlights where Drawdown Review is informative and where it becomes uncertain.