Execution quality: what it means
“Execution quality” describes how closely the price and timing of a trade’s fill match what was available and intended at the moment the order was placed. For an ECN-style account, the goal is usually to understand whether fills reflect the available order book/quotes with minimal extra cost from the execution process. In practice, “good” execution is not a single outcome; it is a set of observable behaviors measured after the fact.
To assess execution quality, distinguish three layers: (1) the market’s available liquidity and volatility at the time, (2) the account’s contractual cost structure (commissions, any fees) and execution rules, and (3) the provider/execution system’s behavior (how orders are routed, how partial fills are handled, and how fills change when conditions move). Separating these layers prevents mixing market movement with execution performance.
Mechanisms and metrics you can measure
Start with definitions that can be computed from trade records.
-
Cost at fill: For each executed order, compute a realized execution cost versus a reference price you choose (for example, the best quoted price at order entry, the mid-price, or the nearest quote time). Because you must choose a reference, document the assumption used.
-
Slippage: Slippage is the difference between your intended reference price and the actual fill price, measured per fill. For buy orders, compare fill price to the reference; for sells, compare the opposite direction. Track both magnitude and frequency.
-
Fill timing: If you have timestamps (order submit time, quote time, and execution time), calculate the delay distribution. Shorter does not always mean better, but long delays during fast moves often indicate lower execution quality.
-
Partial fills and price improvement: Determine whether an order that is split into multiple fills shows consistent price behavior. If price improvement occurred (e.g., buys filled better than the reference and sells filled better than the reference), document it. If fills become worse as liquidity thins, note that as a failure mode.
-
Order handling consistency: For changes like cancel/replace (or edits), verify whether the system behaves as expected. Inconsistent cancellation behavior can look like “bad execution” even when quotes moved.
If you are missing certain fields (such as quote timestamps), you can still evaluate slippage relative to the best available reference you do have, but your conclusions must be limited to that measurement basis.
Evidence and example approach (with assumptions)
A practical assessment method is to run a structured review of your own historical executions, without assuming future performance.
Example (assumptions must be stated): Assume you have trade logs with submit time, fill time, fill price, side, quantity, and commission/fee breakdown. Also assume you can record a reference price at or near submit time from your platform (for instance, the best available quote you saw when placing the order).
Then for each fill:
- Compute realized spread cost proxy using your chosen reference (reference minus fill, direction-adjusted).
- Compute total cost including explicit commissions and implicit execution cost from slippage.
- Group results by market state (for example, high vs. low volatility periods using a simple proxy you can compute from your price series).
- Track distribution metrics: median slippage, worst-case tail, and the proportion of fills that are worse than the reference.
This approach makes the evaluation measurable, but it still depends on your reference choice and timestamp accuracy. A different reference can change slippage values.
Limitations and realistic failure modes
Execution quality evidence can be misleading if you ignore common limitations.
Material limitation: reference mismatch. The quote you used as the reference may not be the best available liquidity at the exact moment your order was routed, especially if routing or latency delays exist.
Material limitation: market microstructure. During rapid price movement, the “best quote” can change before the order reaches the execution venue. In such cases, slippage may reflect market movement more than execution weakness.
Failure mode: partial fill degradation. An order may initially receive acceptable fills, then later fills occur at worse prices when liquidity thins. A simple average can hide this pattern.
Failure mode: inconsistent order modification behavior. If cancels or replaces are processed differently than expected, you may observe fills that contradict your intended price behavior.