Execution quality: what it means
Execution quality describes how closely an order’s actual execution matches the outcome you intended at the time you entered the order. In plain terms, it is about the “how” of getting filled: the price you effectively received, how quickly the execution happened, and whether the order completed as expected (for example, fully filled versus partially filled).
This idea is easiest to assess when you separate three layers:
- Stable mechanics: repeatable aspects of the execution process, such as whether orders are routed and filled in a consistent way.
- Variable market conditions: changes in liquidity, volatility, and order-book depth that affect what is realistically available.
- Variable provider conditions: differences in fees, policies, or operational behavior that change the realized costs.
What to measure (the main execution factors)
To assess execution quality for “Fca” (interpreted here as an execution-quality assessment framework tied to Fca-style policy concepts, not a guaranteed performance metric), focus on measurable factors that you can compute from records.
- Price quality versus a defined reference Pick a reference price at a known point in time (for example, the price observed at order submission, or a quote-based benchmark). Then measure implementation shortfall or a similar metric: the difference between the reference and the effective execution price, adjusted for direction.
Assumptions must be stated: the reference time (submission time, acceptance time, or first acknowledgement) and the benchmark (mid-price, bid/ask at acceptance, or another rule) change the result.
- Timing quality Measure how long it takes from the chosen reference timestamp to actual execution. Common timing failure modes include:
- delayed acknowledgment leading to worse prices,
- slow matching/fill relative to peers, or
- uneven timing across order sizes.
If timestamps are missing or inconsistent, timing-quality conclusions become unreliable.
- Fill quality and completion Orders can be executed fully or partially, sometimes across multiple fills. Evaluate:
- proportion of the order filled,
- average price across fills,
- whether slippage concentrates at certain moments (for example, only when volatility spikes).
- Total transaction cost (not just price) Price quality alone can be misleading. Use total effective cost, including costs you can define from data (spreads, commissions, and any explicitly stated fees). Also treat slippage as the realized difference between the reference and executed price.
A realistic evidence example (and what it can’t prove)
Imagine you want to compare execution quality for a set of limit and market orders over the same time window.
A reasonable approach is:
- Define an order set and direction rules (buy/sell).
- Choose a single benchmark rule (for example, mid-price at order acceptance timestamp).
- Compute implementation shortfall for each execution.
- Split results by order size and by market regime (calm versus volatile), because slippage typically changes with conditions.
A material limitation is that even if you observe stable differences between two providers, those differences can be driven by selection effects. For example, one provider may receive more executions during better liquidity periods, or the reference timestamp may not align with when the provider actually exposed the order to the market.
This is why results should be treated as evidence about your sample and methodology, not a universal claim.
Limitations and failure modes to watch
At least one common failure mode should be tested explicitly:
- Timestamp and data integrity issues: if order acceptance time is not recorded consistently, timing and benchmark comparisons can be biased.
- Partial fill masking: averaging fill prices can hide the fact that a portion executed at a much worse time.
- Hidden cost components: if you omit certain fees or use inconsistent spread calculations, “price quality” can look better than reality.
- Changing market conditions: historical averages may not reflect future volatility or liquidity.
Also note a core constraint: execution quality is not purely under a provider’s control. Market impact, liquidity, and volatility determine what counterparty prices are available at each moment.
Verification checklist and next question
To independently verify execution-quality claims tied to FCA-style concepts, document your methodology before computing results:
- Reference definition: exact timestamp and price benchmark rule.
- Cost definition: what is included in total effective cost.
- Sample definition: time window, order types, and any filtering rules.
- Failure-mode checks: partial fills, latency gaps, and missing data handling.