A standard statistical safety check used by the world's biggest hedge funds is actually filtering out their most profitable strategies.
April 25, 2026
Original Paper
Predictive Value of Within-Strategy Permutation Tests for Forward Selection: Evidence from Over 6 Billion Strategy-Level Permutations Across Three Asset Classes
SSRN · 6636018
The Takeaway
Monte Carlo permutation tests are designed to stop traders from getting lucky on fluke results. However, an analysis of 6 billion permutations shows these tests have a negative impact on portfolio performance. They systematically remove strategies that would have made money in the real world. Quantitative funds are relying on a safety tool that is making them less competitive. This discovery suggests that the industry's primary method for avoiding overfitting is deeply flawed.
From the abstract
<p>Within-strategy Monte Carlo permutation testing—shuffling a strategy's trade returns to assess significance—rests on an exchangeability assumption that financial time series violate. Does acting on the test's output improve forward strategy selection? We evaluate this across 437,911 strategy configurations (8 indicator families; within-family bar-level PnL correlations average only |ρ| = 0.031, refuting the common assumption of near-duplicate return streams among parameter variants) on nine i