Backtesting
Backtesting is where most quant strategies go wrong, not because the code is buggy, but because the methodology is flawed. I write about the biases that inflate backtest results (look-ahead, survivorship, overfitting) and the statistical techniques that keep you honest. If your backtest looks too good, these articles will help you figure out why.
Metamorphic Relations for Backtests: Testing the Engine, Not the Strategy
You often don’t know the “correct” output of a backtest. But you know relationships that must hold when you transform the inputs. Increase fees, performance should drop. Scale …
Monte Carlo Permutation Tests for Strategy Significance: Is Your Alpha Real or Random?
Shuffle your signal, re-run the backtest 10,000 times, see if your strategy beats random. Permutation tests provide a distribution-free way to assess strategy significance. This article covers the …
Bootstrap Methods for Strategy Robustness: Resampling When You Can't Get More Data
You have one history of market data. Your strategy was designed on that history. How do you estimate performance on data you haven’t seen? Bootstrap resampling generates synthetic histories that …
A Taxonomy of Backtest Lies: Survival Bias, Lookahead Bias, and the Rest
Every backtest is biased. The question is how badly and in which direction. This article catalogs the biases that corrupt backtesting results, from survivorship and lookahead to time-period, …
Walk-Forward Optimization: Anchored vs. Rolling Windows and When Each Fails
Walk-forward validation is the backbone of out-of-sample testing for trading strategies. But the choice of window type, window length, and step size introduces meta-parameters that can themselves be …
Autocorrelation and What It Means for Your Backtest P&L
Autocorrelated returns inflate Sharpe ratios, invalidate standard significance tests, and make backtests look better than reality. This article explains why strategy returns are almost always …
The Perfection Paradox in Quantitative Development
Why chasing the perfect backtest, optimal parameters, or flawless infrastructure can stall your trading research. Strategies for balancing rigor with progress.