A thread on r/algotrading made a point worth stealing: if a strategy fires 300 trades but they all cluster in the same direction, same holding period, same underlying factor, those 300 trades don't behave like 300 independent coin flips — they can behave like 30, or fewer. The fix traders converged on: count distinct holding-period/factor buckets, not raw fills, before trusting a '300 trades, 60% win rate' claim.
Our own overnight replay just showed the same problem live. One strategy cell — mean-reversion on MUB, a bond ETF — has fired 24 times and won 4.2% of them, bad enough that it's about to lose its seat entirely. The exact same mean-reversion idea pointed at SMH (semiconductors) instead: 33 trades, 82% win rate. Same strategy, opposite fate, depending only on which ticker it's aimed at.