What Does Not Work, and the Data
What Does Not Work, and the Data
Technical analysis has an image problem. Search any finance forum or academic paper, and you will find fierce debate: Does it work? Is it pseudoscience? The truth is less dramatic and far more useful than either extreme. Technical analysis does not work the way many beginners believe it does—there is no holy-grail indicator, no pattern with 80% accuracy, no free edge waiting to be found. But the data also does not say technical analysis is worthless.
This chapter cuts through the noise with brutal honesty. We examine what academic research actually shows, where most backtests mislead you, why survivorship bias inflates success stories, and what retail traders can realistically expect. You will learn to distinguish between what the data supports and what traders imagine—a critical skill that most traders never develop. By the end, you will have realistic expectations about technical analysis and understand which tools and approaches stand up to scrutiny.
Why this matters
Millions of traders lose money because they were sold a fantasy. A glossy trading course promises 75% win rate. YouTube channels cherry-pick winning trades. Backtests show fictional profits. When reality arrives—when your 75% win-rate system loses six trades in a row—the disappointment and confusion are profound.
This chapter is the antidote. Understanding what the data actually supports is not demoralizing; it is liberating. It lets you avoid the traps that destroy most new traders, set realistic expectations, and focus your effort on what actually works instead of chasing mirages.
What you will learn
Across the articles in this chapter, you will discover:
- How the random walk hypothesis challenges technical analysis and why the debate matters to your trading.
- What academic research consistently finds about chart patterns, indicators, and trend-following—and where academic conclusions fall short for retail traders.
- The deadly impact of survivorship bias: why the best traders you know about are probably survivorship bias in action.
- How curve-fitting and overfitting ruin backtests and create systems that work perfectly on historical data but fail in real time.
- The backtesting pitfalls that inflate returns: look-ahead bias, slippage assumptions, transaction costs, and how to spot them in your own work.
- What the data does support: which technical approaches—trend-following, volatility measurement, support-and-resistance zones—hold up under scrutiny.
- Realistic expectations for retail traders: how to think about edge, sample size, and long-term performance.
How to read this chapter
Read these articles in order. They build from theory (what random walk and academic studies say) through common pitfalls (how backtests deceive) to practical insight (what the data actually supports). We assume basic familiarity with backtesting and the tools described in earlier chapters. This chapter is intentionally skeptical and data-driven; if it conflicts with promises you have heard from trading gurus, that is the point.
By the final articles, you will have a clear-eyed framework for evaluating any technical analysis claim and will know which results to trust and which to question.
Articles in this chapter
📄️ Honest Evidence
Evidence-based examination of whether technical analysis actually works. Academic research, practitioner data, and honest limitations explained.
📄️ Random Walk Theory
Random walk theory explains why price changes may be unpredictable. What the evidence says about whether markets are truly random walks.
📄️ Academic Studies
Comprehensive review of academic research on technical analysis. What peer-reviewed finance journals conclude about chart patterns and trading rules.
📄️ Survivorship Bias
How survivorship bias distorts trading performance data. Why stories about successful traders systematically exaggerate their skill and historical edge.
📄️ Overfitting
How overfitting inflates backtest results. Why strategies that worked perfectly in the past fail in real trading and forward testing.
📄️ Data-Mining Bias
Why searching for patterns in historical data almost always finds something by chance. How data mining creates false trading signals and misleading backtests.
📄️ Backtesting Pitfalls
Backtesting pitfalls expose fatal flaws in strategy validation. Learn why historical performance lies about the future.
📄️ Look-Ahead Bias
Look ahead bias inflates backtest returns by using unavailable data. Learn how hidden timing errors sabotage strategy validation.
📄️ Hindsight Bias Patterns
Hindsight bias patterns make historical trends seem inevitable and predictable. Learn why the past always looks clearer than the future.
📄️ Indicator Overload
Indicator overload corrupts trading decisions by mixing contradictory signals and introducing noise. Learn why more indicators don't improve returns.
📄️ Illusion of Precision
The illusion of precision in trading systems creates false confidence in predictions. Learn why exact price targets rarely materialize as expected.
📄️ Confirmation Bias
Confirmation bias in charting blinds traders to evidence against their positions. Learn how selective attention costs money in real trading.
📄️ Overtrading Cost
How overtrading cost erodes returns through fees, taxes, and slippage—a hidden drag on performance.
📄️ Chart Patterns Effectiveness
Evidence on whether chart patterns like head-and-shoulders and triangles predict price moves—and why pattern recognition is mostly pattern illusion.
📄️ Indicator Effectiveness
Testing RSI, MACD, moving averages, and other indicators on real data reveals why most have no edge after costs.
📄️ Base-Rate Problem
How base rates—the probability that something happens by chance—expose technical analysis claims as worse than random.
📄️ Transaction Costs
The relationship between edge and transaction costs—why most technical strategies lose money after paying the market.
📄️ Luck vs. Skill
Why luck, not skill, explains most trading returns—and how to distinguish genuine edge from statistical noise.
📄️ What the Data Supports
Evidence-based review of technical analysis methods that survive statistical scrutiny and academic testing
📄️ Trend Following Evidence
Comprehensive analysis of trend following evidence, documented returns, and empirical support from academic and institutional research
📄️ Honest Expectations
Realistic earnings, drawdown, and profitability targets for retail traders using technical analysis, with math and case studies
📄️ Using TA Honestly
Practical framework for implementing technical analysis with discipline, avoiding bias, measuring edge objectively, and staying honest about results