The Right Balance Between System and Discretion
What Is the Right Balance Between System and Discretion?
Most traders oscillate between two extremes. Pure system: follow the rules no matter what; ignore obvious risks because the rule says to enter. Pure discretion: trade based on intuition, gut feel, and current market narrative; ignore your historical rules because this time feels different. The truth is not in either extreme, but in balance: a framework that is rule-based enough to enforce discipline, but flexible enough to adapt to genuine regime changes and unforeseen conditions. This chapter shows you how to build that balance, how to recognize when to override a rule and when to follow it ruthlessly, and how to preserve the benefits of both systems and discretion.
Quick definition: The system versus discretion balance refers to the degree to which you follow predetermined rules (system) versus making real-time judgments based on current conditions (discretion), while maintaining sufficient discipline to avoid emotional overrides.
Key takeaways
- Pure system fails when market regimes change. A trend-following rule works until markets stop trending and start ranging; a rigid system blinds you to that change.
- Pure discretion fails because of emotion and recency bias. You feel smart after a win and take more risk; you feel terrified after a loss and exit too early.
- The goal is not perfect rules, but good-enough rules that you'll actually follow. A simple rule executed with discipline beats a perfect rule that you override half the time.
- Discretion is for regime recognition, not for ignoring rules. You can use judgment to recognize "this market has changed from trending to ranging" and adjust your rules, but not to say "I feel lucky today, I'll ignore my stop loss."
- Rules protect you from your own worst decisions. In crisis moments, when emotions run highest and stakes feel highest, rules override emotion and keep you alive.
- Regular (quarterly) reviews allow you to update rules without abandoning discipline. The system is not set in stone, but it's not updated on a whim either.
The Problem with Pure System
A pure system follows predetermined rules without exception. No entry conditions, no exits, no judgment. Only rules.
Advantage: You are never surprised by your own behavior. If the rule says exit at 10% loss, you exit at 10% loss, period. You don't agonize. You don't second-guess. You execute.
Disadvantage: You are blind to genuine changes in market conditions. Consider a trend-following rule: "Buy when price closes above the 50-day moving average; sell when it closes below." This works beautifully in trending markets (2015–2019). But in 2020–2021, markets oscillate around the moving average, and the rule whipsaws constantly—buy, immediately hit the stop, sell, reenter, repeat. The rule is generating losses not because it's flawed in principle, but because the market regime changed from trending to ranging.
A pure system trader faces a painful dilemma: abandon the rule (admit that it's broken) or stick with it and suffer months of drawdown. Most pure system traders eventually break and go discretionary, losing both the discipline of the system and the adaptability of discretion.
Another example: Your rule says "do not hold overnight positions; exit at market close." This works during normal liquidity. But in March 2020, the market gap-down 10% at the open. Your position, which you exited at close the day before, drops 10% anyway—you exited to avoid overnight risk, but the market moved overnight via a gap. A pure system trader has no flexibility to adapt; the rule is the rule.
Pure system also fails to account for black swans and circuit breakers. A rule that assumes you can always exit at your specified price fails when trading halts. A rule that assumes historical volatility continues fails when volatility quadruples in a week.
The Problem with Pure Discretion
A pure discretion trader makes real-time judgments based on current conditions, market narrative, and gut feel. No predetermined rules; pure judgment.
Advantage: You can adapt immediately to regime changes. When you recognize that markets have shifted from trending to ranging, you change your approach. When you see a black swan event developing, you reduce risk before it hits. You're flexible and responsive.
Disadvantage: You are fully exposed to emotion, recency bias, and confirmation bias. After a win, you feel confident and take larger positions. After a loss, you feel scared and exit prematurely. You are confident in your judgment during bull markets and terrified during bear markets, which means you're buying high and selling low—the opposite of what you should do.
Consider a discretionary trader in early 2022, watching inflation accelerate. She reads financial news that says "the Fed will have to tighten aggressively," and she decides to reduce her stock position and go 80% cash. This feels wise and prudent. But she's right about the Fed tightening and wrong about the timing of the stock market recovery. Stocks crash 20% more after she exits, then recover 30%. She stays in cash, scared, and misses the whole recovery because she's still afraid.
Pure discretion also leads to outcome bias—you judge your decision by the outcome, not by the quality of the decision at the time. A discretionary trade that makes money feels like a good decision, but it might have been a terrible decision that happened to work out. A discretionary trade that loses money feels like a bad decision, but it might have been a good decision with bad luck.
Another example: A pure discretion trader decides in June 2022, "The Fed will keep raising rates and the stock market will crash another 30%." This feels like a brilliant, forward-looking insight. But it's wrong. By December 2022, markets have stabilized and the trader is sitting in cash, frustrated. He was right about the general direction (rates up, stocks down) but wrong about the magnitude and timing. Because there was no predetermined rule about position sizing or exit conditions, he overcommitted to his view and suffered unnecessary drawdown in the recovery phase.
Pure discretion also suffers from narrative attachment. You develop a story (rates rising, tech stocks will crash, the market is in a secular downtrend) and you become emotionally attached to the story. When evidence contradicts the story, you ignore it. You find confirmation for the story everywhere. Your judgment, which felt like an advantage, becomes a prison.
The Balanced Approach: System + Discretion
The best traders use a system as the default, but retain discretion for regime recognition. Here's the framework:
1. Default to the system. Your predetermined rules are the default behavior. When the market reaches your entry signal, you enter. When the exit condition is hit, you exit. No questions asked.
2. Recognize regime changes. You monitor the market and your rules' performance for signs that a regime has changed. Is your trend-following rule whipsawing? Are volatility assumptions outdated? Are correlations broken? When you observe a genuine regime change, you can update the rules.
3. Update rules quarterly (not daily or weekly). Once a quarter, review your rules' performance. Did the regime change? Do the rules need updating? If so, document the change, backtest it on recent data, and implement it. But do not update on a whim.
4. Update does not mean abandon. When you recognize a regime change and update your rule, you're improving the system, not abandoning it. The discipline remains; only the parameters shift.
5. Document your discretionary decisions. If you override a rule on any given trade, write down why. "I exited early today because the black swan event (Shanghai lockdown, banking crisis) created conditions the rule didn't anticipate." Later, in your quarterly review, you can assess whether this discretionary override was justified and whether the rule should be updated.
6. Distinguish between regime recognition and emotion. Regime recognition sounds like: "The market has shifted from trending to ranging; my trend-following rule is now generating whipsaws. I'm updating the rule to include a range-detection filter." Emotion sounds like: "I feel like the market's going to crash, so I'm going to go to cash." One is a reasoned analysis of changed conditions; the other is fear. Train yourself to recognize the difference.
Real Examples of System + Discretion
Example 1: The trend follower's regime change.
Your rule: "Buy when price closes above 50-day MA; exit when price closes below 50-day MA."
This works beautifully from January–August 2020 (strong uptrend). Win rate: 65%, average winner: 8%, average loser: 2%.
From September 2020 onward, the market enters a range. Your rule generates many small losses as price crosses the 50-day MA repeatedly. Win rate drops to 35%, average loss increases to 5%.
Pure system approach: Keep the rule exactly as is. Accept the whipsaws and hope the market trends again eventually.
Pure discretion approach: Abandon the trend rule. Trade based on gut feel and current market narrative.
Balanced approach: In your quarterly review (December 2020), you recognize the regime change from trend to range. You analyze the data: "From January–August, the rule was profitable. From September–December, it's unprofitable. The market is ranging, not trending."
You update the rule: "Buy when price closes above 50-day MA AND price is not in a range (defined as: high-low of recent 20 bars < 2% of current price)."
Backtest on September–December 2020 data: Win rate improves to 48%, average loser shrinks to 3%. Not perfect, but better.
Implement the updated rule January 2021. You've recognized the regime change and adapted, while maintaining the discipline of a system. You didn't abandon the framework; you improved it.
Example 2: The position size discretion.
Your rule: "Risk 2% of account per trade."
For most trades, you execute this. But you notice that in periods of very high volatility (VIX > 30), your stops are wider, which means a 2% risk stop is farther away, so you have to reduce position size just to hit the 2% risk target. This is cumbersome.
Also, you notice that in very low volatility (VIX < 12), your stops are tight, which means you're taking more trades to risk your 2% (because each stop is so small).
Pure system approach: Stick with the 2% rule regardless of volatility regime. Accept that you'll take many small-risk trades in low volatility and few trades in high volatility.
Pure discretion approach: Adjust position size every day based on gut feel about current volatility.
Balanced approach: In your quarterly review, you recognize the volatility pattern. You implement a volatility-adjusted rule: "Risk 2% of account per trade, adjusted for current 20-day volatility. In high volatility, risk 1.5% and reduce position size. In low volatility, risk 3% and increase position size."
This is still a rule, but it's a smarter rule that adapts to regime changes. You're not discretionary; you're systematic and adaptive.
Example 3: The black swan discretion.
Your IPS specifies: "Maximum drawdown tolerance 30%."
March 2020: The COVID crash begins. In one week, your portfolio drops 22%. Your rule says "hold," because 22% < 30%. But you're watching the news, and everything looks catastrophic. Hospitals are overwhelmed, companies are going bankrupt, unemployment is spiking. You feel like the crash might accelerate to 50%.
Pure system approach: Ignore the news. Your rule says hold at 22% drawdown. Hold.
Pure discretion approach: Panic. The world is ending. Sell everything, go to cash.
Balanced approach: You recognize that this is a potential black swan event—a tail-risk scenario your original rule didn't anticipate. But you also recognize that panic is a bad advisor. You make a deliberate discretionary decision: reduce your equity position from 60% to 40% (trim 25% of your equity holdings), but don't capitulate to 0%. You're exercising judgment ("this might get worse") while staying partially committed ("this could also recover quickly").
Later, as the market stabilizes and recovers in April–May, you're grateful you didn't sell entirely. By June, you're back in your 60/40 allocation. Your discretionary trim was justified by the unusual conditions, but it didn't destroy your long-term discipline.
The Quarterly Review Process
To maintain balance, implement a quarterly (every 3 months) formal review:
1. Review system performance.
- Win rate: Is it within your expected range?
- Average winner vs. average loser: Are winners larger than losers?
- Drawdown: Did you exceed your target?
- Profit/loss: Did you meet your quarterly target?
2. Identify conditions that broke the system.
- Did the market regime change (trend became range, low vol became high vol)?
- Did correlations shift (assets that moved together now diverge)?
- Did a black swan event occur (unexpected news, policy change, geopolitical shock)?
- Did the system's logic still apply, or does it need updating?
3. Document all discretionary overrides.
- Every trade where you ignored the rule: why?
- Did the override make money or lose money?
- Was the override justified (regime change, black swan) or emotional (fear, greed)?
4. Decide: keep, tweak, or replace.
- Keep: Rule is still valid, performance is acceptable, no regime change detected.
- Tweak: Rule is still valid, but performance degraded due to changing market conditions. Update parameters (stop-loss level, entry signal, position size adjustment).
- Replace: Rule is fundamentally broken. Market regime has shifted such that the rule no longer applies. Design a new rule.
5. Update the documented framework.
- Write the changes to your IPS or trading manual.
- Backtest changes on recent out-of-sample data.
- Implement changes starting next quarter.
When to Override a Rule (And When Not To)
You may override a rule in these situations:
Justified overrides:
-
Black swan event with insufficient information. A geopolitical crisis, natural disaster, or policy shock that creates genuine uncertainty. You have imperfect information and can't predict the outcome. It's reasonable to reduce risk temporarily until clarity emerges. Example: Flash crash in 2010; market halted; you can't execute your normal exit. Justified to hold.
-
System failure (technical/logistical). Your broker goes down. Your algo fails. Market halts. You can't execute your rule. Example: Limit-up halt on a commodity future; you can't sell. Justified to hold.
-
Regime change with clear evidence. You have substantial statistical evidence that the market regime has changed and your rules no longer apply. Example: Trend-following rule breaks down in a ranging market; you have 6 weeks of data showing the new regime.
-
Extreme tail event outside historical experience. Your backtest never showed a move this large, a volatility spike this severe, or a correlation shift this dramatic. Your rules assume conditions within historical bounds; this exceeds them. Example: 1987 Black Monday (22% drop in one day); rules built on 10% drawdown assumptions may not be sufficient.
Unjustified overrides (don't do these):
-
Fear after a small loss. You exit a position after a 3% loss because you're nervous. This is emotion, not regime recognition.
-
Greed after a big win. You hold a winning position well past your profit target because you're feeling confident. This is emotion, not evidence-based judgment.
-
Narrative attachment. You read a compelling financial news article that aligns with your worldview, and you adjust your positions based on the narrative. Narratives are seductive; they're also often wrong.
-
Hindsight bias. "I could have predicted the crash if I'd been paying attention." This is revisionism. If you couldn't predict it in real time, don't pretend you can now.
-
Feeling more/less bullish. "I feel like the market is going to go up, so I'm increasing position size." Feelings are not evidence.
The Discipline of Discretion
Ironically, responsible discretion requires more discipline than rigid systems. A pure system trader just follows the rule; no judgment required. A balanced trader must exercise judgment responsibly, which means:
-
Document every override. Force yourself to write down why you overrode the rule. If you can't articulate it, don't override it.
-
Review overrides quarterly. Did they work? Were they justified? If a pattern emerges (you're always overriding when you're afraid, or when you're confident), adjust your rules to account for your biases.
-
Backtest overrides. If you override a rule, backtest what would have happened if you'd followed the rule. Compare outcomes. This teaches you whether your overrides are improving or harming results.
-
Distinguish regime recognition from emotion. Train yourself, through journaling and review, to recognize the difference. Regime recognition is supported by data and analysis. Emotion is supported by narrative and feeling.
-
Respect the spirit of the rule. A rule says "exit at 10% loss." You interpret this as "exit around 10%, give or take 1–2%." That's reasonable adaptation. But "exit at 10% loss, unless I feel like holding" is not respecting the rule; it's abandoning it.
Real-world examples
Example 1: The trend trader's quarterly check. In Q3 2022, you're a trend-following trader. Your rule works well; win rate is 58%, average winner $1,500, average loser $600. You review your quarterly performance and see no regime change. The market is still trending. In Q4 2022, the market enters a tight range (Federal Reserve pause, earnings stabilize). Your win rate drops to 42%. You review in January 2023: "This is a regime change. Markets have shifted from trending to ranging. I'm updating my rule to include a volatility filter." You backtest: win rate improves to 48%. You implement. You didn't abandon the system; you improved it with evidence.
Example 2: The discretionary override that worked. In March 2020, you're a value investor. Your rule says buy when price-to-book < 0.8. Many stocks hit that threshold in March. But you watch the COVID situation escalate, and you decide: "This is unprecedented uncertainty. Normally I'd buy, but I'm going to wait two weeks to see if clarity emerges." You delay entry. By April, panic subsides, and you buy many of the same stocks at better prices with clearer information. Your discretionary delay was justified by a genuine black swan, not by fear. Most traders can't make that distinction; you did.
Example 3: The discretionary override that failed. In November 2021, you're an equity investor. Your rule says stay 60% equities. But you read articles about valuation extremes and Fed tightening, and you feel like the market is going to crash. You discretionarily reduce to 20% equities in December. The market crashes in 2022, and you feel vindicated. But you also stay in cash through the recovery in 2023. Your override was right about the direction, wrong about the timing, and your failure to re-enter after the crash caused long-term damage. This teaches you: discretion is harder than it looks.
Common mistakes
Mistake 1: Rules that are too rigid. A rule that doesn't allow for any discretion is fragile. It breaks when conditions change. Better to build in some flexibility from the start: "Trend-following rule applies when volatility is low; switch to range-trading rule when volatility is high."
Mistake 2: Discretion that's actually emotion. You tell yourself you're exercising judgment when you're actually following fear or greed. Journaling helps: write down your override reason in real time, then review it three months later. If the reason sounds emotional, tighten the rules.
Mistake 3: Ignoring evidence of regime change. The market has shifted, but you stick with your old rule because you're attached to it. Better to watch your performance metrics (win rate, average winner, drawdown) and update when they deteriorate.
Mistake 4: Updating rules too frequently. Quarterly is good; weekly is too frequent. A rule that underperforms for two weeks doesn't need updating; a rule that underperforms for two months might. Set a fixed review date and stick to it.
Mistake 5: Not documenting your framework. If your framework exists only in your head, you'll make different decisions in different emotional states. Write it down. Share it with someone. Make it real.
FAQ
How much discretion should I allow?
Enough to recognize genuine regime changes (5–10% of trading decisions). Not so much that you're trading on intuition (50%+ of decisions). If you're overriding your rules more than once a month, the rules are too rigid or you're being too emotional.
What if I'm usually right about my discretionary overrides?
Be skeptical. Confirmation bias is powerful. You remember the times your override was correct; you forget or downplay the times it was wrong. Track your overrides rigorously. Calculate win rate of overrides vs. following the rule. Most traders will find that following the rule is better over time.
Should I tell someone about my system and discretion framework?
Yes. Tell your spouse, a friend, or an advisor. This serves two purposes: it keeps you honest (you're less likely to exercise "discretion" if someone knows you agreed to the system), and it provides an outside perspective (someone else can tell you whether your override is regime recognition or emotion).
Can I have different rules for different life situations?
Yes. You might have aggressive trading rules when you're young and can afford losses, and conservative rules when you're nearing retirement. Document both. As your life changes, you shift from one framework to the other. This is different from changing rules on a whim.
What if the market is in a regime I've never seen before?
Then your backtest and historical experience are less relevant. Reduce position size and risk. Increase monitoring. Be humble. Your rules work in regimes that resemble the past; unprecedented regimes require exceptional caution.
Related concepts
- Investment Policy Statement
- Stress Testing Your Rules
- Updating Your Framework as Life Changes
- Real Investment Policy Statement Examples
- What Is a Black Swan
Summary
The best traders balance systems and discretion. Rules provide discipline, consistency, and protection from emotion; they prevent you from making your worst decisions when fear and greed run highest. Discretion provides adaptability, regime recognition, and the ability to handle unprecedented situations. The balanced approach: default to the system, but retain discretion for genuine regime changes and black swan events. Update your rules quarterly based on performance data and regime analysis, not on daily emotion. Document every discretionary override so you can later assess whether it was justified. Train yourself to distinguish regime recognition (supported by data) from emotion (supported by feeling). This balance is not easy; it requires discipline, humility, and honest self-assessment. But it is the most reliable path to long-term trading success.