How to Improve Stock Market Backtesting

In this video, I’ll show you one way to improve your stock market backtesting results.

This method is the one used by my research partner Roger Crandell and me when refining The 9% Signal.

One common problem with backtesting is curve fitting, which is finding a system in retrospect that would have maximized returns in the past market. For example, getting the most out of this two-year TQQQ chart:

[Chart shown in the video, at 1:09.]

The problem is that how the market moved in any period of the past is not guaranteed to repeat. What worked then, probably won’t work now.

We can extract elements from past price behavior, however, to construct a market characteristic.

For instance, this a seven-year scatter plot of TQQQ’s daily percentage price changes:

[Scatter plot shown in the video, at 3:20.]

We can defining this price behavior profile.

Then put it into a restricted randomizer that generates daily changes within this profile to simulate many markets.

This is key: Why is the real market of the past any more valid than a simulated one of the same profile?

We believe it’s not, and put the 9Sig plan through a rigorous test bed of not just a lengthy real-life backtest of 30 years, but 100 simulated 30-year markets.

Listen to this pull quote from this year’s Note 1 from The Kelly Letter:

[Quote shown in the video, at 5:42.]

From this, we zeroed in on the parameters that delivered the best results most of the time.

Could still be wrong, but offers better odds than just the one test bed of actual historical market data.


Want more videos like this? Subscribe to The Kelly Letter YouTube channel.

Thank you for watching!

This entry was posted in Research, Trading Tactics, Video. Bookmark the permalink. Both comments and trackbacks are currently closed.

  • Select Your Subscription

    Disciplined, systematic investing with The Kelly Letter signal plans.

    Monthly Plan
    $105
    / month

    Flexible month-to-month access to The Kelly Letter every Sunday, with all Sig plans, the complete user guide, calculator, and subscriber forums.

    • Weekly Kelly Letter
      (Sunday mornings)
    • Podcast of every letter read by Jason
    • All Sig plans (3Sig, 6Sig, 9Sig, Income Sig)
    • Subscriber-only calculator, user guide, and forums
    Best Value
    Annual Plan
    $1050
    / year

    Save 24% vs monthly. Everything in the Monthly Plan plus a complimentary Wall Street Wink subscription. A comprehensive package for disciplined investors.

    • Weekly Kelly Letter (Sunday mornings)
    • Podcast of every letter read by Jason
    • All Sig plans (3Sig, 6Sig, 9Sig,
      Income Sig)
    • Subscriber-only calculator, user guide, and forums
    • Complimentary Wall Street Wink subscription ($120 value)
    • 24% savings compared with monthly
    Wall Street Wink

    Included Free with Annual Plan

    Annual Kelly Letter subscribers get Wall Street Wink at no extra cost.

    Wall Street Wink — Standalone Subscription

    $100
    per year
    / $10
    per month

    Jason Kelly’s midweek market commentary:
    succinct, insightful, and built for busy schedules.

    • Concise single-session reports
    • Informative, readable analysis
    • Does not include The Kelly Letter
Bestselling Financial Author