How to Improve Stock Market Backtesting

In this video, I’ll show you one way to improve your stock market backtesting results.

This method is the one used by my research partner Roger Crandell and me when refining The 9% Signal.

One common problem with backtesting is curve fitting, which is finding a system in retrospect that would have maximized returns in the past market. For example, getting the most out of this two-year TQQQ chart:

[Chart shown in the video, at 1:09.]

The problem is that how the market moved in any period of the past is not guaranteed to repeat. What worked then, probably won’t work now.

We can extract elements from past price behavior, however, to construct a market characteristic.

For instance, this a seven-year scatter plot of TQQQ’s daily percentage price changes:

[Scatter plot shown in the video, at 3:20.]

We can defining this price behavior profile.

Then put it into a restricted randomizer that generates daily changes within this profile to simulate many markets.

This is key: Why is the real market of the past any more valid than a simulated one of the same profile?

We believe it’s not, and put the 9Sig plan through a rigorous test bed of not just a lengthy real-life backtest of 30 years, but 100 simulated 30-year markets.

Listen to this pull quote from this year’s Note 1 from The Kelly Letter:

[Quote shown in the video, at 5:42.]

From this, we zeroed in on the parameters that delivered the best results most of the time.

Could still be wrong, but offers better odds than just the one test bed of actual historical market data.


Want more videos like this? Subscribe to The Kelly Letter YouTube channel.

Thank you for watching!

This entry was posted in Research, Trading Tactics, Video. Bookmark the permalink. Both comments and trackbacks are currently closed.
  • The Kelly Letter
    A Complete Investment Management System
    The Kelly Letter  every Sunday morning by email.
    Like no other. Many subscribers say this is the best read of their week, astonishing in its ability to distill seven days of noise into one succinct overview of the very few items that might matter. Start your Sundays right!
    A one-page Quick Start Guide
    with page number references to full information in The 3% Signal. You'll receive access to this right away so you can begin transforming your portfolio into a performance machine immediately.
    The 3Sig Calculator.
    A thing of beauty! You'll use it to generate your own personal signals every quarter including exact share amounts to buy and sell based on your account balances. It emails you the results to make later quarters easy by keeping last quarter's numbers at your fingertips. Some subscribers say this tool alone justifies their subscription price.
    The subscriber-only section of this website
    where likeminded investors are commenting on notes and discussing in forums. Jason joins these interactions every day. They're a treasure trove of investing tips and wisdom.
    The archive of Kelly Letter notes.
    It’s a research center, searchable and smartly tagged to make gathering time-stamped material on covered subjects easy.
    The subscriber podcast.
    Jason reads every letter word-for-word. This feature was requested by subscribers who prefer audio learning. They listen on their Monday morning commute, during a workout, or while reading along at their computer.



    $200/year
    Save 17%



    $20/month
    Pay as you go
    Or sign up to receive free email and learn more about the system.
    Do you have a question?
Bestselling Financial Author