How to Improve Stock Market Backtesting

In this video, I’ll show you one way to improve your stock market backtesting results.

This method is the one used by my research partner Roger Crandell and me when refining The 9% Signal.

One common problem with backtesting is curve fitting, which is finding a system in retrospect that would have maximized returns in the past market. For example, getting the most out of this two-year TQQQ chart:

[Chart shown in the video, at 1:09.]

The problem is that how the market moved in any period of the past is not guaranteed to repeat. What worked then, probably won’t work now.

We can extract elements from past price behavior, however, to construct a market characteristic.

For instance, this a seven-year scatter plot of TQQQ’s daily percentage price changes:

[Scatter plot shown in the video, at 3:20.]

We can defining this price behavior profile.

Then put it into a restricted randomizer that generates daily changes within this profile to simulate many markets.

This is key: Why is the real market of the past any more valid than a simulated one of the same profile?

We believe it’s not, and put the 9Sig plan through a rigorous test bed of not just a lengthy real-life backtest of 30 years, but 100 simulated 30-year markets.

Listen to this pull quote from this year’s Note 1 from The Kelly Letter:

[Quote shown in the video, at 5:42.]

From this, we zeroed in on the parameters that delivered the best results most of the time.

Could still be wrong, but offers better odds than just the one test bed of actual historical market data.


Want more videos like this? Subscribe to The Kelly Letter YouTube channel.

Thank you for watching!

This entry was posted in Research, Trading Tactics, Videos. Bookmark the permalink. Both comments and trackbacks are currently closed.
  • Here are your three options:

    Option 1: Annual Subscription (no refunds)

    For just $200 per year, you’ll receive everything listed above to completely upgrade the way you manage your investments. This is 17% cheaper than the monthly option. This is what I recommend:






    Option 2:Monthly Subscription (no refunds)

    If you'd like to try The Kelly Letter  without paying the full year, you can pay $20 per month.





    Option 3:Free Email List

    If you'd like to hear more from me but aren't ready to part with any money yet, you're welcome to join my free email list:

    Join the free list





    Thank you for the work you do. You're a household name here and my wife and I often discuss your letters on Sundays. My ten- and seven-year-old children recognize your name and will eventually be taught to invest using 3Sig and 6Sig. You've had an enormously positive impact on our investing and inspired me to look at the world in more rational and clear terms than I did years ago. I'm sure that thousands of others would say the same. Kelly Letter subscriber Matt Barnes
    Matt Barnes
    Product Line Director
    OCLC

    Join Matt and thousands of other rational investors to invest without stress.

    Subscribe to The Kelly Letter  now!

Bestselling Financial Author