Luck or statistical tendency? - that is the question

When running even the best designed backtesting and optimization tests, there is always a chance that our results are just by luck. There are a few ways to minimize that chance though and gather evidence that



“our test results from the past are, most likely, similar to what we would get in the future.”



While we can only scratch the surface of statistical testing in a post like this, consider some of those ways below, as you run your own tests:

  • Run the backtests with robust settings. Finetuning settings endlessly while running and re-running backtests is enticing, but leads nowhere.

  • Run the tests on various market environments (trending, range-bound), on various asset classes and instruments to see how the strategy holds up.

  • Make sure you have many events in your tests: statistical realities emerge over a large sample size. Think years and thousands of trades.

  • Always know your longest expected losing streak (every strategy has one), and plan your account size accordingly. In the life of every trader, the day will come when your account will be stress-tested.

  • Always be aware of the constraints of any backtests (your order was not really there, your order does not always get filled, your stop may not always protect you, futures contracts do expire, data from the past is a recreated version of reality, your internet connection is not 100% stable, computers can crash, hard drives may fail, you’re thousands of miles from the CME mainframes, and so on, and so on, and so on).

  • At the end, even with all the above precautions, and considerations, the results of a statistical test could still be just by luck. After all, nobody knows the future. You can minimize that chance of luck and build evidence that that is not the case by running Monte Carlo tests. Which is what we did, at the end of all our backtesting and optimization work in our quantitative work recently, in the video above. It shows that our equity curves are quite unlikely the result of luck. On the contrary: it is quite likely that our test results, those equity curves are the result of a statistical tendency. Which is the most we or anyone can say about a future that hasn’t happened yet.

  • It’s easy to see, our strategy stands tall in quantitative rigour. We hope you’ll have a serious look at our Remek! Momentum Pro Standalones, but whatever method or strategy you decide to trade with, passing such tests with such flying colours is the minimum you should demand, before you even risk a single dollar of yours on the markets.

So let’s re-visit our video series, including our forward-testing “month in an hour” series, all the backtests, the reserved optimizations, and those Monte Carlo tests. Numbers do not lie, and verifying and re-creating our tests is easy. You’ll find what we have found: The Remek! Momentum Pro Standalones captures and exploits crowd behaviour efficiently.

A 15-day FREE TRIAL as well as myth-free training and education and an extensive library of resources, not to mention our rock-solid Forum are all available to you to help you be the best trader you can. With 2024 just starting, and with the NQ at 52-week highs, we see no reason to delay.

The anatomy of a trade

If a picture can be worth a thousand words, this ZN chart below is one of those pictures. Here are a few thoughts as we plan our actions on this market in the hours ahead. Note: the trigger hasn’t arrived yet, and we’re speaking about the proverbial hard right edge of the chart aka the future.

  • “Many of our basic emotions still run on stone age code.” - Yuval Noah Harari

  • A crowd exposed to hope and fear tends to act, however rational humans would like to think they are, in a certain way, whether it’s 10,000 BC or 2000 AD.

  • The Remek! Momentum Pro Standalones, built for Ninjatrader 8, monitors, with smart, self-adapting mathematical methods we call the Remek! algorithm, the movement of the crowd, and identifies engagement points with the highest chance of a predicted outcome (called triggers).

  • We then use those triggers to participate in the expected crowd behaviour
    a) on a given time horizon
    b) with a given pre-defined, self-adapting set of rules, we call trade management rules (i.e. target, stop, trailing rules)
    c) to reach a positive probabilistic outcome over a large number of instances we call an edge.

There is no reason you should miss these opportunities: get the tool, learn the method!