BlackArbs Research
Research Question

Which optimizer target should we trust out of sample?

We tested whether the score that looks best during optimization actually points to portfolios with better future paths.

8optimizer targets compared, including geometric Martin itself
2future test periods: recent and longer
1main goal: good compounding without ugly path pain
Disclosure

Educational Risk Disclosure

This presentation is for education and research process review only. It is not personalized investment, trading, legal, tax, or financial advice.

02 / 13

Trading Risk

  • Trading and investing involve risk.
  • You can lose principal.
  • No strategy or model guarantees profits.

Evidence Limits

  • Backtests and holdouts depend on assumptions and historical data.
  • Validation reduces false confidence; it does not remove uncertainty.
  • Future market behavior can differ materially from tested periods.

Use Scope

  • The examples are research artifacts, not trade instructions.
  • Objective rankings are evidence for review, not a recommendation to buy or sell.
  • Position sizing, taxes, suitability, and execution constraints are out of scope.
Why path quality matters

A good final return can hide a bad ride.

The highlighted windows finish with similar median returns, but very different path pain.

03 / 13
High and low path quality example
What we measured

We rewarded smooth compounding, not just bigger returns.

04 / 13

Plain English

  • Grow capital out of sample.
  • Avoid long, painful drawdowns.
  • Keep max drawdown as a veto/diagnostic, not the whole score.
Compounded growth

How well the portfolio actually grows over the future path.

/
Path pain

How deep and persistent the drawdowns are along the way.

The main score is geometric Martin: future compounding divided by drawdown pain.

Scoring rule
Main result

Which targets produced the best future paths?

This now includes geometric Martin as an optimizer target, not just as the OOS scoring rule.

05 / 13
Future path quality by optimizer target
Stability check

Did the ranking hold up when the future test got longer?

Top is best. The direct geometric-Martin objective did not stay ahead once the test period got longer.

06 / 13
Ranking shift between recent and longer future tests
Predictive power

Did the optimizer score predict better future paths?

This asks whether higher in-sample optimizer scores actually pointed to better future path quality.

07 / 13
Predictive power for future path quality
Recent vs longer test

The longer future test made the signal clearer.

A target can look okay recently and much more decisive over a longer future period.

08 / 13
Predictive power by future test period
Growth sanity check

Did the result still make sense on pure growth?

This checks whether the same optimizer scores also line up with future growth.

09 / 13
Growth sanity check
Tail sanity check

Did the result still make sense after looking at bad tails?

This checks whether the optimizer score also lines up with cleaner upside/downside behavior.

10 / 13
Tail and pain sanity check
Final score

Put the evidence into one stability ranking.

The final ranking combines future path quality, predictive power, and consistency. Lower is better.

11 / 13
Final stability ranking
Score components

Why does the longer holdout rank them this way?

The direct geometric-Martin objective had a decent IC, but weaker longer-period path rank and consistency.

12 / 13
Stability score component decomposition
Answer

What should we take away?

13 / 13
Target
Recent rank
Longer rank
Longer GM
GM IC
Read
Sharpe
2
1
13.388
0.668
Best longer-period path score and strongest longer-period predictiveness.
VI composite
1
2
7.579
0.418
Best recent stability rank; still competitive in the longer test.
Gain-to-pain
7
2
7.435
0.311
Improved sharply in the longer test, but weaker recent stability.
Geometric Martin
4
4
6.816
0.451
Surprise: optimizing the target directly did not beat Sharpe or VI on stability.
Max drawdown
8
7
6.221
0.202
Still better as a veto or diagnostic than the primary objective.

Bottom line: use geometric Martin as the out-of-sample judging rule, but do not assume the geometric-Martin optimizer is the best target. Sharpe and VI remain the current finalists.

Conclusion
Left/Right or Space to navigate