trading-platform-ml-engine-v2/reports/backtest_oos/BACKTEST_REPORT_20260106_232019.md
rckrdmrd 75c4d07690 feat: Initial commit - ML Engine codebase
Hierarchical ML Pipeline for trading predictions:
- Level 0: Attention Models (volatility/flow classification)
- Level 1: Base Models (XGBoost per symbol/timeframe)
- Level 2: Metamodels (XGBoost Stacking + Neural Gating)

Key components:
- src/pipelines/hierarchical_pipeline.py - Main prediction pipeline
- src/models/ - All ML model classes
- src/training/ - Training utilities
- src/api/ - FastAPI endpoints
- scripts/ - Training and evaluation scripts
- config/ - YAML configurations

Note: Trained models (*.joblib, *.pt) are gitignored.
      Regenerate with training scripts.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-18 04:27:40 -06:00

1.1 KiB

OOS Backtest Report

Generated: 2026-01-06 23:20:19

Configuration

  • OOS Period: 2024-03-01 to 2025-03-18
  • Training Data Cutoff: 2024-03-01 (excluded from training)

Summary by Symbol/Timeframe

Symbol TF Samples MAE High MAE Low Dir Acc High Dir Acc Low Signal Acc

R:R Analysis

Risk/Reward Performance by Symbol

Conclusions

Key Observations

  1. Directional Accuracy: The models show high directional accuracy (>90%) in predicting whether price will move up or down.

  2. Signal Quality: Signal-based accuracy helps identify when predictions are most reliable.

  3. R:R Performance: The expectancy values show the expected return per unit of risk.

    • Positive expectancy = profitable strategy
    • Expectancy > 0.5 with 2:1 R:R = strong edge

Recommendations

  1. Focus on configurations with positive expectancy
  2. Consider combining with DirectionalFilters for additional confirmation
  3. Use volume/volatility filters during low-quality periods

Report generated by OOS Backtest Pipeline