The probability of back-test over-fitting

Bailey, David H. and Borwein, Jonathan M. and de Pardo, Lopez M. and Zhu, Qiji J. (2015) The probability of back-test over-fitting. Financial Mathematics .

[img] PDF
Download (1551Kb)


    Many investment firms and portfolio managers rely on backtests (i.e., simulations of performance based on historical market data) to select investment strategies and allocate capital. Standard statistical techniques designed to prevent regression over-fitting, such as holdout, tend to be unreliable and inaccurate in the context of investment backtests. We propose a general framework to assess the probability of backtest over-fitting (PBO). We illustrate this framework with specific generic, model-free and nonparametric implementations in the context of investment simulations, which implementations we call combinatorially symmetric cross-validation (CSCV). We show that CSCV produces reasonable estimates of PBO for several useful examples.

    Item Type: Article
    Subjects: UNSPECIFIED
    Faculty: UNSPECIFIED
    Depositing User: Mrs Naghmana Tehseen
    Date Deposited: 27 Jun 2016 13:08
    Last Modified: 27 Jun 2016 13:08

    Actions (login required)

    View Item