Analytic solution to variance optimization with no short positions

I. Kondor, G. Papp, Fabio Caccioli

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

We consider the variance portfolio optimization problem with a ban on short selling. We provide an analytical solution by means of the replica method for the case of a portfolio of independent, but not identically distributed, assets. We study the behavior of the solution as a function of the ratio r between the number N of assets and the length T of the time series of returns used to estimate risk. The no-short-selling constraint acts as an asymmetric regularizer, setting some of the portfolio weights to zero and keeping the out-of-sample estimator for the variance bounded, avoiding the divergence present in the non-regularized case. However, the ban on short positions does not prevent the phase transition in the optimization problem, only shifts the critical point from its non-regularized value of to 2, and changes its character: at the out-of-sample estimator for the portfolio variance stays finite and the estimated in-sample variance vanishes, while another critical parameter, related to the estimated portfolio weights and the condensate density, diverges at the critical value . We also calculate the distribution of the optimal weights over the random samples and show that the regularizer preferentially removes the assets with large variances, in accord with one's natural expectation.

Original languageEnglish
Article number123402
JournalJournal of Statistical Mechanics: Theory and Experiment
Volume2017
Issue number12
DOIs
Publication statusPublished - Dec 12 2017

Fingerprint

Analytic Solution
optimization
Optimization
estimators
Optimization Problem
Replica Method
Estimator
Sample variance
Portfolio Optimization
Condensate
Diverge
Identically distributed
Critical value
Vanish
Critical point
Divergence
Analytical Solution
guy wires
Phase Transition
replicas

Keywords

  • cavity and replica method
  • quantitative finance
  • risk measure and management

ASJC Scopus subject areas

  • Statistical and Nonlinear Physics
  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Cite this

Analytic solution to variance optimization with no short positions. / Kondor, I.; Papp, G.; Caccioli, Fabio.

In: Journal of Statistical Mechanics: Theory and Experiment, Vol. 2017, No. 12, 123402, 12.12.2017.

Research output: Contribution to journalArticle

@article{543f5c9fffa748cca603979e822f628e,
title = "Analytic solution to variance optimization with no short positions",
abstract = "We consider the variance portfolio optimization problem with a ban on short selling. We provide an analytical solution by means of the replica method for the case of a portfolio of independent, but not identically distributed, assets. We study the behavior of the solution as a function of the ratio r between the number N of assets and the length T of the time series of returns used to estimate risk. The no-short-selling constraint acts as an asymmetric regularizer, setting some of the portfolio weights to zero and keeping the out-of-sample estimator for the variance bounded, avoiding the divergence present in the non-regularized case. However, the ban on short positions does not prevent the phase transition in the optimization problem, only shifts the critical point from its non-regularized value of to 2, and changes its character: at the out-of-sample estimator for the portfolio variance stays finite and the estimated in-sample variance vanishes, while another critical parameter, related to the estimated portfolio weights and the condensate density, diverges at the critical value . We also calculate the distribution of the optimal weights over the random samples and show that the regularizer preferentially removes the assets with large variances, in accord with one's natural expectation.",
keywords = "cavity and replica method, quantitative finance, risk measure and management",
author = "I. Kondor and G. Papp and Fabio Caccioli",
year = "2017",
month = "12",
day = "12",
doi = "10.1088/1742-5468/aa9684",
language = "English",
volume = "2017",
journal = "Journal of Statistical Mechanics: Theory and Experiment",
issn = "1742-5468",
publisher = "IOP Publishing Ltd.",
number = "12",

}

TY - JOUR

T1 - Analytic solution to variance optimization with no short positions

AU - Kondor, I.

AU - Papp, G.

AU - Caccioli, Fabio

PY - 2017/12/12

Y1 - 2017/12/12

N2 - We consider the variance portfolio optimization problem with a ban on short selling. We provide an analytical solution by means of the replica method for the case of a portfolio of independent, but not identically distributed, assets. We study the behavior of the solution as a function of the ratio r between the number N of assets and the length T of the time series of returns used to estimate risk. The no-short-selling constraint acts as an asymmetric regularizer, setting some of the portfolio weights to zero and keeping the out-of-sample estimator for the variance bounded, avoiding the divergence present in the non-regularized case. However, the ban on short positions does not prevent the phase transition in the optimization problem, only shifts the critical point from its non-regularized value of to 2, and changes its character: at the out-of-sample estimator for the portfolio variance stays finite and the estimated in-sample variance vanishes, while another critical parameter, related to the estimated portfolio weights and the condensate density, diverges at the critical value . We also calculate the distribution of the optimal weights over the random samples and show that the regularizer preferentially removes the assets with large variances, in accord with one's natural expectation.

AB - We consider the variance portfolio optimization problem with a ban on short selling. We provide an analytical solution by means of the replica method for the case of a portfolio of independent, but not identically distributed, assets. We study the behavior of the solution as a function of the ratio r between the number N of assets and the length T of the time series of returns used to estimate risk. The no-short-selling constraint acts as an asymmetric regularizer, setting some of the portfolio weights to zero and keeping the out-of-sample estimator for the variance bounded, avoiding the divergence present in the non-regularized case. However, the ban on short positions does not prevent the phase transition in the optimization problem, only shifts the critical point from its non-regularized value of to 2, and changes its character: at the out-of-sample estimator for the portfolio variance stays finite and the estimated in-sample variance vanishes, while another critical parameter, related to the estimated portfolio weights and the condensate density, diverges at the critical value . We also calculate the distribution of the optimal weights over the random samples and show that the regularizer preferentially removes the assets with large variances, in accord with one's natural expectation.

KW - cavity and replica method

KW - quantitative finance

KW - risk measure and management

UR - http://www.scopus.com/inward/record.url?scp=85039781243&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039781243&partnerID=8YFLogxK

U2 - 10.1088/1742-5468/aa9684

DO - 10.1088/1742-5468/aa9684

M3 - Article

AN - SCOPUS:85039781243

VL - 2017

JO - Journal of Statistical Mechanics: Theory and Experiment

JF - Journal of Statistical Mechanics: Theory and Experiment

SN - 1742-5468

IS - 12

M1 - 123402

ER -