Skip to content
Get started

Discounted value of a regime chain

A strategy alternates between two market regimes that follow a Markov chain. In regime A it earns +1+1 per period and in regime B it earns −2-2 per period (paid at the start of each period, in the current regime). From A the chain stays in A with probability 0.80.8; from B it moves to A with probability 0.50.5. Future earnings are discounted by γ=0.9\gamma = 0.9 per period. Starting in A, what is the expected discounted sum of all earnings? Give three decimals.

Show hints (2)+
  1. Write VAV_A as the immediate reward plus γ\gamma times the expected value of the next state.
  2. You get two linear equations in VAV_A and VBV_B.

Answer

Reveal answer →

2.603 (± 0.002)

Create a free account to see the full worked solution and track your progress.

Interview format: Hedge Fund Quant, Systematic & Data-Driven Trading

Related questions