Problem 1(25pts) A decision maker (DM) has a Bernoulli utility of wealth that is given
by the function
u(w) = (
w if w ≤ 2
2w − 1 if w > 2.
This DM is considering three lotteries:
Lottery A results in wealth that is distributed according to the pdf
f(w) = (
if w ≥ 4
0 if w < 4.
Lottery B results in wealth that is distributed according to the pdf
g(w) = (
−2w if w ≥ 0
0 if < 0.
Lottery C results in wealth w = 1 with probability 0.5 and wealth w = 5 with probability
a) (5pts) Is the DM risk averse? risk neutral? or neither? Justify your answer
b) (20pts) Which lottery (of the above three lotteries) does the DM prefer?
Problem (25pts) Consider a system consisting of two urns (labelled urn 1 and urn 2),
three white balls and two red balls. At t = 0, two white balls are placed in urn 1. From the
remaining balls, one more ball is randomly selected and placed in urn 1. The remaining two
balls are now placed in urn 2. For each t = 1, 2, 3, · · · , we randomly draw one ball from each
urn and exchange them (the ball that was in urn 1 goes to urn 2 and the one that was in
urn 2 goes to urn 1).
For any t ≥ 0, we say that our system is in state i -for i = 1, 2, 3- if the number of white
balls in urn 1 is i. Let X(t) be the random variable representing the state of the system at
a)(5pts) Find the transition probability matrix for this process.
b)(5pts) Find the initial probability distribution of the states at t = 0.
c)(5pts) What is the probability that the state will be i = 2 at t = 3?
d) (5pts) Find E[X(3)]
e) (5pts) Suppose you get 10 dollars every time the system is at state 1 or 2, and you loose
10 dollars every time the system is at state 3. Suppose you let the system run for a very
long time (say until t=10,000). What is your expected payoff?