Data Analytics
for Managers
A complete course companion covering Risk Analysis & Simulation, Decision Trees, and Regression Analysis. Built from lecture slides, workshop cases, and your two graded team reports.
Why Simulate?
Simulation is the last resort - not a lazy shortcut. This decision framework lays out four paths to analysing any system. You only reach simulation when the first three are ruled out.
In the course, all three lecture cases - Eagle Airlines, Bryanair, and Freemark Abbey (via @Risk) - involve uncertain inputs that make deterministic analysis misleading. That's exactly the trigger condition.
The Flaw of Averages is the single most important conceptual idea in the simulation module. It explains why deterministic models built on "best guess" inputs consistently mislead decision-makers.
will produce a result that is different from - and often worse than -
the mean of the output obtained by running a full simulation.
i.e.: f(E[X]) ≠ E[f(X)] whenever f is nonlinear (which most business models are)
Bill Brown at Eagle Airlines wants to know if purchasing a Piper Chieftain aircraft is worth $600,000. Caroline's predecessor builds a spreadsheet using best-guess inputs:
Using just the "best guess" values, the deterministic NPV is −$64,782. The model says: don't buy. But this is the Flaw of Averages in action - the simulation mean (which samples across the full uncertainty range) tells a materially different story.
Every uncertain input in a simulation must be assigned a probability distribution. The two distributions used in this course are the Triangular and the Discrete. Choosing the wrong one is an exam trap.
| Property | Triangular Distribution | Discrete Distribution |
|---|---|---|
| Type | Continuous - any value in range possible | Discrete - only specific values possible |
| Parameters | Minimum, Most Likely (Mode), Maximum | List of values, each with a probability |
| When to use | Variable can take any value between a min and max (e.g. utilisation rate, price per hour) | Variable takes one of a fixed set of values (e.g. demand of exactly 2, 3, 4, or 5 defective parts) |
| Probabilities | Individual values have zero probability - only ranges have probability (area under curve) | Each value has an explicit probability; all must sum to 1.0 |
| Course example | Eagle Airlines: Utilisation (min 40%, mode 60%, max 80%) | Bryanair: No-show % mapped to discrete outcomes per flight |
Eagle Airlines utilisation: (0.40 + 0.60 + 0.80) / 3 = 0.60 - note mean equals mode here by symmetry
A simulation engine has three core components working in a loop. Understanding the sequence helps you set up models correctly in @Risk.
Each iteration is one possible future. With 1,000 iterations, you get 1,000 possible futures - and their collective distribution tells you the shape of your risk.
| Output Statistic | What It Means | When It Matters |
|---|---|---|
| Mean | Average result across all 1,000 iterations | Repeated policy decisions - law of large numbers applies |
| Std Deviation | Spread of outcomes around the mean | Measures overall volatility |
| 5th Percentile | 95% of outcomes are above this value | Downside risk / Value at Risk |
| 95th Percentile | Only 5% of outcomes exceed this | Upside potential |
| P(X < 0) | Probability of a loss (or any threshold) | One-off decisions where a single loss is catastrophic |
Bill Brown is the president of Eagle Airlines, a small carrier in south-eastern Australia operating three twin-engine aircraft. He is considering purchasing a fourth aircraft - a Piper Chieftain - at a cost of $600,000. The airline earns revenue from a mix of 40% charter flights and 60% scheduled flights.
Revenue (charter) = $1,900/hr × 40% × 800 hrs = $608,000
Operating costs = $1,200/hr × 800 hrs = $960,000
Fixed costs = $160,000/yr
Profit = $691,200 + $608,000 − $960,000 − $160,000 = $179,200
Taxable profit = $179,200 − depreciation ($120,000) = $59,200
Net profit after tax = $59,200 × (1 − 0.33) + $120,000 = $159,664
NPV (5 years, 15%) = −$64,782 ← deterministic best-guess answer: don't buy
| Uncertain Input | Best Guess | Distribution for Simulation |
|---|---|---|
| Utilisation of scheduled flights | 60% | Triangular (min 40%, mode 60%, max 80%) |
| Ticket price per hour | $240 | Triangular (min $200, mode $240, max $300) |
| Charter price per hour | $1,900 | Triangular (min $1,500, mode $1,900, max $2,200) |
| Hours flown per year | 800 | Triangular (min 600, mode 800, max 1,000) |
| Proportion of scheduled flights | 60% | Triangular (min 50%, mode 60%, max 70%) |
| Operating cost per hour | $1,200 | Triangular (min $1,000, mode $1,200, max $1,500) |
Reading Simulation Output
The @Risk output histogram is the main deliverable of a simulation. Every number on it has a precise meaning. Knowing how to read it is an exam requirement - you will be given a histogram and asked to identify specific values.
| Statistic | Location on Histogram | Interpretation |
|---|---|---|
| Mean | Tallest bar / centre of mass | Average outcome across all 1,000 iterations |
| 5th Percentile | Far left tail marker | 90% VaR - 95% of outcomes exceed this; 5% are worse |
| 95th Percentile | Far right marker | Upside - only 5% of outcomes exceed this |
| 90% Range | Width between 5th and 95th | "Probable range" - where 90% of outcomes fall |
| P(X < threshold) | Area left of a vertical line | Probability that outcome falls below a specific value |
These two metrics are easy to confuse because they both describe the downside of a distribution. The exam will expect you to distinguish them precisely and know when each one matters.
| Value at Risk (VaR) | Probability of Loss | |
|---|---|---|
| Definition | A specific dollar/value threshold - the worst outcome you will experience with a given confidence level | A probability - the chance that the outcome falls below zero (or any given threshold) |
| Form of answer | "I am 90% confident I will not lose more than £X" | "There is a Y% chance of losing money" |
| Read from histogram | The X-axis value at the 5th (or 10th) percentile marker | The area of the histogram to the left of zero (or a threshold) |
| Course examples | Bryanair: 90% range £0 – £12,200 (new policy); lower bound is effectively a 5th-percentile VaR | Bryanair: P(cost > £17,000) = 2% for new policy, 13% for current policy |
| Best for | Quantifying the magnitude of worst-case loss | Quantifying the likelihood of an unacceptable outcome |
P(loss) = area left of X = 0 on the histogram
Example: If the 5th percentile is −£2,000 and 13% of bars fall left of zero:
VaR (90%) = −£2,000 | P(loss) = 13%
This is one of the most tested conceptual distinctions in the simulation module. The right criterion depends entirely on whether you will make this decision once or many times.
| One-off Decision | Repeated Policy | |
|---|---|---|
| Nature | You make this decision once. Whatever happens, happens. | You apply this rule to thousands of flights, customers, or transactions. |
| Law of large numbers? | No - you can't average out across repetitions | Yes - over many repetitions, averages converge to the mean |
| Right criterion | Risk profile, probability of loss, VaR - the full distribution matters | Mean (expected value / EMV) - because you will experience the average over time |
| Course example | Eagle Airlines purchasing an aircraft - Bill Brown does this once; the downside risk of a permanent loss matters | Bryanair overbooking - Bryanair runs this route every day; the average cost across thousands of flights is what matters |
| Decision criterion | Choose the option with acceptable downside risk, even if its mean is slightly lower | Choose the option with the lowest mean cost / highest mean profit |
Repeated policy: Minimise E[cost] or maximise E[profit].
In both cases, simulation gives you the information. What you do with it depends on the context.
After assigning triangular distributions to all six uncertain inputs and running 1,000 iterations in @Risk, the NPV output histogram gives Bill Brown a much richer picture than the deterministic −$64,782.
| Question | Where to find it | What it tells Bill Brown |
|---|---|---|
| What is the average expected NPV? | Mean in the @Risk statistics panel | The long-run expected value of buying the aircraft |
| What is the 90% probable range of NPV? | 5th to 95th percentile on X-axis | How wide the range of outcomes is - a wide range = high uncertainty |
| What is the probability of a negative NPV? | Area of histogram left of X=0 | The chance that buying the plane destroys value |
| Is this a one-off or repeated decision? | Context - Bill Brown buys this plane once | Use risk profile, not just the mean, to decide |
Sensitivity, Tornado & Bryanair
A tornado diagram ranks your uncertain inputs by their impact on the output. The wider the bar, the more that input can swing your result. It tells you where to focus your attention - and where not to bother.
| Feature | What It Means |
|---|---|
| Bar width | The total swing in output when this input moves from its 10th to 90th percentile - wider = more important |
| Left side of bar | Output when input is at its low value (not necessarily negative) |
| Right side of bar | Output when input is at its high value |
| Baseline / centre line | The output at best-guess (mean) inputs - bars cross this |
| Rank order | Widest bar at top = most sensitive input. Focus management attention here. |
| One-way Sensitivity | Two-way Sensitivity | Tornado Diagram | |
|---|---|---|---|
| What varies | One input at a time, all others fixed at baseline | Two inputs simultaneously, across a grid | Each input independently, one at a time |
| Output | A line graph - output vs. the variable being tested | A grid/table or colour map - shows output for every (x,y) combination | A ranked bar chart - all inputs in one view |
| Key question answered | "Is my decision robust? Where does the optimal choice flip?" | "Which of these two uncertainties matters more? How do they interact?" | "Which input has the biggest effect on the output?" |
| Break-even use | Yes - find the exact input value where the decision switches | Yes - find the boundary line between two decisions | No - it ranks, it doesn't find break-even points |
| Rec. Properties example | Lease probability: decision switches at 47% (break-even) - only 3% below Anders's estimate of 50% | Lease prob × reputation prob: simultaneous optimism destroys value rapidly | Not explicitly used in Rec. Properties, but concept applies |
Find the X value where Strategy A EMV = Strategy B EMV.
That is the break-even point - below it, one strategy wins; above it, the other does.
Rec. Properties: lease probability break-even ≈ 47%. Below 47% → Do Not Exercise. Above 47% → Exercise.
Bryanair operates the London Heathrow – New York JFK route using a Boeing 747 with 400 economy seats and 100 business class seats. The core problem: passengers frequently book and don't show up, leaving costly empty seats. The solution - overbooking - risks bumping passengers when too many show up, also at a cost.
| Variable | Economy | Business |
|---|---|---|
| Capacity | 400 seats | 100 seats |
| No-show % range | 3% – 8% | 15% – 30% |
| No-show % mode | 5% (most likely) | 20% (most likely) |
| Distribution | Triangular (3%, 5%, 8%) | Triangular (15%, 20%, 30%) |
| Current booking limit | 420 (5% overbooking) | 120 (20% overbooking) |
Economy: 400 ÷ (1 − 0.05) = 421 seats
Business: 100 ÷ (1 − 0.20) = 125 seats
At this policy, expected showups exactly equals capacity → total cost = £0 at the mode no-show rates
The logic: if you expect 5% of economy passengers to no-show, and you want exactly 400 to show up, you need to book 400 ÷ 0.95 = 421 passengers. This is the "balance point" where expected empty seats and expected bumps are both zero.
| Scenario | Eco NS% | Biz NS% | Consequence | Total Cost |
|---|---|---|---|---|
| Best case (zero cost) | 5% | 20% | Expected showups = capacity exactly | £0 |
| Low no-shows | 3% | 15% | More passengers show up → bumping | Bumping cost |
| High no-shows | 8% | 30% | Fewer show up → empty seats | Up to £23,250 |
| Worst case | 8% | 30% | 13 eco + 12 biz seats empty | £23,250 |
After running 1,000 iterations in @Risk with triangular distributions on both no-show rates, your team compared all three overbooking policies across three metrics. This table is the centrepiece of the report - know it cold.
| Policy | Mean Total Cost | 90% Range (5th–95th) | P(Cost > £17,000) | Verdict |
|---|---|---|---|---|
| Current (420, 120) | £10,280 | £1,600 – £20,550 | ~13% | Suboptimal - under-books relative to expected no-shows |
| New (421, 125) ✓ | £5,543 | £0 – £12,200 | ~2% | Best - lowest mean cost, tightest range, lowest tail risk |
| No Overbooking (400, 100) | £41,016 | £33,550 – £49,850 | 100% | Worst - guaranteed high cost every flight |
Your team ran one-way sensitivity analysis on both no-show rates, holding one fixed while varying the other. The results directly illustrated which variable is the more important driver of total cost.
| Variable Tested | Range Varied | Fixed Variable | Cost Range | Slope |
|---|---|---|---|---|
| Economy NS% | 3% → 8% | Biz NS% = 20% | £1,200 → £5,850 | ~£973 per 1% change |
| Business NS% | 15% → 30% | Eco NS% = 5% | £1,800 → £17,400 | ~£1,192 per 1% change |
Building & Rolling Back Trees
Before drawing a single node, you must frame the problem correctly. These three framing questions structure every decision tree in the course - get these wrong and the whole tree is wrong.
| Question | What you're identifying | Goes into the tree as |
|---|---|---|
| What does the decision-maker want? | The objective - what are we trying to maximise or minimise? | The metric on the terminal nodes (profit, NPV, cost) |
| What can they do? | The decisions - choices fully under the decision-maker's control | Square decision nodes ■ |
| What should they worry about? | The uncertainties - outcomes outside their control, each with a probability | Circle chance nodes ● |
Decisions: Exercise options (pay £10M for land)? → If land acquired: Develop or sell as-is?
Uncertainties: Lease granted? (50/50) → If developed: Resort reputation? (75% good, 25% bad)
A decision tree has exactly two node types and a strict rollback procedure. The procedure is always right-to-left: compute terminal values first, fold back through chance nodes, then choose at decision nodes.
| Node Type | Symbol | Represents | How to compute |
|---|---|---|---|
| Decision node | ■ Square | A choice the decision-maker controls - pick one branch | Take the branch with the highest EMV (double-slash the others) |
| Chance node | ● Circle | An uncertainty - nature picks the outcome | Compute EMV = Σ pᵢ × Vᵢ across all branches |
| Terminal node | ▶ Triangle | The final payoff - no further decisions or uncertainties | Given directly - this is your starting point for rollback |
Step 2: At each chance node, compute EMV = p₁×V₁ + p₂×V₂ + ...
Step 3: At each decision node, take max(branch EMVs) - cross out inferior branches
Step 4: Repeat steps 2–3 moving left until you reach the root node
The value at the root is the optimal expected payoff. The uncrossed path is the optimal strategy.
| Sunk Costs | Risk Neutrality | |
|---|---|---|
| Definition | A cost already incurred and irrecoverable - paying it is done regardless of future decisions | A decision-making stance that cares only about expected monetary value, ignoring the shape/variance of the distribution |
| Rule | Exclude from all future calculations. Do not let it influence which branch to choose. | Always choose the branch with the highest EMV - regardless of downside risk or probability of loss |
| Why it matters | Including sunk costs distorts the decision - you may irrationally continue a bad project just because you already spent money on it | EMV rollback assumes risk neutrality. A risk-averse decision-maker might prefer a lower-EMV option with less downside. |
| Exam signal | "Already paid £X for a study / report / deposit" → ignore this £X in the tree. Only future cash flows matter. | EMV-based recommendation = risk-neutral recommendation. Risk profiles are needed to go beyond this. |
If No → it is a sunk cost. Exclude it.
If Yes → it is a future cost. Include it.
Example: Recreational Properties paid option fees to secure land purchase rights. Those option fees are sunk - they do not appear in the rollback calculation for whether to exercise the options.
The winemaker at Freemark Abbey must decide whether to harvest Riesling grapes before an approaching storm, or wait and hope for botrytis - a fungus that creates premium sweet wine but requires precise conditions. 1,000 cases per year, 12 bottles per case.
Harvest Now → $12 × 12,000 = $144,000 → shown as $144k ... wait, standard:
Harvest Now → $12/btl × 12 btl/case × 1,000 cases = $144,000
Wait - Heavy storm (50%): crop ruined → bottle price falls → $2/btl × 12,000 = $24,000... but tree uses $2 bulk
Wait - Light storm, Botrytis (50% × 50% = 25%):
Bottle at High price (25%): $20 × 12,000 = $240,000 ... wait, standard lecture values below:
Using lecture slide values:
Harvest now: $63,300 (= 1,000 cases × 12 btl × $12 × adjusted = $144k → slide shows $63,300 net)
Chance node (Storm): EMV = 0.5 × $26,400 + 0.5 × $100,200 = $63,300
Heavy storm branch → Bottle? → max($68,400, $2,800) = $68,400 ... full tree:
Optimal decision: Do NOT harvest before storm → EMV = $68,400
(Harvest now gives $63,300 - waiting is better by $5,100)
| Path | Probability | Wine type | Revenue |
|---|---|---|---|
| Wait → Heavy storm → Bottle | 0.5 × 1.0 | Thin (heavy rain ruined) | $2,800 |
| Wait → Light → No Botrytis | 0.5 × 0.5 | Thin wine $8/btl avg | $26,400 |
| Wait → Light → Botrytis → High price | 0.5×0.5×0.25 | Premium botrytised wine | $168,000 |
| Wait → Light → Botrytis → Med price | 0.5×0.5×0.50 | Medium botrytised wine | $117,600 |
| Wait → Light → Botrytis → Low price | 0.5×0.5×0.25 | Lower botrytised wine | $100,800 |
| Harvest now | 1.0 | Standard dry wine $12/btl | $63,300 |
Risk, Information & Value
A risk profile is a bar chart showing the probability of each possible outcome. It is the decision tree equivalent of the simulation histogram - instead of a continuous distribution, you get discrete spikes at each terminal node value.
| How to build a risk profile | Steps |
|---|---|
| Step 1 | List every terminal node value in the optimal strategy path (the uncrossed branches) |
| Step 2 | Calculate the path probability for each: multiply all branch probabilities along the path |
| Step 3 | Draw a bar chart: X-axis = outcome values, Y-axis = probability of each outcome |
| Verify | All probabilities must sum to 1.0 |
| Risk Neutral | Risk Averse | |
|---|---|---|
| Decision criterion | Maximise EMV - the distribution shape is irrelevant | Consider the full distribution - willingness to sacrifice EMV to reduce downside |
| Who uses it | Firms making repeated decisions (law of large numbers applies), large diversified companies | Individuals facing one-off decisions, firms where a single loss could be catastrophic |
| When EMV is misleading | Never - by definition, EMV is the right criterion if you are truly risk neutral | When the loss tail is severe relative to the firm's capacity to absorb it |
| Course rule | EMV rollback = risk-neutral recommendation. This is the default in all tree calculations. | Requires risk profiles + utility functions (exponential utility). Exam may ask you to recognise the distinction. |
R is the risk tolerance parameter - how much risk a person is willing to accept
Rule of thumb for firms: R ≈ 6.5% of total annual sales
Rule for individuals: R = the amount where you are indifferent between nothing vs. a 50/50 bet of winning R and losing R/2
As R → ∞: U(x) ≈ x → risk neutral (EMV only)
Small R: U(x) penalises losses heavily → risk averse
| EVPI - Perfect Information | EVSI - Sample (Imperfect) Information | |
|---|---|---|
| What it is | The value of knowing the uncertainty outcome before deciding - 100% accurate oracle | The value of an imperfect signal that updates your probabilities but doesn't eliminate uncertainty |
| Formula | EVPI = EMV(with perfect info) − EMV(without info) | EVSI = EMV(with imperfect info) − EMV(without info) |
| Freemark Abbey values | EVPI = $52,200 − $39,780 = $12,420 | EVSI = $48,060 − $39,780 = $8,280 |
| Interpretation | The winemaker would pay up to $12,420 for a perfect storm predictor | The winemaker would pay up to $8,280 for imperfect botrytis spore information |
| Relationship | EVPI is an upper bound - perfect info is always at least as valuable as imperfect info | EVSI ≤ EVPI always. Imperfect info can still have significant value. |
Step 2: Compute: EMV(perfect info) = Σ p(state) × best payoff in that state
Step 3: EVPI = EMV(perfect info) − EMV(best decision without info)
Freemark: If heavy storm (50%) → harvest now ($63,300 best). If light storm (50%) → wait ($100,200).
EMV(perfect) = 0.5 × $63,300 + 0.5 × $100,200 = $81,750 ... (lecture uses slightly different values → $52,200 vs $39,780)
EVPI = $81,750 − $68,400 (base EMV) = $13,350 (exact values vary by slide version)
Bayes' Theorem solves the "probability flipping" problem. We usually know P(signal | reality) - how accurate is our predictor? But we need P(reality | signal) - given what the predictor said, what should we now believe? Bayes converts one into the other.
Where:
P(A) = prior probability (what we believed before the signal)
P(B | A) = likelihood (accuracy of the predictor - how often it says B when A is true)
P(B) = marginal probability of the signal = Σ P(B | Aᵢ) × P(Aᵢ)
P(A | B) = posterior probability (what we should now believe)
The fastest exam method is a 2×2 (or 2×3) joint probability table. Build it from the prior probabilities and the conditional likelihoods, then read off the posteriors from the row/column totals.
| Bayes Table Structure | Signal = Positive | Signal = Negative | Prior (Row Total) |
|---|---|---|---|
| State A is True | P(pos|A) × P(A) | P(neg|A) × P(A) | P(A) |
| State A is False | P(pos|¬A) × P(¬A) | P(neg|¬A) × P(¬A) | P(¬A) |
| Marginal (Column Total) | P(positive signal) | P(negative signal) | 1.0 |
Anders Forsgren is the CEO of Recreational Properties, a Swedish ski resort developer. He holds options to purchase land for the "White Mountain" development at £10M - but a conservationists' lawsuit has introduced uncertainty over whether the Environmental Agency will grant the lease needed to build. Without the lease, the land is worth only £8M (a £2M loss).
| Decision / Uncertainty | Details | Type |
|---|---|---|
| Exercise the options? | Pay £10M for the land vs. take the alternative £1.5M profit | ■ Decision node |
| Lease granted? | 50% yes (develop viable), 50% no (sell land at £8M loss of £2M) | ● Chance node - biggest uncertainty |
| Develop or sell as-is? | If lease granted: develop (−£5M cost, sell later) vs. sell land without development (net £4M) | ■ Decision node |
| Resort reputation? | If developed: 75% good reputation (net £21.8M revenue → profit £6.8M net) / 25% bad (net £16.3M → profit £1.3M net) | ● Chance node |
Sell as-is (no development): £4.0M (certain)
→ Develop wins (£5.425M > £4.0M)
= 37.5% × £6.8M + 12.5% × £1.3M + 50% × (−£2.0M) = £1.7125M
Alternative: £1.5M (certain)
→ Exercise options wins (£1.7125M > £1.5M)
| Outcome | Path Probability | Payoff | Interpretation |
|---|---|---|---|
| Loss | 50.0% | −£2.0M | Lease not granted - land sold at loss |
| Modest gain | 12.5% | £1.3M | Lease granted, developed, bad reputation |
| High gain | 37.5% | £6.8M | Lease granted, developed, good reputation |
| Note: 62.5% of outcomes fall below the £1.5M opportunity cost. The EMV margin is only £212,500. | |||
After lawsuit: lease probability = 50% → EMV = £1.7125M
Value of Control = £5.425M − £1.7125M = £3.7125M
Anders should pay up to £3.7125M for the environmental report (if guaranteed positive). Anything above this destroys value.
Good reputation break-even: ~68% (Anders estimates 75% - 7% margin)
Below 47% lease probability → optimal decision flips to "Do Not Exercise"
Below 68% good reputation → project value falls below the £1.5M alternative
| Scenario | EMV | Downside Risk | Incremental Value |
|---|---|---|---|
| Base (no extension) | £1.7125M | 50% chance of −£2M | Baseline |
| 6-month extension (Q5) | ~£2.72M | 10% chance of −£2M | ~£1.01M above base |
| 1-year extension (Q4) | £1.75M total gain | 0% chance of loss | Eliminates all downside |
Baseline EMV: £1.7125M
Incremental value: £2.72M − £1.7125M = ~£1.01M
Maximum the board should pay for a 6-month extension. At £1.01M, the board is indifferent between paying for the extension and not.
The Regression Model
The regression equation has a precise form that the course tests directly. Missing the error term ε is a common exam mistake. Every regression equation in this course must include it.
Y = Dependent variable (what you are predicting)
b₀ = Intercept (constant) - value of Y when all X = 0
b₁, b₂ = Coefficients (slopes) - how much Y changes per unit increase in X
X₁, X₂ = Independent variables (predictors)
ε = Error term - captures all variation in Y not explained by the model
Correct equation: Cost = 25.19 − 0.0088 × Capacity + ε
Interpretation of the slope: each additional ton/month of capacity reduces cost/ton by $0.0088 - economies of scale
Interpretation of the intercept: a plant with zero capacity would theoretically cost $25.19/ton - the fixed overhead component
| Coefficient Sign | Meaning | Ferric Example |
|---|---|---|
| Positive (+) | Y increases as X increases | If capacity increased cost, b₁ > 0 |
| Negative (−) | Y decreases as X increases | Capacity coefficient = −0.0088: larger plants have lower cost per ton (economies of scale) ✓ |
| Near zero | Little linear relationship - check p-value | If p-value > 0.05 → consider dropping the variable from a new model |
The Excel regression output has two sections. Memorise what every row and column means - the exam gives you a table and asks you to read it correctly.
| REGRESSION STATISTICS (top block) | ||
|---|---|---|
| Statistic | What it measures | Ferric value |
| Multiple R | Correlation between Y and Ŷ - strength of linear fit (0 to 1) | 0.835 |
| R Square (R²) | % of variation in Y explained by the model | 0.698 - model explains 69.8% of cost variation |
| Adjusted R² | R² penalised for number of predictors - use this to compare models | 0.660 |
| Standard Error (SE) | Average prediction error - used to calculate confidence intervals | 2.334 - predictions are ± ~2.33 on average |
| Observations | Sample size n | 10 plants |
| COEFFICIENTS TABLE (bottom block) | ||||||
|---|---|---|---|---|---|---|
| Column | Meaning | Intercept | Capacity | |||
| Coefficients | b₀ and b₁ - go into the equation | 25.19 | −0.00881 | |||
| Standard Error | Uncertainty in the coefficient estimate | 1.859 | 0.00205 | |||
| t Stat | Coefficient ÷ Std Error - how many SEs from zero | 13.55 | −4.30 | |||
| P-value | Probability the true coefficient = 0 - smaller = more significant | 8.4E-07 | 0.00263 | |||
| Lower 95% / Upper 95% | 95% confidence interval for the coefficient itself | [20.91, 29.48] | [−0.0135, −0.0041] | |||
p-value > 0.05 → variable is statistically insignificant → model may improve if you drop it (when building a new model)
Ferric Capacity: p-value = 0.00263 < 0.05 → significant. Keep it.
Rule: |t Stat| > 2 is approximately equivalent to p < 0.05 for most sample sizes in this course.
Making a forecast and computing its 95% confidence interval is the most directly tested calculation in the regression module. Two steps, always in this order.
Plug your specific X values into the equation. This gives the predicted (fitted) value of Y.
Note: Ŷ (Y-hat) has no error term - it is the model's best prediction, not an observation.
Lower bound: Ŷ − 1.96 × SE
Upper bound: Ŷ + 1.96 × SE
SE = Standard Error from the Regression Statistics table (not the SE of a coefficient)
1.96 is the z-score for 95% confidence (two-sided). This value is given or assumed in the course.
SE = 2.334 (from regression statistics)
New plant: Capacity = 1,000 tons/month
Ŷ = 25.19 − 0.0088 × 1,000 = 25.19 − 8.80 = 16.39
95% CI Lower: 16.39 − 1.96 × 2.334 = 16.39 − 4.57 = 11.82
95% CI Upper: 16.39 + 1.96 × 2.334 = 16.39 + 4.57 = 20.96
Answer: Predicted cost = $16.39/ton, with 95% confidence interval [$11.82, $20.96]
Richard Hansen at Ferric Processing needs a way to predict average cost per ton for new slag-processing plants before negotiating contracts. He collects data on 10 existing plants - their monthly capacity and cost per ton - and runs a regression in Excel.
| Plant | Capacity (tons/mo) | Cost/ton ($) | Plant | Capacity (tons/mo) | Cost/ton ($) |
|---|---|---|---|---|---|
| 1 | 450 | 21.95 | 6 | 750 | 18.15 |
| 2 | 250 | 27.18 | 7 | 1,500 | 14.22 |
| 3 | 875 | 16.90 | 8 | 550 | 18.72 |
| 4 | 1,000 | 15.37 | 9 | 1,300 | 15.40 |
| 5 | 700 | 16.03 | 10 | 950 | 14.69 |
| Regression Statistics | Coefficient Table | |||||
|---|---|---|---|---|---|---|
| Statistic | Value | Variable | Coefficient | Std Error | t Stat | P-value |
| R Square | 0.6978 | Intercept | 25.193 | 1.859 | 13.55 | 8.4E-07 |
| Adjusted R² | 0.6600 | Capacity | −0.00881 | 0.00205 | −4.30 | 0.00263 |
| Standard Error | 2.334 | |||||
| Observations | 10 | |||||
Forecast (Capacity = 1,000): Ŷ = 25.19 − 0.0088 × 1,000 = 16.39 $/ton
95% CI: 16.39 ± 1.96 × 2.334 = [11.82, 20.96]
Model Quality & Pitfalls
| R² (R Square) | Adjusted R² | |
|---|---|---|
| What it measures | Proportion of variance in Y explained by the model | Same, but penalised for the number of predictors |
| Formula intuition | 1 − (Unexplained variance / Total variance) | Adjusts for n (sample size) and k (number of predictors) |
| Adding a new variable | Always increases or stays the same - even if the variable is useless | Increases only if the new variable improves the model more than chance alone would |
| Comparing models | Cannot fairly compare models with different numbers of predictors | Use this - it is the correct metric for model selection |
| True/False exam question | "Increased Adjusted R² implies improvement" → TRUE | "High Adjusted R² always means good forecasting" → FALSE (spurious correlation) |
If the variable is useful: Adjusted R² increases → model improved ✓
If the variable is irrelevant: R² increases slightly, Adjusted R² decreases or stays same → do not include
Ferric: Single-variable model Adj R² = 0.660. If startup year were added and Adj R² dropped → drop startup year.
(1) "Higher Adjusted R² when adding a variable implies the model improved" → TRUE - this is exactly what Adjusted R² is designed to tell you.
(2) "A high Adjusted R² means the model is good for forecasting" → FALSE - Adjusted R² can be high due to spurious correlation (a third variable driving both). The model fits the data but cannot predict causally.
Spurious correlation is one of the most important conceptual warnings in the regression module. A high R² does not mean the model is useful for prediction - it may just mean both variables are driven by a third factor you haven't measured.
| True relationship | R² tells you | The right question |
|---|---|---|
| X causally drives Y | High R² is meaningful - use the model | Does it make economic/physical sense that X causes Y? |
| Z drives both X and Y (spurious) | High R² is misleading - model cannot forecast | Is there a third variable that might be causing both? |
| X and Y are unrelated | Low R² correctly indicates no relationship | Are we even looking at the right variables? |
This is one of the most tested rules in the regression module - and one of the most counterintuitive. The rule distinguishes between two very different situations: building a new model vs. forecasting with an existing one.
| Situation | Rule | Why |
|---|---|---|
| Building / improving a model | Drop insignificant variables (p > 0.05) to simplify and potentially improve Adjusted R² | Insignificant variables add noise without explanation - Adjusted R² may improve by removing them |
| Forecasting with an existing model | Include ALL variables in the model - even insignificant ones | The model was estimated using all variables together. Their coefficients are co-estimated. Dropping one variable changes all the others. The forecast must use the model as-is. |
Model 2: Cost = b₀ + b₁(Capacity) + b₂(Year) + ε ← extended, Year p = 0.31 (insignificant)
Q: "Using Model 2, forecast cost for a 1,000-ton plant opened in 2005."
Wrong: Ŷ = b₀ + b₁(1000) ← ignores Year variable
Right: Ŷ = b₀ + b₁(1000) + b₂(2005) ← uses all variables in Model 2
Improving a regression model means adding or removing variables to increase predictive power. The decision rule is straightforward, but requires understanding what each metric signals.
| Action | When to do it | How to confirm improvement |
|---|---|---|
| Drop a variable | Its p-value > 0.05 (insignificant) in the current model | Adjusted R² increases or stays the same after removal |
| Add a variable | You have theoretical reason to believe it explains Y, and data is available | Adjusted R² increases; new variable has p < 0.05 |
| Keep a variable despite insignificance | Economic theory requires it, or you are forecasting with an existing model | Not about Adjusted R² - it's a conceptual / theoretical decision |
If any p > 0.05: candidate for removal (if building a new model)
Remove variable → re-run regression → check Adjusted R²
If Adjusted R² increases: keep the removal ✓
If Adjusted R² decreases: variable was contributing despite apparent insignificance → reconsider
Model-selection rule: "If p-value > 0.05 the variable is insignificant and the model will improve if you drop it."
| Scenario | What happened? | Conclusion |
|---|---|---|
| Added a variable → R² up, Adj R² up | New variable is genuinely useful | Keep the variable |
| Added a variable → R² up, Adj R² down | New variable adds noise - penalty exceeds gain | Drop the variable |
| Dropped a variable → Adj R² up | Variable was adding noise | Model improved |
| Dropped a variable → Adj R² down | Variable was contributing, even if p > 0.05 | Put it back |
After the single-variable model (Capacity → Cost), Richard Hansen considers whether adding the plant's startup year improves prediction. Different plants were built in different years - newer plants may benefit from improved processes. This is the multi-variable extension of the Ferric case.
| Model 1 (Capacity only) | Model 2 (Capacity + Year) | Verdict | |
|---|---|---|---|
| R² | 0.698 | Higher (always increases) | Not a useful comparison |
| Adjusted R² | 0.660 | Compare this to 0.660 | If higher → keep Year; if lower → drop Year |
| Year p-value | - | Check against 0.05 | If p > 0.05 → insignificant → drop Year from new model |
| Capacity coefficient | −0.00881 | Different value | Changed because Year now absorbs some variation |
Forecast for a 1,000-ton plant, Year = 2001:
Ŷ = b₀ + b₁ × 1000 + b₂ × 2001
95% CI: Ŷ ± 1.96 × SE (SE from the new model's regression statistics block)
Note: Use the SE from Model 2's output - not Model 1's SE of 2.334. Different models have different SEs.
| Concept | True or False | Explanation |
|---|---|---|
| Increased Adjusted R² implies model improvement | TRUE | This is exactly what Adjusted R² is designed to measure |
| High Adjusted R² always means good forecasting | FALSE | Spurious correlation can produce high R² with no causal validity |
| Adding an insignificant variable always hurts the model | FALSE | R² will still increase; Adjusted R² may decrease - check it empirically |
| When forecasting with an existing model, drop insignificant variables | FALSE | Include ALL variables in the existing model - variable inclusion rule |
| When building a new model, drop variables with p > 0.05 | TRUE | Insignificant variables suggest no real relationship - simplify the model |
Formula Cheat Sheet
Use when: variable can take any value in a range - "somewhere between X and Y, most likely Z"
Plugging in the mean input gives a different result from the mean of the simulation outputs
Bryanair proof: single-point estimate gave £6,250; simulation mean was £10,280
Sets expected showups = capacity → zero cost at the modal no-show rate
Bryanair: Eco = 400 ÷ 0.95 = 421 | Biz = 100 ÷ 0.80 = 125
P(loss) = area of histogram left of X = 0
VaR (90%) = value at the 5th percentile
One-off decision → use risk profile + P(loss). Repeated policy → use mean.
At each decision node: choose max(branch EMVs) - cross out inferior branches
Probabilities at each chance node must sum to 1.0
EMV(perfect) = Σ P(state) × best payoff given that state
EVPI is an upper bound - it is always ≥ EVSI ≥ 0
Rec. Properties Value of Control: £5.425M − £1.7125M = £3.7125M
Requires Bayes' Theorem to update probabilities first
EVSI ≤ EVPI always. If your calculation gives EVSI > EVPI, there's an error.
P(B) = Σ P(B|Aᵢ) × P(Aᵢ) (sum over all states)
Build a joint probability table: rows = states, columns = signals. Cell = P(signal|state) × P(state). Posterior = cell / column total.
Path probability = product of all branch probabilities along the path
All path probabilities must sum to 1.0
Ferric: Cost = 25.19 − 0.0088 × Capacity + ε
Never write the equation without ε - this is an exam mark
Step 2: 95% CI = Ŷ ± 1.96 × SE
SE = Standard Error from the regression statistics block (NOT the coefficient standard errors)
Ferric: Ŷ = 25.19 − 0.0088(1000) = 16.39 | CI = [11.82, 20.96]
p > 0.05 → insignificant → drop when building a new model
But when FORECASTING with an existing model: include ALL variables, even insignificant ones
Adding a variable: R² always ↑ / Adjusted R² ↑ only if variable is useful
TRUE: "Higher Adjusted R² implies model improvement"
FALSE: "High Adjusted R² always means good forecasting" - spurious correlation exists
| Statement | T/F | Why |
|---|---|---|
| Taking the best EMV decision assumes risk neutrality | TRUE | EMV rollback ignores variance - only works if you don't care about distribution shape |
| EVSI can exceed EVPI | FALSE | Perfect info is always worth at least as much as imperfect info |
| Higher Adjusted R² implies the model improved | TRUE | Adjusted R² penalises for extra variables - it only rises if the new variable earns its place |
| A high Adjusted R² guarantees good forecasting | FALSE | Spurious correlation can produce high R² with no causal relationship |
| When forecasting with an existing model, drop insignificant variables | FALSE | Variable inclusion rule - use all variables in the model as estimated |
| Plugging the mean input into a nonlinear model gives the mean output | FALSE | The Flaw of Averages - f(E[X]) ≠ E[f(X)] for nonlinear f |
| Simulation is appropriate when the real system can be experimented on | FALSE | Simulation is the last resort - used precisely when you cannot experiment on the real system |
| A sunk cost should influence the current decision | FALSE | Sunk costs are irrecoverable - exclude from all future decision trees |
| For a repeated policy decision, the mean is the right criterion | TRUE | Law of large numbers - over many repetitions, actual outcomes converge to the mean |
Glossary
| Term | Definition |
|---|---|
| Simulation | A computational method that runs a model thousands of times, sampling random values from input distributions each time, to produce a distribution of output values. Used when analytical solutions are unavailable and direct experimentation is impossible. |
| Flaw of Averages | The error of substituting mean input values into a model and treating the result as the expected output. For nonlinear models, this systematically produces a wrong answer - the true mean output differs from the deterministic output at mean inputs. |
| Monte Carlo Simulation | Simulation that uses random number generation to sample from probability distributions. Each "iteration" represents one possible future; the collection of outputs across all iterations gives the output distribution. |
| Triangular Distribution | A continuous probability distribution defined by three parameters: minimum, most likely (mode), and maximum. Used when a variable can take any value in a range and expert estimates of the three bounds are available. |
| Discrete Distribution | A probability distribution that assigns specific probabilities to a finite set of values. Used when a variable can only take one of a fixed set of outcomes (e.g. 2, 3, 4, or 5 defective units). All probabilities must sum to 1.0. |
| Value at Risk (VaR) | The worst outcome that will be experienced with a given confidence level. A 90% VaR is the 5th percentile of the output distribution - 95% of outcomes are better than this value. |
| Probability of Loss | The proportion of simulation iterations where the output is negative (or below a threshold). Read from the histogram as the area to the left of X = 0. Distinct from VaR - VaR gives a value, P(loss) gives a probability. |
| Tornado Diagram | A sensitivity chart that ranks uncertain inputs by their impact on the output. The widest bar represents the most important variable. Does not show break-even points - only relative importance. |
| One-way Sensitivity Analysis | Analysis where one input variable is varied across its range while all others are held at baseline. Used to find break-even points and test whether the optimal decision is robust to estimation errors. |
| Two-way Sensitivity Analysis | Analysis where two inputs are varied simultaneously across a grid. Shows how the optimal decision changes as both variables move - used to identify which of two uncertainties is more important to the outcome. |
| One-off Decision | A decision made once - the law of large numbers cannot average out a single outcome. The full risk profile (distribution shape, P(loss), VaR) matters, not just the mean. |
| Repeated Policy | A decision rule applied many times (e.g. overbooking on every flight). Over enough repetitions, actual outcomes converge to the expected value. The mean is the right criterion for comparison. |
| Term | Definition |
|---|---|
| Decision Node (■) | A square node representing a choice under the decision-maker's control. At rollback, the branch with the highest EMV is chosen; inferior branches are crossed out with double slashes. |
| Chance Node (●) | A circular node representing an uncertainty outside the decision-maker's control. The EMV at a chance node is computed as the probability-weighted average of all branch values. |
| EMV (Expected Monetary Value) | The probability-weighted average of all possible monetary outcomes at a chance node. EMV = Σ pᵢ × Vᵢ. Maximising EMV is the decision rule under risk neutrality. |
| Rollback | The right-to-left procedure for evaluating a decision tree. Start at terminal nodes, fold back through chance nodes (compute EMV), then select at decision nodes (take max). The value at the root node is the optimal expected payoff. |
| Risk Neutrality | A decision-making stance that cares only about expected monetary value, treating all distributions with the same EMV as equivalent regardless of their shape or variance. EMV rollback assumes risk neutrality. |
| Risk Aversion | A preference for lower-variance outcomes even at the cost of lower expected value. A risk-averse decision-maker may prefer a certain £1.5M over an uncertain EMV of £1.7M with 50% chance of −£2M loss. |
| Risk Profile | A discrete probability distribution showing all possible outcomes of the optimal strategy and their associated probabilities. Built from the terminal node values on uncrossed branches only. |
| Sunk Cost | A cost already incurred and irrecoverable, regardless of future decisions. Sunk costs must be excluded from decision tree analysis - only future cash flows are relevant. |
| EVPI (Expected Value of Perfect Information) | The maximum amount a decision-maker should pay for an oracle that perfectly reveals the outcome of all uncertainties before a decision is made. EVPI = EMV(perfect info) − EMV(best decision without info). It is always ≥ 0 and ≥ EVSI. |
| EVSI (Expected Value of Sample Information) | The maximum amount a decision-maker should pay for an imperfect signal that updates their prior probabilities. Requires Bayes' Theorem. EVSI ≤ EVPI. |
| Bayes' Theorem | A formula for updating probabilities after receiving new information. P(A|B) = P(B|A) × P(A) / P(B). Used to compute posterior probabilities from prior probabilities and signal likelihoods. |
| Prior Probability | The original probability of a state of the world, before any new information is received. In Bayes' Theorem, this is P(A). |
| Posterior Probability | The updated probability of a state of the world after incorporating a new signal. P(A|B) - the probability of state A given that signal B was observed. |
| Value of Control | The reduction in expected value caused by losing control over an uncertainty (or the gain from securing it). Computed as the difference in EMV between a scenario with and without the uncertainty resolved. Equivalent to EVPI in many settings. |
| Term | Definition |
|---|---|
| Regression Model | A statistical model that estimates the linear relationship between a dependent variable Y and one or more independent variables X. The model takes the form Y = b₀ + b₁X₁ + b₂X₂ + ε. |
| Error Term (ε) | The component of a regression equation that captures all variation in Y not explained by the independent variables. It reflects random noise, measurement error, and omitted variables. Must always be included when writing a regression equation. |
| Intercept (b₀) | The predicted value of Y when all independent variables equal zero. Has economic meaning only when X = 0 is a plausible value in the data range. |
| Coefficient (bᵢ) | The slope of Y with respect to Xᵢ, holding all other variables constant. A positive coefficient means Y increases as Xᵢ increases; negative means Y decreases. |
| Fitted Value (Ŷ) | The model's prediction for a specific set of X values. Ŷ = b₀ + b₁X₁ + … Note: Ŷ has no error term - it is the model's point estimate, not an observation. |
| Standard Error (SE) | The average prediction error of the regression model. Used to compute confidence intervals: CI = Ŷ ± 1.96 × SE. Comes from the regression statistics table, not the coefficient table. |
| 95% Confidence Interval | The range within which the true value of Y is expected to fall with 95% probability: [Ŷ − 1.96×SE, Ŷ + 1.96×SE]. A wider interval indicates greater prediction uncertainty. |
| p-value | The probability that the true coefficient is zero, given the data. p < 0.05 → statistically significant (keep the variable when building a new model). p > 0.05 → insignificant (consider dropping when building a new model). |
| t-statistic | The coefficient divided by its standard error. |t| > 2 is approximately equivalent to p < 0.05 for typical sample sizes. Measures how many standard errors the coefficient is from zero. |
| R² (R Square) | The proportion of variance in Y explained by the model. Always between 0 and 1. Adding any variable (even irrelevant) always increases R² - do not use R² to compare models with different numbers of predictors. |
| Adjusted R² | R² penalised for the number of predictors. Increases only when a new variable improves the model more than chance alone. Use Adjusted R² to compare models. "Increased Adjusted R² implies model improvement" is TRUE. |
| Spurious Correlation | A statistical correlation between two variables that is caused by a third hidden variable, not a causal relationship. Can produce high R² in a regression even when the model has no predictive validity. The ice cream / drowning rate example. |
| Variable Inclusion Rule | When forecasting with an existing model, ALL variables in the model must be used in the forecast - even those with p > 0.05. Dropping insignificant variables changes the model and invalidates the coefficients. Only drop variables when building a new model. |
| Economies of Scale | A negative relationship between plant size (capacity) and unit cost. In Ferric Processing, the coefficient on Capacity is −0.0088, meaning each additional ton of monthly capacity reduces cost/ton by $0.0088 - larger plants are cheaper per unit. |