Actuarium

Extreme Value Theory and Heavy Tails

Advanced
13 min read·Risk & Reinsurance
On this page
Key formulas
GEV CDF
Hξ(x)=exp{(1+ξxμσ)1/ξ}H_\xi(x) = \exp\left\{ -\left(1+\xi \frac{x-\mu}{\sigma}\right)^{-1/\xi} \right\}
GPD CDF
Gξ,β(y)=1(1+ξyβ)1/ξG_{\xi,\beta}(y) = 1 - \left(1+\xi \frac{y}{\beta}\right)^{-1/\xi}
Mean excess function
e(u)=E[XuX>u]e(u) = E[X-u \mid X>u]
GPD mean excess (linear in u)
e(u)=β+ξu1ξe(u) = \frac{\beta + \xi u}{1-\xi}
Hill estimator
ξ^Hill=1ki=1klnX(ni+1)X(nk)\hat\xi_{\text{Hill}} = \frac{1}{k}\sum_{i=1}^{k} \ln\frac{X_{(n-i+1)}}{X_{(n-k)}}

Reinsurance layers, catastrophe pricing, and capital for tail risk all live in the extreme tail of the loss distribution, where data is by definition sparse. Extreme value theory (EVT) gives a principled asymptotic framework for extrapolating beyond observed data rather than relying on a single parametric family fit to the whole distribution (which is often a poor fit exactly where it matters most).

Fisher–Tippett and the GEV family

Just as the Central Limit Theorem describes the limiting distribution of sums, the Fisher–Tippett–Gnedenko theorem describes the limiting distribution of block maxima. If Mn=max(X1,,Xn)M_n = \max(X_1,\ldots,X_n) and there exist norming constants an>0,bna_n>0, b_n such that (Mnbn)/an(M_n-b_n)/a_n converges in distribution to a non-degenerate limit, that limit must be a Generalized Extreme Value (GEV) distribution:

Hξ(x)=exp{(1+ξxμσ)1/ξ},1+ξxμσ>0,H_\xi(x) = \exp\left\{-\left(1+\xi\frac{x-\mu}{\sigma}\right)^{-1/\xi}\right\}, \qquad 1+\xi\frac{x-\mu}{\sigma} > 0,

with location μ\mu, scale σ>0\sigma>0, and shape ξ\xi. Three cases nest inside this one family: ξ>0\xi>0 gives the heavy-tailed Fréchet case (power-law tail — the relevant case for most insurance losses); ξ=0\xi=0 (limit) gives the light-tailed Gumbel case (exponential-type tail); ξ<0\xi<0 gives the finite-upper-endpoint Weibull case. GEV fitting requires block maxima (e.g., annual maximum loss per year), which wastes data by discarding everything but the single largest observation per block.

Peaks over threshold and the GPD

The peaks-over-threshold (POT) approach uses all exceedances of a high threshold uu rather than block maxima, making far more efficient use of data. The Pickands–Balkema–de Haan theorem states that, for a threshold uu high enough, the distribution of excesses Y=XuX>uY = X - u \mid X > u converges to a Generalized Pareto Distribution (GPD):

Gξ,β(y)=1(1+ξyβ)1/ξ,y0 (ξ0),0yβ/ξ (ξ<0),G_{\xi,\beta}(y) = 1 - \left(1+\xi\frac{y}{\beta}\right)^{-1/\xi}, \qquad y \ge 0 \ (\xi\ge0), \quad 0\le y \le -\beta/\xi\ (\xi<0),

with the same shape parameter ξ\xi as the corresponding GEV limit — GPD is the natural excess-distribution counterpart of GEV. For ξ>0\xi > 0 the GPD has a Pareto-like power tail with finite moments only up to order 1/ξ1/\xi (e.g., ξ0.5\xi \ge 0.5 implies infinite variance) — this single number governs whether classical variance-based methods are even valid.

Mean-excess plots

The mean excess function e(u)=E[XuX>u]e(u) = E[X-u \mid X>u] diagnoses tail behavior and threshold choice. For an exact GPD tail, e(u)e(u) is exactly linear in uu: e(u)=(β+ξu)/(1ξ)e(u) = (\beta + \xi u)/(1-\xi). This gives a practical graphical tool: plot the empirical mean excess e^(u)=1nuXi>u(Xiu)\hat e(u) = \frac{1}{n_u}\sum_{X_i>u}(X_i-u) against uu over a range of candidate thresholds; a roughly linear, upward-sloping plot beyond some uu^* signals a heavy (Fréchet, ξ>0\xi>0) tail and identifies uu^* as a reasonable POT threshold — a mean-excess plot that flattens or decreases signals a lighter tail.

The Hill estimator

For a Pareto-type (regularly varying) tail, the Hill estimator estimates the tail index directly from the kk largest order statistics X(n)X(n1)X(nk+1)X_{(n)} \ge X_{(n-1)} \ge \cdots \ge X_{(n-k+1)} of a sample of size nn:

ξ^Hill=1ki=1klnX(ni+1)X(nk)\hat\xi_{\text{Hill}} = \frac{1}{k}\sum_{i=1}^{k}\ln\frac{X_{(n-i+1)}}{X_{(n-k)}}

(equivalently the reciprocal of this is often quoted as the Pareto tail index α=1/ξ\alpha = 1/\xi). The choice of kk (equivalently, threshold) trades bias (too large kk pulls in non-tail data, biasing the estimate) against variance (too small kk gives a noisy estimate from few points) — a Hill plot of ξ^Hill\hat\xi_{\text{Hill}} against kk is examined for a stable region.

Worked GPD threshold example

Suppose 500 large-claim observations exceed a working threshold of u0=250,000u_0 = 250{,}000 (in thousands: 250), and among these, fitting the GPD to exceedances above u0u_0 gives ξ^=0.35\hat\xi = 0.35, β^=180\hat\beta = 180 (thousand). We want the loss amount corresponding to a 1-in-2,000-claim event, i.e., the (11/2000)(1 - 1/2000)-quantile of the ground-up severity, given that P(X>u0)=500/50,000=0.01P(X>u_0) = 500/50{,}000 = 0.01 from a base of 50,000 total claims.

For x>u0x > u_0, the tail probability under the fitted GPD is:

P(X>x)=P(X>u0)(1+ξxu0β)1/ξ=0.01(1+0.35x250180)1/0.35.P(X>x) = P(X>u_0) \cdot \left(1+\xi\frac{x-u_0}{\beta}\right)^{-1/\xi} = 0.01\left(1+0.35\frac{x-250}{180}\right)^{-1/0.35}.

We want P(X>x)=1/2000=0.0005P(X>x) = 1/2000 = 0.0005, i.e. a ratio of 0.0005/0.01=0.050.0005/0.01 = 0.05:

(1+0.35x250180)1/0.35=0.05    1+0.35x250180=0.050.35.\left(1+0.35\frac{x-250}{180}\right)^{-1/0.35} = 0.05 \;\Rightarrow\; 1+0.35\frac{x-250}{180} = 0.05^{-0.35}.

0.050.35=e0.35ln0.05=e0.35×(2.9957)=e1.0485=2.85360.05^{-0.35} = e^{-0.35\ln 0.05} = e^{-0.35\times(-2.9957)} = e^{1.0485} = 2.8536.

So 0.35x250180=1.8536x250180=5.2960x250=953.3x=1,203.30.35\dfrac{x-250}{180} = 1.8536 \Rightarrow \dfrac{x-250}{180} = 5.2960 \Rightarrow x - 250 = 953.3 \Rightarrow x = 1{,}203.3 (thousand), i.e. approximately 1,203,000.

This single extrapolation — from a threshold with reasonable data support out to a 1-in-2,000 event nearly five times further into the tail — is exactly the exercise underlying per-risk XoL layer pricing far above the experience base, and is only defensible because of the GPD's theoretical justification (Pickands' theorem) rather than an ad hoc curve fit.

Implications for reinsurance pricing

Because high XoL layers and cat treaties are priced almost entirely from the extreme tail, the tail index ξ\xi is often the single most consequential parameter in the whole exercise: a shift from ξ=0.2\xi=0.2 to ξ=0.4\xi=0.4 can multiply high-layer expected losses several-fold even holding the fitted threshold-exceedance probability fixed, because it changes how fast the tail decays. This is why cat and per-risk excess pricing leans on POT/GPD fits (and mean-excess diagnostics to justify the threshold) rather than extrapolating a lognormal or gamma fit calibrated mainly to the bulk of the distribution, which typically understates tail thickness for liability and property catastrophe losses.

Pitfalls

  • Choosing the POT threshold by eye without a mean-excess or Hill-plot check, then reporting spuriously precise extreme quantiles.
  • Extrapolating GPD/Hill fits far beyond the data support without communicating the wide confidence interval on ξ\xi itself, which drives most of the uncertainty in extreme quantiles.
  • Mixing perils/lines with different tail indices in one fit (e.g., wind vs. earthquake) rather than fitting separately.
  • Ignoring ξ1\xi \ge 1 (infinite mean) or ξ0.5\xi \ge 0.5 (infinite variance) implications when such values are estimated — classical layer-pricing loadings based on variance are invalid there.

Exam relevance

EVT, GPD/POT, and the Hill estimator are tested on CAS Exam 8 and appear in SOA's ERM/QFI extreme risk material.

Further reading

  • Embrechts, Klüppelberg & Mikosch, Modelling Extremal Events for Insurance and Finance
  • McNeil, Frey & Embrechts, Quantitative Risk Management
  • Hill (1975), A Simple General Approach to Inference About the Tail of a Distribution

Related

References

  • Embrechts, Klüppelberg & Mikosch, Modelling Extremal Events
  • McNeil, Frey & Embrechts, Quantitative Risk Management
  • CAS Exam 8 Syllabus

Want a deeper conversation on this topic?

Ask the agent about this
Ask the tutor