1. Home
  2. Methodology

Methodology

Endereye uses Monte Carlo simulation to estimate each player's probability of surviving the next elimination round, and to surface the specific conditions observed most often that determine the outcome.

In a 60+ player lobby, simulating exact permutations becomes computationally impossible. The 'Safe' and 'Needs #' labels bypass player variance by using point calculations to surface guaranteed survival thresholds.

Summary

Each time a seed completes, the model runs 20,000 simulated playthroughs of the remaining seeds. In each simulation, player performance is sampled from a model built on Elo rating and season ladder completion stats (average time, best time). The fraction of simulations in which a player survives the next elimination becomes their displayed survival probability.

Survival and threat paths are derived from the same simulation batch. After all simulations run, the model identifies which opponent placement patterns most reliably separate "survived" outcomes from "eliminated" outcomes for each player, and surfaces the most frequent ones.

Invariants

0
Safe violations
Times the model guaranteed a player was mathematically safe, but they were actually eliminated. Must remain 0.
0
Clinch violations
Clinch place is the exact placement mathematically guaranteed to secure survival. A violation occurs if a player hits this safety threshold but is still eliminated. Must remain 0.

Predictive Accuracy

0.103
Overall Survival Brier
Measures predictive accuracy from 0.0 (perfect) to 1.0. Lower is better.
0.045
Pre-Event Win Brier
Accuracy of predicting the overall tournament winners before Seed 1 begins. Lower is better.
n = 4,169 historical predictions analyzed

Model Comparison

Macro-AUC scores each event on its own field only (does the model rank that event's qualifiers above its non-qualifiers), then averages across events, so a small event and a large one count equally. The confidence interval comes from resampling which of the backtested events are included; it measures how much this lift depends on which events happen to be in the dataset, not on match-outcome randomness within a given event.

+5.6%
AUC Lift vs. Elo
Macro-AUC (model) minus macro-AUC (raw elo baseline), averaged evenly across events. Positive means the model ranks qualifiers better than elo alone.
[0.008, 0.102]
95% CI
Event-cluster bootstrap: whole events are resampled with replacement to see how much the lift moves if a different combination of the same events had been observed.
0.0122
p-value
Fraction of bootstrap resamples where the baseline matched or beat the model. Not a classical significance test — it only accounts for uncertainty from which events are in the dataset.
n = 10 events

Probability Calibration

A well-calibrated model should be right as often as it says it will be: when it assigns 70% survival odds, the player should survive roughly 70% of the time. The chart below shows predicted vs. actual survival rates across all historical LCQ and MSS events. Grey bars are the predicted rate; colored bars are actual outcomes. Blue means well-calibrated; green means the model was conservative; red means it was overconfident.

Scenario Path Accuracy

To validate survival and threat paths, I check historical events against the model's predictions. For each player the model expected to survive who was actually eliminated (threat cohort) or vice versa (survival cohort), I check whether the opponent the model flagged as pivotal actually placed as predicted.

The grey bar shows what hit rate you'd get by picking that opponent randomly. The blue bar is the model's actual hit rate.

Threat paths: n=12 surprise eliminations across all events

Survival paths: n=7 clutch survivals across all events

Accuracy by Round (Brier Score)

As the tournament progresses, the model's accuracy changes because the pool gets smaller. This chart tracks the average Brier error as we approach the final seed.

Limitations

  • The model does not account for player momentum, fatigue, or meta-game dynamics within an event.
  • Elo and completion time metrics are based on the season ladder. A player having an unusually good or bad day is not reflected.
  • Scenario path validation is based on a small number of historical events. Sample sizes will grow as more seasons are archived.
  • DNF probability is estimated from historical completion rates and does not account for known circumstances like technical issues or scheduling conflicts.

Raw Data

Accuracy BacktestUpdated 6 Sept 2026, 18:18
View
Survival/Threat Scenarios BacktestUpdated 6 Sept 2026, 18:18
View
endereye

survival analytics for MCSR Ranked LCQ and MSS events

MethodologyPlayersFinalists
mcsrranked.com
not affiliated with MCSR Rankedmade with by sydrinea