What is Brier score?

The Brier score of probability forecasts $p_i$ of binary outcomes $y_i\in\{0,1\}$ is the mean squared error $\frac1N\sum_i(p_i-y_i)^2$: zero for perfect forecasts, 0.25 for a constant forecast of one half, lower is better.