What is Information criterion?

An information criterion ranks models by fit penalised for size: Akaike’s $\mathrm{AIC} = -2\ell + 2k$ and Schwarz’s $\mathrm{BIC} = -2\ell + k\ln n$, for maximised log-likelihood $\ell$ and $k$ parameters; the smallest wins.