O que é Interpretability?

Interpretability is the degree to which a person can understand why a model produces its outputs: globally (how the prediction depends on each input across the data) or locally (why this prediction, for this input). An explanation is itself a model of the model, and has an accuracy of its own.