Definition Overfitting
In the context of data modeling, overfitting occurs when the model fits perfectly (or, almost perfectly) the data sample on which it is trained but might not have very good predictive power when used on observations outside this training sample. Overfitting often occurs when the data in the training sample is too noisy, the sample is too small, or the model is overly complex.
Please note that the definitions in our statistics encyclopedia are simplified explanations of terms. Our goal is to make the definitions accessible for a broad audience; thus it is possible that some definitions do not adhere entirely to scientific standards.
- Overfitting
- Outlier
- Ordinal scale
- Opinion poll
- Observation
- Objectivity