Give a model enough freedom and it will fit any history perfectly, including all the noise in it. The fit then tells you nothing about the future. In finance this is the default outcome rather than an occasional risk, because the signal is weak and the noise is large. This lesson makes overfitting visible, measures it, and sets out the habits that keep it under control.
| Term | Meaning |
|---|---|
| training error | How badly the model fits the data it was fitted on |
| test error | How badly it predicts new data from the same source |
| bias | Error from a model too simple to capture the real pattern |
| variance | Error from a model so flexible its fit changes with every sample of noise |
| noise floor | The error no model can beat: the variance of the unpredictable part |
| regularisation | Penalising complexity so the fit prefers simple explanations |
The rest of this lesson needs lifetime access
It will be part of lifetime access, which is coming soon: every lesson in all four tracks, including lessons added later, for one payment.
See pricing
Already have access? Sign in

