Overfitting and how training and test sets catch it

A model that scores 100% on the examples it learned from might be brilliant, or it might be useless. The whole point of machine learning is to perform well on new data, and the examples you trained on cannot tell you that by themselves. This lesson shows why, and what to do about it.