Empirical Loss

An estimation of the Generalization Loss given a Loss Function $L$ and set $E$ with a total of $N$ examples.

${\mathrm{EmpLoss}}_{L,E}(h):=\frac{1}{N}\left({\sum }_{(x,y)\in E}L(y,h(x))\right)$ We then get the estimated best hypothesis ${\hat{h}}^{\ast }:=\underset{h\in \mathcal{H}}{\mathrm{argmin}}{\text{ EmpLoss }}_{L,E}(h)$