PAC-Bayesian Analysis: A Link Between Inference and Statistical Physics

PAC-Bayesian analysis is a general tool for deriving generalization bounds for a wide class of inference rules. Interestingly, PAC-Bayesian generalization bounds take a form of a trade-off between the