This paper describes a system that can automatically annotate videos and illustrates its application to tennis games. A unified apparatus is proposed, cast in a Bayesian reasoning framework. This is s