Kullback-Leibler Divergence Estimation of Continuous Distributions

We present a universal method for estimating the KL divergence between continuous densities and we prove it converges almost surely. Divergence estimation is typically solved estimating the densities