Improving Cramér-Rao Bound And Its Variants: An Extrinsic Geometry Perspective

This work presents a geometric refinement of the classical Cram\'er-Rao bound (CRB) by incorporating curvature-aware corrections based on the second fundamental form associated with the statistical model manifold. That is, our formulation shows that relying on the extrinsic geometry of the square root embedding of the manifold in the ambient Hilbert space comprising square integrable functions with respect to a fixed base measure offers a rigorous (and intuitive) way to improve upon the CRB and some of its variants, such as the Bhattacharyya-type bounds, that use higher-order derivatives of the log-likelihood. Precisely, the improved bounds in the latter case make explicit use of the elegant framework offered by employing the Fa\`a di Bruno formula and exponential Bell polynomials in expressing the jets associated with the square root embedding in terms of the raw scores. The interplay between the geometry of the statistical embedding and the behavior of the estimator variance is quantitatively analyzed in concrete examples, showing that our corrections can meaningfully tighten the lower bound, suggesting further exploration into connections with estimator efficiency in more general situations.