AI/ ai · machine-learning · generative-models · research

Spherical Cauchy Gives VAEs a Faster Way to Model Uncertainty

A new spherical probability distribution beats standard options for AI models that reason on spheres, running faster with better accuracy.

A new statistical distribution lets AI models reason on the surface of a sphere without the usual computational tax.

Researchers built the spherical Cauchy distribution, a new option for variational autoencoders that need to represent uncertainty on a sphere instead of on a flat, Euclidean space. It replaces two awkward standbys: the von Mises-Fisher distribution, which needs modified Bessel functions and a slow rejection sampler, and Power Spherical, which gets tidy math only by forcing the probability to zero at the point directly opposite the mean. The new approach uses a stereographic projection and a Mobius transformation to turn a simple uniform draw into an exact posterior sample using only inner products, norms, and basic arithmetic. The same transformation gives a closed-form way to compute the regularization term (the KL divergence) in every even dimension, with a certified approximation for odd dimensions.

The payoff shows up in both speed and accuracy. At 128 dimensions the method ran 1.5 times faster than Power Spherical and 4.2 times faster than von Mises-Fisher on CPU, with bigger margins on GPU, and it produced the lowest MNIST reconstruction loss at every dimension tested plus a 3.6 percent improvement on a harder 3D-viewpoint benchmark called smallNORB. Models that need to encode rotational or wraparound structure, like 3D poses or camera viewpoints, are the most direct beneficiaries.

Von Mises-Fisher has been the default, if clunky, tool for this job for years, so a faster and more accurate drop-in replacement matters more than a single benchmark table suggests, assuming it holds up outside the paper's own test suite.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →