We continue our investigation in [RST] of a martingale formed by picking a measurable set $A$ in a compact group $G$, taking random rotates of $A$, and considering measures of the resulting intersections, suitably normalized. Here we concentrate on the inverse problem of recognizing $A$ from a small amount of data from this martingale. This leads to problems in harmonic analysis on $G$, including an analysis of integrals of products of Gegenbauer polynomials.