An AI trained only to recognize faces can suddenly identify a weird texture it has never seen before with near-perfect accuracy.
Diffusion models trained on one specific domain act as universal feature extractors for entirely unrelated data. The geometry of how a model learns to draw a face contains universal mathematical properties that apply to any other type of image. This discovery removes the need to train a new anomaly detector for every different task or industry. You can take a model built for one thing and use it to spot defects in a factory or fraud in a bank with almost no extra work. It suggests that deep learning has found a set of universal mathematical atoms for understanding the world.
Geometry over Density: Few-Shot Cross-Domain OOD Detection
arXiv · 2605.03410
Out-of-distribution (OOD) detection identifies test samples that fall outside a model's training distribution, a capability critical for safe deployment in high-stakes applications. Standard OOD detectors are trained on a specific in-distribution (ID) dataset and detect deviations from that single domain. In contrast, we study few-shot cross-domain OOD detection: given a \emph{single} pre-trained model, can we perform OOD detection on \emph{arbitrary} new ID-OOD task pairs using only a handful o