MomentAux: When Does Fusing Hand-crafted Knowledge with Learned Representations Pay?
arXiv 2026 project page / arXiv / code
A cost-normalized benchmark of stacking, substitution and interference: one hand-crafted spectral prior against data-driven alternatives under a single frozen recipe, across 14 datasets and 11 backbones. The free prior is worth more to a small transformer than two rounds of self-supervised pre-training, and nothing to a convolutional network that already has enough data.