·
Multimodal Foundation Model for Particle Physics
One model for many steps of collider reconstruction and simulation. Seven kinds of data share one token vocabulary, and a task is a choice of which to provide and which to request.
Key result
1302
tasks, one model
One set of weights maps any subset of seven modalities to any other, trained on 88.9M simulated jets. Trained on particle flow alone, the autoregressive model matches HGPflow on jet resolution and is far harder to tell from the truth.
Resources