Modern machine learning techniques, including deep learning, is rapidly being applied, adapted, and developed for high energy physics. The goal of this document is to provide a nearly comprehensive list of citations for those developing and applying these approaches to experimental, phenomenological, or theoretical analyses. As a living document, it will be updated as often as possible to incorporate the latest developments. A list of proper (unchanging) reviews can be found within. Papers are grouped into a small set of topics to be as useful as possible. Suggestions are most welcome.
The purpose of this note is to collect references for modern machine learning as applied to particle physics. A minimal number of categories is chosen in order to be as useful as possible. Note that papers may be referenced in more than one category. The fact that a paper is listed in this document does not endorse or validate its content - that is for the community (and for peer-review) to decide. Furthermore, the classification here is a best attempt and may have flaws - please let us know if (a) we have missed a paper you think should be included, (b) a paper has been misclassified, or (c) a citation for a paper is not correct or if the journal information is now available. In order to be as useful as possible, this document will continue to evolve so please check back before you write your next paper. If you find this review helpful, please consider citing it using \cite{hepmllivingreview} in HEPML.bib.
This review was built with the help of the HEP-ML community, the INSPIRE REST API, and the moderators Benjamin Nachman, Matthew Feickert, Claudius Krause, and Ramon Winterhalder.
Modern reviews
Specialized reviews
Classical papers
Datasets
Parameterized classifiers
Representations
Jet images
Event images
Sequences
Trees
Graphs
Sets (point clouds)
Physics-inspired basis
Targets
$W/Z$ tagging
$H\rightarrow b\bar{b}$
quarks and gluons
top quark tagging
strange jets
$b$-tagging
Flavor physics
BSM particles and models
Particle identification
Neutrino Detectors
[Probing the mixing parameter | V\ensuremath{\tau}N | 2 for heavy neutrinos](https://arxiv.org/abs/2211.00309) [DOI] |
Direct Dark Matter Detectors
Cosmology, Astro Particle, and Cosmic Ray physics
Tracking
Heavy Ions / Nuclear Physics
Learning strategies
Hyperparameters
Weak/Semi supervision
Unsupervised
Reinforcement Learning
Quantum Machine Learning
Feature ranking
Attention
Regularization
Optimal Transport
Fast inference / deployment
Software
Hardware/firmware
Deployment
Pileup
Calibration
Recasting
Matrix elements
Parameter estimation
Parton Distribution Functions (and related)
Lattice Gauge Theory
Function Approximation
Symbolic Regression
Equivariant networks.
Decorrelation methods.
GANs:
Autoencoders
Normalizing flows
Diffusion Models
Transformer Models
Physics-inspired
Mixture Models
Phase space generation
Gaussian processes
Other/hybrid
Anomaly detection.
Parameter estimation
Unfolding
Domain adaptation
BSM
Differentiable Simulation
Interpretability
Estimation
Mitigation
Uncertainty- and inference-aware learning
Experimental results. This section is incomplete as there are many results that directly and indirectly (e.g. via flavor tagging) use modern machine learning techniques. We will try to highlight experimental results that use deep learning in a critical way for the final analysis sensitivity.
Performance studies
Searches and measurements were ML reconstruction is a core component
Final analysis discriminate for searches
Measurements using deep learning directly (not through object reconstruction)