Papers
Topics
Authors
Recent
Search
2000 character limit reached

Deep Probabilistic Direction Prediction in 3D with Applications to Directional Dark Matter Detectors

Published 23 Mar 2024 in hep-ex and physics.data-an | (2403.15949v2)

Abstract: We present the first method to probabilistically predict 3D direction in a deep neural network model. The probabilistic predictions are modeled as a heteroscedastic von Mises-Fisher distribution on the sphere $\mathbb{S}2$, giving a simple way to quantify aleatoric uncertainty. This approach generalizes the cosine distance loss which is a special case of our loss function when the uncertainty is assumed to be uniform across samples. We develop approximations required to make the likelihood function and gradient calculations stable. The method is applied to the task of predicting the 3D directions of electrons, the most complex signal in a class of experimental particle physics detectors designed to demonstrate the particle nature of dark matter and study solar neutrinos. Using simulated Monte Carlo data, the initial direction of recoiling electrons is inferred from their tortuous trajectories, as captured by the 3D detectors. For $40\,$keV electrons in a $70\%$ $\textrm{He}$ $30 \%$ $\textrm{CO}_2$ gas mixture at STP, the new approach achieves a mean cosine distance of $0.104$ ($26\circ$) compared to $0.556$ ($64\circ$) achieved by a non-machine learning algorithm. We show that the model is well-calibrated and accuracy can be increased further by removing samples with high predicted uncertainty. This advancement in probabilistic 3D directional learning could increase the sensitivity of directional dark matter detectors.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. S. Biagi. Degrad – transport of electrons in gas mixtures, 2014. URL http://magboltz.web.cern.ch/magboltz.
  2. Implication of neutrino backgrounds on the reach of next generation dark matter direct detection experiments. Phys. Rev. D, 89(2):023524, 2014. doi: 10.1103/PhysRevD.89.023524.
  3. C. Bingham. An antipodally symmetric distribution on the sphere. Annals of Statistics, 2:1201–1225, 1974. URL https://api.semanticscholar.org/CorpusID:123395443.
  4. T. Chang. Spherical Regression. The Annals of Statistics, 14(3):907 – 924, 1986. doi: 10.1214/aos/1176350041. URL https://doi.org/10.1214/aos/1176350041.
  5. A simple framework for contrastive learning of visual representations. In International conference on machine learning, pages 1597–1607. PMLR, 2020.
  6. Hyperspherical variational auto-encoders. 34th Conference on Uncertainty in Artificial Intelligence (UAI-18), 2018.
  7. Deep bingham networks: Dealing with uncertainty and ambiguity in pose estimation. International Journal of Computer Vision, 130(7):1627–1654, 2022.
  8. I. S. Dhillon and S. Sra. Modeling data using directional distributions. Technical report, The University of Texas at Austin, 2003.
  9. Texture mapping via spherical multi-dimensional scaling. In Scale Space and PDE Methods in Computer Vision: 5th International Conference, Scale-Space 2005, Hofgeismar, Germany, April 7-9, 2005. Proceedings 5, pages 443–455. Springer, 2005.
  10. Deep orientation uncertainty learning based on a bingham loss. In International Conference on Learning Representations, 2020. URL https://openreview.net/forum?id=ryloogSKDS.
  11. Deep-learning-based reconstruction of the neutrino direction and energy for in-ice radio detectors. Astroparticle Physics, 145:102781, 2023. ISSN 0927-6505. doi: https://doi.org/10.1016/j.astropartphys.2022.102781. URL https://www.sciencedirect.com/science/article/pii/S0927650522000822.
  12. B. Graham and L. van der Maaten. Submanifold sparse convolutional networks. arXiv preprint arXiv:1706.01307, 2017.
  13. 3d semantic segmentation with submanifold sparse convolutional networks. CVPR, 2018.
  14. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9729–9738, 2020.
  15. D. Hoag. Apollo guidance and navigation: Considerations of apollo imu gimbal lock. Canbridge: MIT Instrumentation Laboratory, pages 1–64, 1963.
  16. Cooperative holistic scene understanding: Unifying 3d object, layout, and camera pose estimation. In Advances in Neural Information Processing Systems, pages 206–217, 2018.
  17. I. Jaegle et al. Compact, directional neutron detectors capable of high-resolution nuclear recoil imaging. Nucl. Instrum. Meth. A, 945:162296, 2019. doi: 10.1016/j.nima.2019.06.037.
  18. J. T. Kent. The fisher-bingham distribution on the sphere. Journal of the Royal Statistical Society. Series B (Methodological), 44(1):71–80, 1982. ISSN 00359246. URL http://www.jstor.org/stable/2984712.
  19. The von mises–fisher matrix distribution in orientation statistics. Journal of the royal statistical society series b-methodological, 39:95–106, 1977. URL https://api.semanticscholar.org/CorpusID:126381617.
  20. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  21. A convolutional neural network approach for reconstructing polarization information of photoelectric x-ray polarimeters. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 942:162389, 2019. ISSN 0168-9002. doi: https://doi.org/10.1016/j.nima.2019.162389. URL https://www.sciencedirect.com/science/article/pii/S0168900219309726.
  22. Image to sphere: Learning equivariant features for efficient pose prediction. In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=_2bDpAtr7PI.
  23. C. Ley and T. Verdebout. Applied directional statistics: modern methods and case studies. CRC Press, 2018.
  24. Spherical regression: Learning viewpoints, surface normals and 3d rotations on n-spheres. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, USA, June 2019.
  25. Delving into discrete normalizing flows on SO(3) manifold for probabilistic rotation modeling, 2023. URL https://openreview.net/forum?id=pvrkJUkmto.
  26. 3d pose regression using convolutional neural networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 494–495, 2017. doi: 10.1109/CVPRW.2017.73.
  27. A mixed classification-regression framework for 3d pose estimation from 2d images. ArXiv, abs/1805.03225, 2018. URL https://api.semanticscholar.org/CorpusID:13688430.
  28. A. D. Marco et al. A weighted analysis to improve the x-ray polarization sensitivity of the imaging x-ray polarimetry explorer. The Astronomical Journal, 163(4):170, mar 2022. doi: 10.3847/1538-3881/ac51c9. URL https://dx.doi.org/10.3847/1538-3881/ac51c9.
  29. K. Mardia. Statistics of directional data. Academic Press, 1972. ISBN 0124711502.
  30. Directional statistics, volume 2. Wiley Online Library, 2000.
  31. Spherical regression models using projective linear transformations. Journal of the American Statistical Association, 109(508):1615–1624, 2014. doi: 10.1080/01621459.2014.892881. URL https://doi.org/10.1080/01621459.2014.892881.
  32. Probabilistic orientation estimation with matrix fisher distributions. In H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 4884–4893. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper_files/paper/2020/file/33cc2b872dfe481abef0f61af181dfcf-Paper.pdf.
  33. Implicit-pdf: Non-parametric representation of probability distributions on the rotation manifold. In M. Meila and T. Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 7882–7893. PMLR, 18–24 Jul 2021. URL https://proceedings.mlr.press/v139/murphy21a.html.
  34. C. A. J. O’Hare. New Definition of the Neutrino Floor for Direct Dark Matter Searches. Phys. Rev. Lett., 127(25):251802, 2021. doi: 10.1103/PhysRevLett.127.251802.
  35. C. A. J. O’Hare et al. Recoil imaging for dark matter, neutrinos, and physics beyond the Standard Model. In Snowmass 2021, 3 2022.
  36. Spherical regression models with general covariates and anisotropic errors. Statistics and Computing, 30:153–165, 2020.
  37. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32, 2019.
  38. Deep ensemble analysis for imaging x-ray polarimetry. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 986:164740, 2021. ISSN 0168-9002. doi: https://doi.org/10.1016/j.nima.2020.164740. URL https://www.sciencedirect.com/science/article/pii/S0168900220311372.
  39. D. Pfeiffer et al. Interfacing Geant4, Garfield++ and Degrad for the Simulation of Gaseous Detectors. Nucl. Instrum. Meth. A, 935:121–134, 2019. doi: 10.1016/j.nima.2019.04.110.
  40. Deep directional statistics: Pose estimation with uncertainty quantification. In European Conference on Computer Vision (ECCV), Sept. 2018.
  41. L.-P. Rivest. Spherical Regression for Concentrated Fisher-Von Mises Distributions. The Annals of Statistics, 17(1):307 – 317, 1989. doi: 10.1214/aos/1176347018. URL https://doi.org/10.1214/aos/1176347018.
  42. Spconv Contributors. Spconv: Spatially Sparse Convolution Library, Oct. 2022. URL https://github.com/traveller59/spconv.
  43. Directional Recoil Detection. Ann. Rev. Nucl. Part. Sci., 71:189–224, 2021. doi: 10.1146/annurev-nucl-020821-035016.
  44. F. Villante and A. Serenelli. An updated discussion of the solar abundance problem. In Solar Neutrinos: Proceedings of the 5th International Solar Neutrino Conference, pages 103–120. World Scientific, 2019.
  45. M. C. Weisskopf et al. The imaging x-ray polarimetry explorer (ixpe). Results in Physics, 6:1179–1180, 2016. ISSN 2211-3797. doi: https://doi.org/10.1016/j.rinp.2016.10.021. URL https://www.sciencedirect.com/science/article/pii/S221137971630448X.
  46. Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes. 2018.
  47. Second: Sparsely embedded convolutional detection. Sensors, 18(10), 2018. ISSN 1424-8220. doi: 10.3390/s18103337. URL https://www.mdpi.com/1424-8220/18/10/3337.
Citations (3)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We found no open problems mentioned in this paper.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 3 tweets with 2 likes about this paper.