Confidence Intervals on Multivariate Normal Quantiles for Environmental Specification Development in Multi-axis Shock and Vibration Testing
Abstract: This article describes two Monte Carlo methods for calculating confidence intervals on cumulative density function (CDF) based multivariate normal quantiles that allows for controlling the tail regions of a multivariate distribution where one is most concerned about extreme responses. The CDF based multivariate normal quantiles associated with bivariate distributions are represented as contours and for trivariate distributions represented as iso-surfaces. We first provide a novel methodology for an inverse problem, characterizing the uncertainty on the $\tau{\mathrm{th}}$ multivariate quantile probability, when using concurrent univariate quantile probabilities. The uncertainty on the $\tau{\mathrm{th}}$ multivariate quantile probability demonstrates inadequacy in univariate methods which neglect correlation between multiple variates. Limitations of traditional multivariate normal tolerance regions and simultaneous univariate tolerance methods are discussed thereby necessitating the need for confidence intervals on CDF based multivariate normal quantiles. Two Monte Carlo methods are discussed; the first calculates the CDF over a tessellated domain followed by taking a bootstrap confidence interval over the tessellated CDF. The CDF based multivariate quantiles are then estimated from the CDF confidence intervals. For the second method, only the point associated with highest probability density along the CDF based quantile is calculated, which greatly improves the computational speed compared to the first method. Monte Carlo simulation studies are used to assess the performance of the various methods. Finally, real data analysis is performed to illustrate a workflow for CDF based multivariate normal quantiles in the domain of mechanical shock and vibration to specify a minimum conservative test level for environmental specification.
- A. Wald and J. Wolfowitz. Tolerance Limits for a Normal Distribution. The Annals of Mathematical Statistics, 17(2):208–215, 1946. ISSN 0003-4851. URL https://www.jstor.org/stable/2236039. Publisher: Institute of Mathematical Statistics.
- Abraham Wald. An Extension of Wilks’ Method for Setting Tolerance Limits. The Annals of Mathematical Statistics, 14(1):45–55, 1943. ISSN 0003-4851. URL https://www.jstor.org/stable/2236001. Publisher: Institute of Mathematical Statistics.
- Abraham Wald. Setting of Tolerance Limits When the Sample is Large. The Annals of Mathematical Statistics, 13(4):389–399, 1942. ISSN 0003-4851. URL https://www.jstor.org/stable/2235841. Publisher: Institute of Mathematical Statistics.
- Statistical Intervals: A Guide for Practitioners and Researchers, 2nd Edition | Wiley. Wiley, March 2023. ISBN 978-0-471-68717-7. URL https://www.wiley.com/en-us/Statistical+Intervals%3A+A+Guide+for+Practitioners+and+Researchers%2C+2nd+Edition-p-9780471687177.
- Tolerance interval testing for assessing accuracy and precision simultaneously. PLoS ONE, 16(2):e0246642, February 2021. ISSN 1932-6203. 10.1371/journal.pone.0246642. URL https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7864420/.
- Modern Industrial Statistics: With Applications in R, MINITAB, and JMP. John Wiley & Sons, May 2021. ISBN 978-1-119-71496-5. URL https://www.wiley.com/en-us/Modern+Industrial+Statistics:+With+Applications+in+R,+MINITAB,+and+JMP,+3rd+Edition-p-9781119714903. Google-Books-ID: iYEqEAAAQBAJ.
- To tolerate or to agree: A tutorial on tolerance intervals in method comparison studies with BivRegBLS R Package. Statistics in Medicine, 39(28):4334–4349, December 2020. ISSN 0277-6715. 10.1002/sim.8709. URL https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7756677/.
- Rectangular tolerance regions and multivariate normal reference regions in laboratory medicine. Biometrical Journal, 65(3):2100180, 2023. ISSN 1521-4036. 10.1002/bimj.202100180. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/bimj.202100180. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/bimj.202100180.
- Nonparametric hyperrectangular tolerance and prediction regions for setting multivariate reference regions in laboratory medicine. Statistical Methods in Medical Research, 29(12):3569–3585, December 2020. ISSN 0962-2802. 10.1177/0962280220933910. URL https://doi.org/10.1177/0962280220933910. Publisher: SAGE Publications Ltd STM.
- Victor Chew. Confidence, Prediction, and Tolerance Regions for the Multivariate Normal Distribution. Journal of the American Statistical Association, 61(315):605–617, September 1966. ISSN 0162-1459. 10.1080/01621459.1966.10480892. URL https://www.tandfonline.com/doi/abs/10.1080/01621459.1966.10480892. Publisher: Taylor & Francis _eprint: https://www.tandfonline.com/doi/pdf/10.1080/01621459.1966.10480892.
- The Multivariate Normal Distribution. In Statistical Tolerance Regions: Theory, Applications, and Computation, pages 225–247. John Wiley & Sons, Ltd, 2009. ISBN 978-0-470-47390-0. 10.1002/9780470473900.ch9. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/9780470473900.ch9. Section: 9 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/9780470473900.ch9.
- Björn Bornkamp. Calculating quantiles of noisy distribution functions using local linear regressions. Computational Statistics, 33(1):487–501, March 2018. ISSN 1613-9658. 10.1007/s00180-017-0736-0. URL https://doi.org/10.1007/s00180-017-0736-0.
- Distribution-Function-Based Bivariate Quantiles. Journal of Multivariate Analysis, 83(1):208–231, October 2002. ISSN 0047-259X. 10.1006/jmva.2001.2043. URL https://www.sciencedirect.com/science/article/pii/S0047259X01920433.
- Directional bivariate quantiles: a robust approach based on the cumulative distribution function. AStA Advances in Statistical Analysis, 104(2):225–260, June 2020. ISSN 1863-818X. 10.1007/s10182-019-00355-3. URL https://doi.org/10.1007/s10182-019-00355-3.
- B. Efron. Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics, 7(1):1–26, 1979. ISSN 0090-5364. URL https://www.jstor.org/stable/2958830. Publisher: Institute of Mathematical Statistics.
- B. Efron and R. Tibshirani. Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy. Statistical Science, 1(1):54–75, 1986. ISSN 0883-4237. URL https://www.jstor.org/stable/2245500. Publisher: Institute of Mathematical Statistics.
- The Jackknife and the Bootstrap. In Computer Age Statistical Inference: Algorithms, Evidence, and Data Science, Institute of Mathematical Statistics Monographs, pages 155–180. Cambridge University Press, Cambridge, 2016. ISBN 978-1-107-14989-2. 10.1017/CBO9781316576533.011. URL https://www.cambridge.org/core/books/computer-age-statistical-inference/jackknife-and-the-bootstrap/900BA9154E0F7F487FDE155336A99BF1.
- Fast multivariate empirical cumulative distribution function with connection to kernel density estimation. Computational Statistics & Data Analysis, 162:107267, October 2021. ISSN 0167-9473. 10.1016/j.csda.2021.107267. URL https://www.sciencedirect.com/science/article/pii/S0167947321001018.
- Bootstrap Confidence Intervals. In Bootstrap Methods and their Application, Cambridge Series in Statistical and Probabilistic Mathematics, pages 191–255. Cambridge University Press, Cambridge, 1997. ISBN 978-0-521-57471-6. 10.1017/CBO9780511802843.006. URL https://www.cambridge.org/core/books/bootstrap-methods-and-their-application/confidence-intervals/499FDF2036D956E7B7E7FB7F25D08B13.
- Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Statistics in Medicine, 19(9):1141–1164, 2000. ISSN 1097-0258. 10.1002/(SICI)1097-0258(20000515)19:9¡1141::AID-SIM479¿3.0.CO;2-F. URL https://onlinelibrary.wiley.com/doi/abs/10.1002/%28SICI%291097-0258%2820000515%2919%3A9%3C1141%3A%3AAID-SIM479%3E3.0.CO%3B2-F. _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/%28SICI%291097-0258%2820000515%2919%3A9%3C1141%3A%3AAID-SIM479%3E3.0.CO%3B2-F.
- Generating random correlation matrices based on vines and extended onion method. Journal of Multivariate Analysis, 100(9):1989–2001, October 2009. ISSN 0047-259X. 10.1016/j.jmva.2009.04.008. URL https://www.sciencedirect.com/science/article/pii/S0047259X09000876.
- TMIL-STD-810 TEST METHOD STANDARD: ENVIRONMENTAL ENGINEERING CONSIDERATIONS AND LABORATORY TESTS, a.
- URL https://www.desolutions.com/testing-services/test-standards/jesd22/.
- NAVMAT P-9492 NAVY MANUFACTURING SCREENING PROGRAM DECREASE CORPORATE COSTS INCREASE FLEET READINESS, c.
- Fatigue failure results for multi-axial versus uniaxial stress screen vibration testing. Shock and Vibration, 9(6):319–328, January 2002. ISSN 1070-9622. URL https://content.iospress.com/articles/shock-and-vibration/sav00185. Publisher: IOS Press.
- Multi-Axis Resonant Plate Shock Testing Evaluation and Test Specification Development. Technical Report SAND-2020-10224, Sandia National Lab. (SNL-NM), Albuquerque, NM (United States), September 2020. URL https://www.osti.gov/biblio/1670873.
- Garrett Dean Nelson. A Systematic Evaluation of Test Specification Derivation Methods for Multi-Axis Vibration Testing. Technical Report SAND2017-11538C, Sandia National Lab. (SNL-NM), Albuquerque, NM (United States), October 2017. URL https://www.osti.gov/biblio/1480216. ISSN: 2191-5644.
- Christian Lalanne. Mechanical Vibration and Shock Analysis, Volume 5, Specification Development, 3rd Edition | Wiley. Wiley, April 2014. ISBN 978-1-118-93123-3. URL https://www.wiley.com/en-ie/Mechanical+Vibration+and+Shock+Analysis%2C+Volume+5%2C+Specification+Development%2C+3rd+Edition-p-9781118931233.
- Laura Diane Jacobs-Omalley. Methodology for Defining Multi-Axis Vibration Specifications. Technical Report SAND2014-18809C, Sandia National Lab. (SNL-NM), Albuquerque, NM (United States), October 2014. URL https://www.osti.gov/biblio/1315349.
- Comparison of Multi-Axis and Single Axis Testing on Plate Structures. Technical Report SAND2015-1363C, Sandia National Lab. (SNL-NM), Albuquerque, NM (United States), February 2015. URL https://www.osti.gov/biblio/1240323.
- Applied Multivariate Statistical Analysis. Pearson, Upper Saddle River, N.J, 6th edition edition, April 2007. ISBN 978-0-13-187715-3.
- Zvi Drezner. Computation of the Trivariate Normal Integral. Mathematics of Computation, 62(205):289–294, 1994. ISSN 0025-5718. 10.2307/2153409. URL https://www.jstor.org/stable/2153409. Publisher: American Mathematical Society.
- On the computation of the bivariate normal integral. Journal of Statistical Computation and Simulation, 35(1-2):101–107, March 1990. ISSN 0094-9655. 10.1080/00949659008811236. URL https://doi.org/10.1080/00949659008811236. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/00949659008811236.
- Alan Genz. Numerical computation of rectangular bivariate and trivariate normal and t probabilities. Statistics and Computing, 14(3):251–260, August 2004. ISSN 1573-1375. 10.1023/B:STCO.0000035304.20635.31. URL https://doi.org/10.1023/B:STCO.0000035304.20635.31.
- Numerical computation of multivariate t-probabilities with application to power calculation of multiple contrasts. Journal of Statistical Computation and Simulation, 63(4):103–117, July 1999. ISSN 0094-9655. 10.1080/00949659908811962. URL https://doi.org/10.1080/00949659908811962. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/00949659908811962.
- Comparison of Methods for the Computation of Multivariate t Probabilities. Journal of Computational and Graphical Statistics, 11(4):950–971, December 2002. ISSN 1061-8600. 10.1198/106186002394. URL https://doi.org/10.1198/106186002394. Publisher: Taylor & Francis _eprint: https://doi.org/10.1198/106186002394.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.