Unscented Trajectory Optimization
Abstract: In a nutshell, unscented trajectory optimization is the generation of optimal trajectories through the use of an unscented transform. Although unscented trajectory optimization was introduced by the authors about a decade ago, it is reintroduced in this paper as a special instantiation of tychastic optimal control theory. Tychastic optimal control theory (from \textit{Tyche}, the Greek goddess of chance) avoids the use of a Brownian motion and the resulting It^{o} calculus even though it uses random variables across the entire spectrum of a problem formulation. This approach circumvents the enormous technical and numerical challenges associated with stochastic trajectory optimization. Furthermore, it is shown how a tychastic optimal control problem that involves nonlinear transformations of the expectation operator can be quickly instantiated using an unscented transform. These nonlinear transformations are particularly useful in managing trajectory dispersions be it associated with path constraints or targeted values of final-time conditions. This paper also presents a systematic and rapid process for formulating and computing the most desirable tychastic trajectory using an unscented transform. Numerical examples are used to illustrate how unscented trajectory optimization may be used for risk reduction and mission recovery caused by uncertainties and failures.
- Kushner, H. J., “Necessary Conditions for Continuous Parameter Stochastic Optimization Problems,” SIAM Journal of Control, Vol. 10, No. 3, 1972, pp. 550-565.
- Peng, S., “A General Stochastic Maximum Principle for Optimal Control Problems,” SIAM Journal of Control and Optimization, Vol. 28, No. 4, 1990, pp. 966-979.
- Higham, D. J., “An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations,” SIAM Review, Vol. 43, No.3, 2001, pp. 525–546.
- Poznyak, A. S., “Robust Stochastic Maximum Principle: Complete Proof and Discussions,” Mathematical Problems in Engineering, Vol. 8/4-5, 2002, pp. 389–411.
- Bonnans, J. F., “The shooting approach to optimal control problems,” IFAC Proceedings , Volume 46, Issue 11, 2013, pp. 281–292.
- Caillau, J.-B., Ferretti, R., Trélat, E., Zidani, H., “An algorithmic guide for finite-dimensional optimal control problems,” Handbook of Numerical Analysis, Editor(s): E. Trélat, E. Zuazua, Volume 24, 2023, Elsevier, pp. 559–626.
- Conway, B. A., “A Survey of Methods Available for the Numerical Optimization of Continuous Dynamic Systems,” Journal of Optimization Theory and Applications, Vol. 152, 2012, pp. 271–306.
- Ross, I. M., Proulx R. J. and M. Karpenko, “Unscented Optimal Control For Space Flight,” 24th International Symposium on Space Flight Dynamics (ISSFD), Laurel, MD, May 5-9, 2014.
- Ross, I. M., Proulx, R. J., and Karpenko, M., “Unscented Optimal Control for Orbital and Proximity Operations in an Uncertain Environment: A New Zermelo Problem,” AIAA Space and Astro. Forum and Expo.: AIAA/AAS Astrodynamics Specialist Conf., San Diego, CA 4-7 August 2014.
- Ross, I. M., Proulx, R. J., and Karpenko, M. “Unscented Guidance,” Proceedings of the ACC, Chicago, IL, July 1–3, 2015.
- Ross, I. M., Proulx, R. J. Karpenko, M. and Q. Gong, “Riemann-Stieltjes Optimal Control Problems for Uncertain Dynamcial Systems,” Journal of Guidance, Control and Dynamics, Vol. 38, No. 7, 2015, pp. 1251–1263.
- Ross, I. M., Karpenko, M. and Proulx, R. J., “A Lebesgue-Stieltjes Framework For Optimal Control and Allocation,” Proceedings of the ACC, Chicago, IL, July 1–3, 2015.
- Ross, I. M., Proulx, R. J. and Karpenko, M., “Unscented Optimization,” AAS/AIAA Astrodynamics Specialist Conference, Vail, CO, August 9–13, 2015. AAS Paper 15-607.
- Ross, I. M., Karpenko, M. and Proulx, R. J., “Path Constraints in Tychastic and Unscented Optimal Control: Theory, Application and Experimental Results,” Proceedings of the ACC, Boston, IL, July 6–8, 2016.
- Ross, I. M., Proulx, R. J., Karpenko, M “Unscented Control for Uncertain Dynamic Systems,” US Patent 9727034B1, April 29, 2015.
- Ross, I. M., Proulx, R. J. and Karpenko, M., “Monte Rey Methods for Unscented Optimization,” AIAA Guidance, Navigation, and Control Conference, AIAA SciTech Forum, San Diego, CA, January 4–8, 2016. doi:10.2514/6.2016-0871.
- Ross, I. M., Karpenko, M. and Proulx, R. J., “Method and Apparatus for State Space Trajectory Control of Uncertain Dynamic Systems,” US Patent 9849785B1, June 21, 2016.
- Ross, I. M., Karpenko, M. and Proulx, R. J., “Unscented Optimization and Control Allocation,” US Patent 10065312B1, July 13, 2016.
- Ross, I. M., Karpenko, M. and Proulx, R. J., “Closed-Loop Control System Using Unscented Optimization,” US Patent 10095198B1, July 06, 2017.
- Aubin, J.-P., Chen, L., Dordan, O., Faleh, A., Lezan, G. and Planchet, F., “Stochastic and Tychastic Approaches to Guaranteed ALM Problem,” Bulletin Français d’Actuariat, Vol. 12, No. 23, 2012, pp. 59-95.
- Koopman, B. O., “The Theory of Search, II: Target Detection,” Operations Research, Vol. 4, No. 5, 1956, pp. 503–531.
- Stone, L. D. and Richardson, H. R., “Search for Targets with Conditionally Deterministic Motion,” SIAM Journal of Applied Mathematics, Vol. 27, No. 2, September 1974, pp. 239–255.
- Phelps, C., Royset, J. O., and Gong, Q., “Sample Average Approximations in Optimal Control of Uncertain Systems,” Proceedings of the 52nd IEEE CDC, Florence, Italy, 2013.
- Li, J.-S. and Khaneja, N., “Control of Inhomogeneous Quantum Ensembles,” Physical Review A, Vol. 73, No. 030302(R), 2006, pp. 030302-1–030303-4.
- Li, Jr-S., Ruths, J., Yu, T-Y, Arthanari H., and Wagner, G., “Optimal Pulse Design in Quantum Control: A Unified Computational Method,” Proceedings of the NAS, Vol. 108, No. 5, Feb 2011, pp. 1879-1884.
- Vinter, R. B., “Minimax Optimal Control,” SIAM Journal of Control and Optimization, Vol. 44, No. 3, 2005, pp. 939-968.
- Aubin, J.-P., Chen, L., Dordan, O., Faleh, A., Lezan, G. and Planchet, F., “Stochastic and Tychastic Approaches to Guaranteed ALM Problem,” Bulletin Français d’Actuariat, Vol. 12, No. 23, 2012, pp. 59-95.
- Julier, S., J., “The Spherical Simplex Unscented Transformation,” Proceedings of the American Control Conference, Denver, CO, June 4-6, 2003, Vol. 3, pp. 2430–2434.
- Julier, S. J., Uhlmann, J. K. and H. F. Durrant-Whyte, “A New Approach for Filtering Nonlinear Systems,” Proceedings of the American Control Conference, Seattle, WA, 1995, pp. 1628–1632.
- Charnes A. and Cooper, W. W., “Chance-Constrained Programming,” Management Science, Vol. 6, No. 1, 1959, pp. 73–79.
- Cools, R., Mysovskikh, I. P., and Schmid, H. J., “Cubature Formulae and Orthogonal Polynomials,” Journal of Computational and Applied Mathematics, Vol. 127, pp. 121-152, 2001.
- Adurthi, N., Singla, P. and Singh, T., “The Conjugate Unscented Transform - An Approach to Evaluate Multi-dimensional Expectation Integrals,” Proceedings of the American Control Conference, Montreal, QC, Canada, 2012, pp. 5556–5561.
- Menegaz, H. M. T., Ishihara, J. Y., Borges, G. A. and Vargas, A. N., “A Systematization of the Unscented Kalman Filter Theory,” IEEE Transactions on Automatic Control, vol. 60, no. 10, pp. 2583–2598, 2015.
- Stojanovski, Z. and Savransky, D., “Higher-Order Unscented Estimator,” Journal of Guidance, Control, and Dynamics, 44/12, 2021, 2186–2198.
- Ross, I. M., “Enhancements to the DIDO Optimal Control Toolbox,” arXiv preprint, arXiv:2004.13112, 2020, https://arxiv.org/abs/2004.13112.
- Ross, I. M. and Karpenko, M. “A Review of Pseudospectral Optimal Control: From Theory to Flight,” Annual Reviews in Control, Vol. 36, No. 2, pp. 182–197, 2012.
- Gong, Q., Fahroo F. and Ross, I. M., “Spectral Algorithm for Pseudospectral Methods in Optimal Control,” Journal of Guidance, Control, and Dynamics, vol. 31 no. 3, pp. 460-471, 2008.
- Gong, Q. and Ross, I. M., “Autonomous Pseudospectral Knotting Methods for Space Mission Optimization,” Advances in the Astronatuical Sciences, Vol. 124, 2006, AAS 06-151, pp. 779–794.
- Gong, Q., Ross, I. M. and Fahroo, F., “Spectral and Pseudospectral Optimal Control Over Arbitrary Grids,” Journal of Optimization Theory and Applications, vol. 169, no. 3, pp. 759-783, 2016.
- Koeppen, K., Ross, I. M., Wilcox, L. C. and Proulx, R. J., “Fast Mesh Refinement in Pseudospectral Optimal Control,” Journal of Guidance, Control, and Dynamics, vol. 42 no. 4, pp. 711-722, 2019.
- Ross, I. M. and Proulx, R. J., “Further Results on Fast Birkhoff Pseudospectral Optimal Control Programming,” Journal of Guidance, Control, and Dynamics, vol. 42 no. 9, pp. 2086-2092, 2019.
- Bedrossian, N., Karpenko, M., and Bhatt, S., “Overclock My Satellite: Sophisticated Algorithms Boost Satellite Performance on the Cheap,” IEEE Spectrum, November 2012.
- Bedrossian, N., Bhatt, S., Kang, W., and Ross, I. M., “Zero-Propellant Maneuver Guidance,” IEEE Control Systems Magazine, October 2009, pp. 53–73.
- Kang, W. and Bedrossian, N., “Pseudospectral Optimal Control Theory Makes Debut Flight – Saves NASA $1M in Under 3 hrs,” SIAM News, Vol. 40, No. 7, September 2007, Page 1.
- Karpenko, M. et al, “Fast Attitude Maneuvers for NASA’s Lunar Reconnaissance Orbiter: Practical Flight Application of Attitude Guidance Using Birkhoff Pseudospectral Theory and Hamiltonian Programming,” IEEE Control Systems Magazine, to appear.
- Serres, U., “On Zermelo-Like Problems: Gauss-Bonnet Inequality and E. Hopf Theorem,” Journal of Dynamical and Control Systems, January 2009, Vol. 15, No. 1, pp. 99-131.
- Kamel, A., and Tibbitts, R., “Some Useful Results on Initial Node Locations for Near-Equatorial Circular Satellite Orbits,” Celestial Mechanics, Vol. 8, 1973, pp. 45-73.
- Kechichian, J. A., “Optimal Steering for North-South Stationkeeping of Geostationary Spacecraft,” Journal Of Guidance, Control, And Dynamics Vol. 20, No. 3, May-June 1997, pp. 435-444.
- Stevens, R. E. and Baker, W. P., “Optimal Control of a Librating Electrodynamic Tether Performing a Multirevolution Orbit Change,” AIAA Guidance, Navigation, and Control Conference 10-13 August 2009, Chicago, Illinois. AIAA 2009-5803.
- Karpenko, M. and Proulx, R. J., “Experimental Implementation of Riemann-Stieltjes Optimal Control for Agile Imaging Satellites,” Journal of Guidance, Control, and Dynamics, 39/1, 2016, pp. 144-150.
- Ng, H. K., “Strategic Planning with Unscented Optimal Guidance for Urban Air Mobility,” AIAA Aviation Forum, 2020, https://doi.org/10.2514/6.2020-2904
- Dougherty, H., Tompetrini, K. Levinthal, J. and Nurre, G., “Space Telescope Pointing Control System,” Journal of Guidance, Control and Dynamics, Vol. 5, No. 4, 1982, pp. 403-409.
- Beals, G. A., Crum, R. C., Dougherty, H. J., Hegel, D. K., Kelley, J. L., and Rodden, J. J., “Hubble Space Telescope Precision Pointing Control System,” Journal of Guidance, Control and Dynamics, Vol. 11, No. 2, 1988, pp. 119-123.
- Thienel, J. K., and Sanner, R. M., “Hubble Space Telescope Angular Velocity Estimation During the Robotic Servicing Mission,” Journal of Guidance, Control, and Dynamics, Vol. 30, No. 1, 2007, pp. 29-34.
- Markley, F. L. and Nelson, “Zero-Gyro Safemode Controller for the Hubble Space Telescope,” Journal of Guidance, Control and Dynamics, Vol. 17, No. 4, 1994, pp. 815-822.
- Prior, M. and Dunham, L., “System Design and Performance of Two-Gyro Scince Mode for the Hubble Space Telescope,” Acta Astronautica, Vol. 61, 2007, pp. 1010-1018.
- Harwood, W., “Healthy Hubble Telescope Raises Hopes of Longer Life,” Spaceflightnow.com, Posted June 1, 2013.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.