Papers
Topics
Authors
Recent
2000 character limit reached

Falsification of a Vision-based Automatic Landing System (2307.01925v1)

Published 4 Jul 2023 in cs.RO, cs.SY, and eess.SY

Abstract: At smaller airports without an instrument approach or advanced equipment, automatic landing of aircraft is a safety-critical task that requires the use of sensors present on the aircraft. In this paper, we study falsification of an automatic landing system for fixed-wing aircraft using a camera as its main sensor. We first present an architecture for vision-based automatic landing, including a vision-based runway distance and orientation estimator and an associated PID controller. We then outline landing specifications that we validate with actual flight data. Using these specifications, we propose the use of the falsification tool Breach to find counterexamples to the specifications in the automatic landing system. Our experiments are implemented using a Beechcraft Baron 58 in the X-Plane flight simulator communicating with MATLAB Simulink.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. Charnley, W., “Blind landing,” The Journal of Navigation, Vol. 12, No. 2, 1959, pp. 115–140.
  2. Teubert, C., “X-Plane Connect,” https://github.com/nasa/XPlaneConnect, 2013–2017.
  3. Pnueli, A., “The temporal logic of programs,” 18th Annual Symposium on Foundations of Computer Science (sfcs 1977), IEEE, 1977, pp. 46–57.
  4. Donzé, A., “Breach, A Toolbox for Verification and Parameter Synthesis of Hybrid Systems,” Computer Aided Verification, edited by T. Touili, B. Cook, and P. Jackson, Springer Berlin Heidelberg, Berlin, Heidelberg, 2010, pp. 167–170.
  5. Huh, S., and Shim, D. H., “A vision-based automatic landing method for fixed-wing UAVs,” Journal of Intelligent and Robotic Systems, Vol. 57, No. 1-4, 2010, p. 217.
  6. Laiacker, M., Kondak, K., Schwarzbach, M., and Muskardin, T., “Vision aided automatic landing system for fixed wing UAV,” 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2013, pp. 2971–2976.
  7. Min, B.-M., Tahk, M.-J., Shim, D. H., and Bang, H., “Guidance law for vision-based automatic landing of UAV,” International Journal of Aeronautical and Space Sciences, Vol. 8, No. 1, 2007, pp. 46–53.
  8. Thurrowgood, S., Moore, R. J., Soccol, D., Knight, M., and Srinivasan, M. V., “A biologically inspired, vision-based guidance system for automatic landing of a fixed-wing aircraft,” Journal of Field Robotics, Vol. 31, No. 4, 2014, pp. 699–727.
  9. Le Bras, F., Hamel, T., Barat, C., and Mahony, R., “Nonlinear image-based visual servo controller for automatic landing guidance of a fixed-wing aircraft,” 2009 European Control Conference (ECC), IEEE, 2009, pp. 1836–1841.
  10. Burlion, L., De Plinval, H., and Mouyon, P., “Backstepping based visual servoing for transport aircraft automatic landing,” 2014 IEEE Conference on Control Applications (CCA), IEEE, 2014, pp. 1461–1466.
  11. Coutard, L., Chaumette, F., and Pflimlin, J.-M., “Automatic landing on aircraft carrier by visual servoing,” 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2011, pp. 2843–2848.
  12. Victor, G., and Guilhem, P., “Landing of an airliner using image based visual servoing,” IFAC Proceedings Volumes, Vol. 46, Elsevier, 2013, pp. 74–79.
  13. Rives, P., and Azinheira, J. R., “Visual auto-landing of an autonomous aircraft,” 2002.
  14. Oishi, M., Mitchell, I., Bayen, A., Tomlin, C., and Degani, A., “Hybrid verification of an interface for an automatic landing,” Proceedings of the 41st IEEE Conference on Decision and Control, 2002., Vol. 2, IEEE, 2002, pp. 1607–1613.
  15. Umeno, S., and Lynch, N., “Safety verification of an aircraft landing protocol: A refinement approach,” International Workshop on Hybrid Systems: Computation and Control, Springer, 2007, pp. 557–572.
  16. Johnson, T. T., and Mitra, S., “Parametrized verification of distributed cyber-physical systems: An aircraft landing protocol case study,” 2012 IEEE/ACM Third International Conference on Cyber-Physical Systems, IEEE, 2012, pp. 161–170.
  17. George, F., “Flying Garmin’s New Emergency Autoland,” Aviation Week, 2019. URL https://aviationweek.com/business-aviation/flying-garmins-new-emergency-autoland.
  18. Zhang, Y., Poupart-Lafarge, G., Teng, H., Wilhelm, J., Jeannin, J.-B., Ozay, N., and Scholte, E., “A software architecture for autonomous taxiing of aircraft,” AIAA Scitech 2020 Forum, 2020, p. 0139.
  19. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A., “You only look once: Unified, real-time object detection,” Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 779–788.
  20. Zheng, Y., Sugimoto, S., and Okutomi, M., “Aspnp: An accurate and scalable solution to the perspective-n-point problem,” IEICE TRANSACTIONS on Information and Systems, Vol. 96, No. 7, 2013, pp. 1525–1535.
  21. Collins, T., and Bartoli, A., “Infinitesimal plane-based pose estimation,” International journal of computer vision, Vol. 109, No. 3, 2014, pp. 252–286.
  22. Ouyang, W., Wang, X., Zhang, C., and Yang, X., “Factors in finetuning deep model for object detection with long-tail distribution,” Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 864–873.
  23. Miller, A., Shah, M., and Harper, D., “Landing a UAV on a runway using image registration,” 2008 IEEE International Conference on Robotics and Automation, IEEE, 2008, pp. 182–187.
  24. Wen, F., Ying, R., Gong, Z., and Liu, P., “Efficient Algorithms for Maximum Consensus Robust Fitting,” IEEE Transactions on Robotics, Vol. 36, No. 1, 2020, pp. 92–106.
  25. Li, X., Wang, K., Wang, W., and Li, Y., “A multiple object tracking method using Kalman filter,” The 2010 IEEE international conference on information and automation, IEEE, 2010, pp. 1862–1866.
  26. Federal Aviation Administration, “Ann Arbor Municipal (KARB) RNAV (GPS) Runway 6 approach,” https://aeronav.faa.gov/d-tpp/2012/05506R6.PDF, retrieved November 2020.
  27. Paw, Y. C., “Synthesis and validation of flight control for UAV.” Dissertation, University of Minnesota, 2009.
  28. https://www.aopa.org/training-and-safety/students/solo/skills/the-quest-for-the-perfect-landing.
  29. Saini, M., “Flying by the numbers: A precise approach to landing,” FAA aviation news, Vol. 49, No. 2, 2010, p. 11.
  30. http://www.aviationchief.com/ils.html.
  31. FlightRadar24, “FlightRadar24,” https://www.flightradar24.com/data/flights/dl4755#2552d3cc, retrieved September 2020.
  32. James Terpstra, “Constant Angle Non-Precision Approaches,” http://www.jeppesen.com/download/aopa/dec99aopa.pdf, 1999.
  33. AirNav, “John F Kennedy International Airport FAA Information,” http://www.airnav.com/airport/jfk, retrieved December 2020.
  34. Bartocci, E., Manjunath, N., Mariani, L., Mateis, C., and Ničković, D., “Automatic Failure Explanation in CPS Models,” International Conference on Software Engineering and Formal Methods, Springer, 2019, pp. 69–86.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now

Whiteboard

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up