Designing an Objective-Driven Test Method for the Comparative Performance Evaluation of Commercial DTI Solutions for Counter UAS systems
Abstract: Unmanned Aerial Systems (UASs) or drones become more and more commercially available and cheap. There has been much emphasis on developing and deploying Counter-UAS systems (UASs) with Detection Tracking and Identification (DTI) solutions. However, the capabilities of these systems are hard to benchmark. Performance claims of these systems are currently not supported by evidence. In addition, no standard test methodologies are available for these DTI systems and different test methodologies make comparison of these systems hard or impossible. We report on the definition, development and verification of an objective-driven test method and corresponding comparative performance evaluation for commercial DTI solutions for C-UASs. The developed methodology is based on end-user scenarios that are operationally relevant. The test methodology is based on a generic DTI system lay-out and is detailed towards detection, tracking and identification, taking into account contextual information and end-user input. The comparative performance evaluation is developed to enable the use of the methodology in a relevant environment, thereby taking into account any potential environmental aspect that might influence DTI system performance. Validation of the work in a relevant environment has been done in three operational trials. The operational trial results show that the method allows for performance evaluation at component level (i.e., detection, tracking or identification component) and at system level (combinations of these components and integrated DTI system of system solutions).
- Securing Your Airspace: Detection of Drones Trespassing Protected Areas. Sensors 2024, 24. https://doi.org/10.3390/s24072028.
- Joint Research Centre and Institute for the Protection and Security of the Citizen.; Boucher, P. Civil drones in society – Societal and ethics aspects of remotely piloted aircraft systems; Publications Office, 2014. https://doi.org/doi/10.2788/14527.
- Risk Analysis of the Use of Drones in City Logistics. Mathematics 2024, 12. https://doi.org/10.3390/math12081250.
- Protection against Unmanned Aircraft Systems – Handbook on UAS risk assessment and principles for physical hardening of buildings and sites; Publications Office of the European Union, 2023. https://doi.org/doi/10.2760/969680.
- Advances and Challenges in Drone Detection and Classification Techniques: A State-of-the-Art Review. Sensors 2024, 24. https://doi.org/10.3390/s24010125.
- Protection against Unmanned Aircraft Systems – Handbook on UAS protection of critical infrastructure and public space – A five phase approach for C-UAS stakeholders; Publications Office of the European Union, 2023. https://doi.org/doi/10.2760/18569.
- System Analysis of Counter-Unmanned Aerial Systems Kill Chain in an Operational Environment. Systems 2021, 9. https://doi.org/10.3390/systems9040079.
- Detection of maritime anomalous behavior in a successful MARISA North Sea trial. 10 2019.
- Automatic threat evaluation for border security and surveillance. 10 2019, p. 15. https://doi.org/10.1117/12.2532308.
- Drone Detection and Tracking Using RF Identification Signals. Sensors 2023, 23. https://doi.org/10.3390/s23177650.
- Counter unmanned aerial system testing and evaluation methodology. 05 2017, p. 1018408. https://doi.org/10.1117/12.2262538.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
