Failure-adverse closed-loop statistical verification

John F. Quindlen, Ufuk Topcu, Girish Chowdhary, Jonathan P. How

Research output: Chapter in Book/Report/Conference proceedingConference contribution


The increasing complexity of control systems highlights the importance of verification analysis to ensure the resulting closed-loop system robustly satisfies necessary performance requirements. Safety-critical performance requirements present further challenges as failure to satisfy these requirements have severe real-world consequences. For physical systems such as cars or aircraft, simulation-based analysis provides a good indication of the real-world system’s performance without risking physical property or people, but cannot completely replace experimental testing due to discrepancies between simulation models and the real world. Given these considerations, this paper develops new statistical verification frameworks for failure-adverse testing of safety-critical performance requirements in experimental domains. Extensions of recently-developed closed-loop statistical verification algorithms form the core of this failure-adverse approach. These new failure-adverse algorithms break verification into a simulation stage and a hardware stage and carefully select experimental tests so as to maximize the information gained with each experiment while minimizing the likelihood of encountering failures. Two case studies compare the failure-adverse closed-loop verification approach against existing verification techniques and demonstrate its effectiveness in substantially decreasing the number of failures without sacrifices in prediction accuracy.

Original languageEnglish (US)
Title of host publicationAIAA Scitech 2019 Forum
PublisherAmerican Institute of Aeronautics and Astronautics Inc, AIAA
ISBN (Print)9781624105784
StatePublished - 2019
EventAIAA Scitech Forum, 2019 - San Diego, United States
Duration: Jan 7 2019Jan 11 2019

Publication series

NameAIAA Scitech 2019 Forum


ConferenceAIAA Scitech Forum, 2019
Country/TerritoryUnited States
CitySan Diego

ASJC Scopus subject areas

  • Aerospace Engineering


Dive into the research topics of 'Failure-adverse closed-loop statistical verification'. Together they form a unique fingerprint.

Cite this