TY - GEN
T1 - Scheduling Classifiers for Real-Time Hazard Perception Considering Functional Uncertainty
AU - Abdelzaher, Tarek
AU - Baruah, Sanjoy
AU - Bate, Iain
AU - Burns, Alan
AU - Davis, Robert Ian
AU - Hu, Yigong
N1 - The importance of obtaining assurance for safety-critical systems that incorporate machine learning has been recognized in several large-scale initiatives including: the Assured Autonomy Program [24] of the United States Defense Advanced Research Projects Agency (DARPA); the Assuring Autonomy International Programme [25], funded by Lloyd’s of London; and the Bounded Behavior Assurance initiative [20], led by Northrop Grumman Corporation.
This research was funded in part by Innovate UK HICLASS project (113213), and the US National Science Foundation (Grants CPS-1932530, CNS-2141256, and CNS-2229290). EPSRC Research Data Management: No new primary data was created during this study.
PY - 2023/6/7
Y1 - 2023/6/7
N2 - This paper addresses the problem of real-time classification-based machine perception, exemplified by a mobile autonomous system that must continually check that a designated area ahead is free of hazards. Such hazards must be identified within a specified time. In practice, classifiers are imperfect; they exhibit functional uncertainty. In the majority of cases, a given classifier will correctly determine whether there is a hazard or the area ahead is clear. However, in other cases it may produce false positives, i.e. indicate hazard when the area is clear, or false negatives, i.e. indicate clear when there is in fact a hazard. The former are undesirable since they reduce quality of service, whereas the latter are a potential safety concern. A stringent constraint is therefore placed on the maximum permitted probability of false negatives. Since this requirement may not be achievable using a single classifier, one approach is to (logically) OR the outputs of multiple disparate classifiers together, setting the final output to hazard if any of the classifiers indicates hazard. This reduces the probability of false negatives; however, the trade-off is an inevitably increase in the probability of false positives and an increase in the overall execution time required. In this paper, we provide optimal algorithms for the scheduling of classifiers that minimize the probability of false positives, while meeting both a latency constraint and a constraint on the maximum acceptable probability of false negatives. The classifiers may have arbitrary statistical dependences between their functional behaviors (probabilities of correct identification of hazards), as well as variability in their execution times, characterized by typical and worst-case values.
AB - This paper addresses the problem of real-time classification-based machine perception, exemplified by a mobile autonomous system that must continually check that a designated area ahead is free of hazards. Such hazards must be identified within a specified time. In practice, classifiers are imperfect; they exhibit functional uncertainty. In the majority of cases, a given classifier will correctly determine whether there is a hazard or the area ahead is clear. However, in other cases it may produce false positives, i.e. indicate hazard when the area is clear, or false negatives, i.e. indicate clear when there is in fact a hazard. The former are undesirable since they reduce quality of service, whereas the latter are a potential safety concern. A stringent constraint is therefore placed on the maximum permitted probability of false negatives. Since this requirement may not be achievable using a single classifier, one approach is to (logically) OR the outputs of multiple disparate classifiers together, setting the final output to hazard if any of the classifiers indicates hazard. This reduces the probability of false negatives; however, the trade-off is an inevitably increase in the probability of false positives and an increase in the overall execution time required. In this paper, we provide optimal algorithms for the scheduling of classifiers that minimize the probability of false positives, while meeting both a latency constraint and a constraint on the maximum acceptable probability of false negatives. The classifiers may have arbitrary statistical dependences between their functional behaviors (probabilities of correct identification of hazards), as well as variability in their execution times, characterized by typical and worst-case values.
KW - Classifiers
KW - DNN
KW - Optimal Ordering
KW - Real-Time
KW - arbitrary dependences
UR - http://www.scopus.com/inward/record.url?scp=85161226016&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85161226016&partnerID=8YFLogxK
U2 - 10.1145/3575757.3593649
DO - 10.1145/3575757.3593649
M3 - Conference contribution
AN - SCOPUS:85161226016
T3 - ACM International Conference Proceeding Series
SP - 143
EP - 154
BT - Proceedings of 31st International Conference on Real-Time Networks and Systems, RTNS 2023
PB - Association for Computing Machinery
T2 - 31st International Conference on Real-Time Networks and Systems, RTNS 2023
Y2 - 7 June 2023 through 8 June 2023
ER -