TY - GEN
T1 - Fictitious play with time-invariant frequency update for network security
AU - Nguyen, Kien C.
AU - Alpcan, Tansu
AU - Başar, Tamer
PY - 2010
Y1 - 2010
N2 - We study two-player security games which can be viewed as sequences of nonzero-sum matrix games played by an Attacker and a Defender. The evolution of the game is based on a stochastic fictitious play process, where players do not have access to each other's payoff matrix. Each has to observe the other's actions up to present and plays the action generated based on the best response to these observations. In a regular fictitious play process, each player makes a maximum likelihood estimate of her opponent's mixed strategy, which results in a time-varying update based on the previous estimate and current action. In this paper, we explore an alternative scheme for frequency update, whose mean dynamic is instead time-invariant. We examine convergence properties of the mean dynamic of the fictitious play process with such an update scheme, and establish local stability of the equilibrium point when both players are restricted to two actions. We also propose an adaptive algorithm based on this time-invariant frequency update.
AB - We study two-player security games which can be viewed as sequences of nonzero-sum matrix games played by an Attacker and a Defender. The evolution of the game is based on a stochastic fictitious play process, where players do not have access to each other's payoff matrix. Each has to observe the other's actions up to present and plays the action generated based on the best response to these observations. In a regular fictitious play process, each player makes a maximum likelihood estimate of her opponent's mixed strategy, which results in a time-varying update based on the previous estimate and current action. In this paper, we explore an alternative scheme for frequency update, whose mean dynamic is instead time-invariant. We examine convergence properties of the mean dynamic of the fictitious play process with such an update scheme, and establish local stability of the equilibrium point when both players are restricted to two actions. We also propose an adaptive algorithm based on this time-invariant frequency update.
UR - http://www.scopus.com/inward/record.url?scp=78649433065&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78649433065&partnerID=8YFLogxK
U2 - 10.1109/CCA.2010.5611248
DO - 10.1109/CCA.2010.5611248
M3 - Conference contribution
AN - SCOPUS:78649433065
SN - 9781424453627
T3 - Proceedings of the IEEE International Conference on Control Applications
SP - 65
EP - 70
BT - 2010 IEEE International Conference on Control Applications, CCA 2010
PB - Institute of Electrical and Electronics Engineers Inc.
ER -