Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access

Marie Josepha Youssef; Venugopal V. Veeravalli; Joumana Farah; Charbel Abdel Nour

doi:10.1109/PIMRC48278.2020.9217349

Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access

Marie Josepha Youssef, Venugopal V. Veeravalli, Joumana Farah, Charbel Abdel Nour

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, an algorithm based on the multi-player multi-armed bandit (MAB) framework is proposed to solve an uncoordinated spectrum access problem. The proposed technique does not require any communication or coordination between users. The case of varying channel rewards across users is considered. In contrast to previous work, the users are permitted to choose multiple channels for transmission, resulting in a MAB model with multiple plays. The proposed algorithm has an expected regret of the order O(log2T), which is validated by simulation results.

Original language	English (US)
Title of host publication	2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728144900
DOIs	https://doi.org/10.1109/PIMRC48278.2020.9217349
State	Published - Aug 2020
Event	31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020 - Virtual, London, United Kingdom Duration: Aug 31 2020 → Sep 3 2020

Publication series

Name	IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
Volume	2020-August

Conference

Conference	31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020
Country/Territory	United Kingdom
City	Virtual, London
Period	8/31/20 → 9/3/20

Keywords

Multi-armed bandits with multiple plays
Uncoordinated spectrum access
Varying reward distribution

ASJC Scopus subject areas

Electrical and Electronic Engineering

Online availability

10.1109/PIMRC48278.2020.9217349

Library availability

Discover UIUC Full Text

Cite this

Youssef, M. J., Veeravalli, V. V., Farah, J., & Nour, C. A. (2020). Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access. In 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020 Article 9217349 (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC; Vol. 2020-August). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PIMRC48278.2020.9217349

Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access. / Youssef, Marie Josepha; Veeravalli, Venugopal V.; Farah, Joumana et al.
2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. 9217349 (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC; Vol. 2020-August).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Youssef, MJ, Veeravalli, VV, Farah, J & Nour, CA 2020, Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access. in 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020., 9217349, IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC, vol. 2020-August, Institute of Electrical and Electronics Engineers Inc., 31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020, Virtual, London, United Kingdom, 8/31/20. https://doi.org/10.1109/PIMRC48278.2020.9217349

Youssef MJ, Veeravalli VV, Farah J, Nour CA. Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access. In 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9217349. (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC). doi: 10.1109/PIMRC48278.2020.9217349

Youssef, Marie Josepha ; Veeravalli, Venugopal V. ; Farah, Joumana et al. / Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access. 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. (IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC).

@inproceedings{3269f5494b8542c1b30bcc2facb6cdc4,

title = "Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access",

abstract = "In this paper, an algorithm based on the multi-player multi-armed bandit (MAB) framework is proposed to solve an uncoordinated spectrum access problem. The proposed technique does not require any communication or coordination between users. The case of varying channel rewards across users is considered. In contrast to previous work, the users are permitted to choose multiple channels for transmission, resulting in a MAB model with multiple plays. The proposed algorithm has an expected regret of the order O(log2T), which is validated by simulation results.",

keywords = "Multi-armed bandits with multiple plays, Uncoordinated spectrum access, Varying reward distribution",

author = "Youssef, {Marie Josepha} and Veeravalli, {Venugopal V.} and Joumana Farah and Nour, {Charbel Abdel}",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020 ; Conference date: 31-08-2020 Through 03-09-2020",

year = "2020",

month = aug,

doi = "10.1109/PIMRC48278.2020.9217349",

language = "English (US)",

series = "IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020",

address = "United States",

}

TY - GEN

T1 - Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access

AU - Youssef, Marie Josepha

AU - Veeravalli, Venugopal V.

AU - Farah, Joumana

AU - Nour, Charbel Abdel

PY - 2020/8

Y1 - 2020/8

N2 - In this paper, an algorithm based on the multi-player multi-armed bandit (MAB) framework is proposed to solve an uncoordinated spectrum access problem. The proposed technique does not require any communication or coordination between users. The case of varying channel rewards across users is considered. In contrast to previous work, the users are permitted to choose multiple channels for transmission, resulting in a MAB model with multiple plays. The proposed algorithm has an expected regret of the order O(log2T), which is validated by simulation results.

AB - In this paper, an algorithm based on the multi-player multi-armed bandit (MAB) framework is proposed to solve an uncoordinated spectrum access problem. The proposed technique does not require any communication or coordination between users. The case of varying channel rewards across users is considered. In contrast to previous work, the users are permitted to choose multiple channels for transmission, resulting in a MAB model with multiple plays. The proposed algorithm has an expected regret of the order O(log2T), which is validated by simulation results.

KW - Multi-armed bandits with multiple plays

KW - Uncoordinated spectrum access

KW - Varying reward distribution

UR - http://www.scopus.com/inward/record.url?scp=85094098254&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85094098254&partnerID=8YFLogxK

U2 - 10.1109/PIMRC48278.2020.9217349

DO - 10.1109/PIMRC48278.2020.9217349

M3 - Conference contribution

AN - SCOPUS:85094098254

T3 - IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC

BT - 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 31st IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2020

Y2 - 31 August 2020 through 3 September 2020

ER -

Stochastic multi-player multi-armed bandits with multiple plays for uncoordinated spectrum access

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this