TY - JOUR
T1 - Learning Fair Policies for Multi-Stage Selection Problems from Observational Data
AU - Jia, Zhuangzhuang
AU - Hanasusanto, Grani A.
AU - Vayanos, Phebe
AU - Xie, Weijun
N1 - Z. Jia and G. Hanasusanto are funded in part by the National Science Foundation under grants 2342505 and 2343869. P. Vayanos is funded in part by the National Science Foundation under grant 2046230. W. Xie is funded in part by the National Science Foundation under grants 2246414 and 2246417. They thank the four anonymous referees whose reviews helped substantially improve the quality of the paper.
PY - 2024/3/25
Y1 - 2024/3/25
N2 - We consider the problem of learning fair policies for multistage selection problems from observational data. This problem arises in several high-stakes domains such as company hiring, loan approval, or bail decisions where outcomes (e.g., career success, loan repayment, recidivism) are only observed for those selected. We propose a multi-stage framework that can be augmented with various fairness constraints, such as demographic parity or equal opportunity. This problem is a highly intractable infinite chance-constrained program involving the unknown joint distribution of covariates and outcomes. Motivated by the potential impact of selection decisions on people's lives and livelihoods, we propose to focus on interpretable linear selection rules. Leveraging tools from causal inference and sample average approximation, we obtain an asymptotically consistent solution to this selection problem by solving a mixed binary conic optimization problem, which can be solved using standard off-the-shelf solvers. We conduct extensive computational experiments on a variety of datasets adapted from the UCI repository on which we show that our proposed approaches can achieve an 11.6% improvement in precision and a 38% reduction in the measure of unfairness compared to the existing selection policy.
AB - We consider the problem of learning fair policies for multistage selection problems from observational data. This problem arises in several high-stakes domains such as company hiring, loan approval, or bail decisions where outcomes (e.g., career success, loan repayment, recidivism) are only observed for those selected. We propose a multi-stage framework that can be augmented with various fairness constraints, such as demographic parity or equal opportunity. This problem is a highly intractable infinite chance-constrained program involving the unknown joint distribution of covariates and outcomes. Motivated by the potential impact of selection decisions on people's lives and livelihoods, we propose to focus on interpretable linear selection rules. Leveraging tools from causal inference and sample average approximation, we obtain an asymptotically consistent solution to this selection problem by solving a mixed binary conic optimization problem, which can be solved using standard off-the-shelf solvers. We conduct extensive computational experiments on a variety of datasets adapted from the UCI repository on which we show that our proposed approaches can achieve an 11.6% improvement in precision and a 38% reduction in the measure of unfairness compared to the existing selection policy.
UR - http://www.scopus.com/inward/record.url?scp=85189638906&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85189638906&partnerID=8YFLogxK
U2 - 10.1609/aaai.v38i19.30112
DO - 10.1609/aaai.v38i19.30112
M3 - Conference article
AN - SCOPUS:85189638906
SN - 2159-5399
VL - 38
SP - 21188
EP - 21196
JO - Proceedings of the AAAI Conference on Artificial Intelligence
JF - Proceedings of the AAAI Conference on Artificial Intelligence
IS - 19
T2 - 38th AAAI Conference on Artificial Intelligence, AAAI 2024
Y2 - 20 February 2024 through 27 February 2024
ER -