publications

2023

1. IEEE Access

   Fairness-Aware Multimodal Learning in Automatic Video Interview Assessment

   Changwoo Kim ,  Jinho Choi ,  Jongyeon Yoon , and 2 more authors

   IEEE Access, 2023

   Abs Bib HTML PDF

   With the ever-growing reliance on Artificial Intelligence (AI) across diverse domains, there is an increasing concern surrounding the possibility of biases and unfairness inherent in AI systems. Fairness problems in automatic interview assessment systems, especially video-based automated interview assessments, have less been addressed despite their prevalence in the recruiting field. In this paper, we propose a method that resolves fairness problems in an automated interview assessment system that uses multimodal data as input. This is mainly done by minimizing the Wasserstein distance between two sensitive groups by introducing a regularization term. Subsequently, we employ a hyperparameter that can control the trade-off between fairness and accuracy. To test our method in various data settings, we suggest a preprocessing method that can manually adjust the underlying degree of unfairness in the training data. Experimental results show that our method presents state-of-the-art results in terms of fairness compared to previous methods.

   @article{10287972,
     url = {https://ieeexplore.ieee.org/abstract/document/10287972},
     author = {Kim, Changwoo and Choi, Jinho and Yoon, Jongyeon and Yoo, Daehun and Lee, Woojin},
     journal = {IEEE Access},
     title = {Fairness-Aware Multimodal Learning in Automatic Video Interview Assessment},
     year = {2023},
     volume = {11},
     number = {},
     pages = {122677-122693},
     keywords = {Interviews;Recruitment;Predictive models;Training data;Machine learning algorithms;Data models;Prediction algorithms;Automatic interview assessment;multimodal;fairness;sensitive attribute;unfair assumption;Wasserstein distance;adversarial;representation learning},
     doi = {10.1109/ACCESS.2023.3325891}
   }