Gao, GePaik, SejinReardon, CarleyZhao, YanlingGuo, LeiIshwar, P.Betke, MargritWijaya, D.2023-03-282023-03-282022-11-01G. Gao, S. Paik, C. Reardon, Y. Zhao, L. Guo, P. Ishwar, M. Betke, D. Wijaya. 2022. "Prediction of People’s Emotional Response towards Multi-modal News" Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp.364-374.https://hdl.handle.net/2144/45971We aim to develop methods for understanding how multimedia news exposure can affect people’s emotional responses, and we especially focus on news content related to gun violence, a very important yet polarizing issue in the U.S. We created the dataset NEmo+ by significantly extending the U.S. gun violence news-to-emotions dataset, BU-NEmo, from 320 to 1,297 news headline and lead image pairings and collecting 38,910 annotations in a large crowdsourcing experiment. In curating the NEmo+ dataset, we developed methods to identify news items that will trigger similar versus divergent emotional responses. For news items that trigger similar emotional responses, we compiled them into the NEmo+-Consensus dataset. We benchmark models on this dataset that predict a person’s dominant emotional response toward the target news item (single-label prediction). On the full NEmo+ dataset, containing news items that would lead to both differing and similar emotional responses, we also benchmark models for the novel task of predicting the distribution of evoked emotional responses in humans when presented with multi-modal news content. Our single-label and multi-label prediction models outperform baselines by large margins across several metrics.p. 364-374en-US©2022 Association for Computational Linguistics. The ACL materials that are hosted in the Anthology are licensed to the general public under a liberal usage policy that allows unlimited reproduction, distribution and hosting of materials on any other website or medium, for non-commercial purposes. All subsequent materials are available to the general public on the terms of the Creative Commons 4.0 BY (Attribution) license (https://aclanthology.org/faq/).https://creativecommons.org/licenses/by/4.0/Conference materials2023-01-190000-0002-4491-6868 (Betke, Margrit)781229