Skip to menu Skip to content Skip to footer

2024

Journal Article

Cognitive biases in fact-checking and their countermeasures: a review

Soprano, Michael, Roitero, Kevin, La Barbera, David, Ceolin, Davide, Spina, Damiano, Demartini, Gianluca and Mizzaro, Stefano (2024). Cognitive biases in fact-checking and their countermeasures: a review. Information Processing and Management, 61 (3) 103672. doi: 10.1016/j.ipm.2024.103672

Cognitive biases in fact-checking and their countermeasures: a review

2024

Conference Publication

CoLAL: Co-learning active learning for text classification

Le, Linh, Zhao, Genghong, Zhang, Xia, Zuccon, Guido and Demartini, Gianluca (2024). CoLAL: Co-learning active learning for text classification. Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, BC Canada, 20–27 February 2024. Washington, DC United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v38i12.29235

CoLAL: Co-learning active learning for text classification

2024

Journal Article

Who determines what is relevant? Humans or AI? Why not both? : A spectrum of human–AI collaboration in assessing relevance

Faggioli, Guglielmo, Dietz, Laura, Clarke, Charles, Demartini, Gianluca, Hagen, Matthias, Hauff, Claudia, Kando, Noriko, Kanoulas, Evangelos, Potthast, Martin, Stein, Benno and Wachsmuth, Henning (2024). Who determines what is relevant? Humans or AI? Why not both? : A spectrum of human–AI collaboration in assessing relevance. Communications of the ACM, 67 (4), 31-34. doi: 10.1145/3624730

Who determines what is relevant? Humans or AI? Why not both? : A spectrum of human–AI collaboration in assessing relevance

2023

Journal Article

Data bias management

Demartini, Gianluca, Roitero, Kevin and Mizzaro, Stefano (2023). Data bias management. Communications of the ACM, 67 (1), 28-32. doi: 10.1145/3611641

Data bias management

2023

Journal Article

Human-AI cooperation to tackle misinformation and polarization

Spina, Damiano, Sanderson, Mark, Angus, Daniel, Demartini, Gianluca, Mckay, Dana, Saling, Lauren L. and White, Ryen W. (2023). Human-AI cooperation to tackle misinformation and polarization. Communications of the ACM, 66 (7), 40-45. doi: 10.1145/3588431

Human-AI cooperation to tackle misinformation and polarization

2022

Conference Publication

Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments

Roitero, Kevin, Checco, Alessandro, Mizzaro, Stefano and Demartini, Gianluca (2022). Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments. ACM Web Conference, Virtual/Lyon, France, 25-29 April 2022. New York, United States: Association for Computing Machinery. doi: 10.1145/3485447.3511960

Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments

2020

Journal Article

CrowdCO-OP: sharing risks and rewards in crowdsourcing

Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203

CrowdCO-OP: sharing risks and rewards in crowdsourcing

2020

Conference Publication

Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background

Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112

Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background

2020

Conference Publication

On understanding data worker interaction behaviors

Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401059

On understanding data worker interaction behaviors

2020

Journal Article

Adversarial attacks on crowdsourcing quality control

Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332

Adversarial attacks on crowdsourcing quality control

2019

Conference Publication

Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data

Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599

Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data

2015

Conference Publication

The dynamics of micro-task crowdsourcing: the case of amazon MTurk

Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685

The dynamics of micro-task crowdsourcing: the case of amazon MTurk

2015

Conference Publication

Understanding malicious behavior in crowdsourcing platforms: the case of online surveys

Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443

Understanding malicious behavior in crowdsourcing platforms: the case of online surveys

2026

Conference Publication

APD: Ad persuasion dashboard — Insights into Facebook political campaign strategies

Meguellati, Elyas, Civelli, Stefano, Sadiq, Shazia and Demartini, Gianluca (2026). APD: Ad persuasion dashboard — Insights into Facebook political campaign strategies. Twentieth International AAAI Conference on Web and Social Media, Los Angeles, CA, United States, 27-29 May 2026. Washington, DC, United States: Association for the Advancement of Artificial Intelligence (AAAI). doi: 10.1609/icwsm.v20i1.42807

APD: Ad persuasion dashboard — Insights into Facebook political campaign strategies

2026

Conference Publication

18th ACM Web Science Conference 2026: Celebrating 20 Years of Web Science

Balke, Wolf-Tilo, Plötzky, Florian, Demartini, Gianluca, Dietze, Stefan, Golbeck, Jennifer, Kaiser, Sierra and Rezapour, Rezvaneh (2026). 18th ACM Web Science Conference 2026: Celebrating 20 Years of Web Science. Association for Computing Machinery, Inc. doi: 10.1145/3795766

18th ACM Web Science Conference 2026: Celebrating 20 Years of Web Science

2026

Conference Publication

Towards detecting persuasion on social media: from model development to insights on persuasion strategies

Meguellati, Elyas, Civelli, Stefano, Bernardelle, Pietro, Sadiq, Shazia, King, Irwin and Demartini, Gianluca (2026). Towards detecting persuasion on social media: from model development to insights on persuasion strategies. Twentieth International AAAI Conference on Web and Social Media, Los Angeles, CA, United States, 27-29 May 2026. Washington, DC, United States: Association for the Advancement of Artificial Intelligence (AAAI). doi: 10.1609/icwsm.v20i1.42714

Towards detecting persuasion on social media: from model development to insights on persuasion strategies

2026

Conference Publication

Political advertising on Facebook During the 2022 Australian federal election: a social identity perspective

Civelli, Stefano, Bernardelle, Pietro, Mols, Frank and Demartini, Gianluca (2026). Political advertising on Facebook During the 2022 Australian federal election: a social identity perspective. Twentieth International AAAI Conference on Web and Social Media, Los Angeles, CA United States, 27-29 May 2026. Washington, DC United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/icwsm.v20i1.42654

Political advertising on Facebook During the 2022 Australian federal election: a social identity perspective

2026

Conference Publication

SubData: Bridging Heterogeneous Datasets to Enable Theory-Driven Evaluation of Political and Demographic Perspectives in LLMs

Bernardelle, Pietro, Froehling, Leon, Civelli, Stefano and Demartini, Gianluca (2026). SubData: Bridging Heterogeneous Datasets to Enable Theory-Driven Evaluation of Political and Demographic Perspectives in LLMs. European Language Resources Association (ELRA). doi: 10.63317/2uppkbro3uvq

SubData: Bridging Heterogeneous Datasets to Enable Theory-Driven Evaluation of Political and Demographic Perspectives in LLMs

2026

Journal Article

Ideology-Based LLMs for Content Moderation

Civelli, Stefano, Bernardelle, Pietro, Pratama, Nardiena A. and Demartini, Gianluca (2026). Ideology-Based LLMs for Content Moderation. ACM Transactions on Intelligent Systems and Technology 3810946. doi: 10.1145/3810946

Ideology-Based LLMs for Content Moderation

2026

Conference Publication

Large language models as assessors: on the impact of relevance scales

Zamolo, Riccardo, Lunardi, Riccardo, Soprano, Michael, Demartini, Gianluca, Mizzaro, Stefano and Roitero, Kevin (2026). Large language models as assessors: on the impact of relevance scales. 48th European Conference on Information Retrieval, Delft, The Netherlands, 29 March-2 April 2026. Cham, Switzerland: Springer Cham. doi: 10.1007/978-3-032-21300-6_24

Large language models as assessors: on the impact of relevance scales