Skip to menu Skip to content Skip to footer

Featured

2024

Journal Article

Cognitive biases in fact-checking and their countermeasures: a review

Soprano, Michael, Roitero, Kevin, La Barbera, David, Ceolin, Davide, Spina, Damiano, Demartini, Gianluca and Mizzaro, Stefano (2024). Cognitive biases in fact-checking and their countermeasures: a review. Information Processing and Management, 61 (3) 103672. doi: 10.1016/j.ipm.2024.103672

Cognitive biases in fact-checking and their countermeasures: a review

Featured

2024

Conference Publication

CoLAL: Co-learning active learning for text classification

Le, Linh, Zhao, Genghong, Zhang, Xia, Zuccon, Guido and Demartini, Gianluca (2024). CoLAL: Co-learning active learning for text classification. Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, BC Canada, 20–27 February 2024. Washington, DC United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v38i12.29235

CoLAL: Co-learning active learning for text classification

Featured

2024

Journal Article

Who Determines What Is Relevant? Humans or AI? Why Not Both? : A spectrum of human–AI collaboration in assessing relevance

Faggioli, Guglielmo, Dietz, Laura, Clarke, Charles, Demartini, Gianluca, Hagen, Matthias, Hauff, Claudia, Kando, Noriko, Kanoulas, Evangelos, Potthast, Martin, Stein, Benno and Wachsmuth, Henning (2024). Who Determines What Is Relevant? Humans or AI? Why Not Both? : A spectrum of human–AI collaboration in assessing relevance. Communications of the ACM, 67 (4), 31-34. doi: 10.1145/3624730

Who Determines What Is Relevant? Humans or AI? Why Not Both? : A spectrum of human–AI collaboration in assessing relevance

Featured

2023

Journal Article

Data bias management

Demartini, Gianluca, Roitero, Kevin and Mizzaro, Stefano (2023). Data bias management. Communications of the ACM, 67 (1), 28-32. doi: 10.1145/3611641

Data bias management

Featured

2023

Journal Article

Human-AI cooperation to tackle misinformation and polarization

Spina, Damiano, Sanderson, Mark, Angus, Daniel, Demartini, Gianluca, Mckay, Dana, Saling, Lauren L. and White, Ryen W. (2023). Human-AI cooperation to tackle misinformation and polarization. Communications of the ACM, 66 (7), 40-45. doi: 10.1145/3588431

Human-AI cooperation to tackle misinformation and polarization

Featured

2022

Conference Publication

Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments

Roitero, Kevin, Checco, Alessandro, Mizzaro, Stefano and Demartini, Gianluca (2022). Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments. ACM Web Conference, Virtual/Lyon, France, 25-29 April 2022. New York, United States: Association for Computing Machinery. doi: 10.1145/3485447.3511960

Preferences on a budget: prioritizing document pairs when crowdsourcing relevance judgments

Featured

2020

Journal Article

CrowdCO-OP: sharing risks and rewards in crowdsourcing

Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203

CrowdCO-OP: sharing risks and rewards in crowdsourcing

Featured

2020

Conference Publication

Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background

Roitero, Kevin, Soprano, Michael, Fan, Shaoyang, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2020). Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background. International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25-30 July 2020. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401112

Can the crowd identify misinformation objectively?: The effects of judgment scale and assessor's background

Featured

2020

Conference Publication

On understanding data worker interaction behaviors

Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2020). On understanding data worker interaction behaviors. SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval, Virtual Event China, July 2020. New York, United States: Association for Computing Machinery. doi: 10.1145/3397271.3401059

On understanding data worker interaction behaviors

Featured

2020

Journal Article

Adversarial attacks on crowdsourcing quality control

Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332

Adversarial attacks on crowdsourcing quality control

Featured

2019

Conference Publication

Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data

Yang, Jie, Demartini, Gianluca, Smirnova, Alisa, Lu, Yuan, Yang, Dingqi and Cudré-Mauroux, Philippe (2019). Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data. World Wide Web Conference (WWW), San Francisco, CA, United States, 13-17 May 2019. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/3308558.3313599

Scalpel-CD: leveraging crowdsourcing and deep probabilistic modeling for debugging noisy training data

Featured

2015

Conference Publication

Understanding malicious behavior in crowdsourcing platforms: the case of online surveys

Gadiraju, Ujwal, Kawase, Ricardo, Dietze, Stefan and Demartini, Gianluca (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. 33rd Annual CHI Conference on Human Factors in Computing Systems - CHI'15, Seoul, South Korea, 18 - 23 April 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2702123.2702443

Understanding malicious behavior in crowdsourcing platforms: the case of online surveys

Featured

2015

Conference Publication

The dynamics of micro-task crowdsourcing: the case of amazon MTurk

Difallah, Djellel Eddine, Catasta, Michele, Demartini, Gianluca, Ipeirotis, Panagiotis G. and Cudré-Mauroux, Philippe (2015). The dynamics of micro-task crowdsourcing: the case of amazon MTurk. 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, 18 - 22 May 2015. New York, NY, United States: Association for Computing Machinery. doi: 10.1145/2736277.2741685

The dynamics of micro-task crowdsourcing: the case of amazon MTurk

2024

Conference Publication

Optimizing LLMs with direct preferences: a data efficiency perspective

Bernardelle, Pietro and Demartini, Gianluca (2024). Optimizing LLMs with direct preferences: a data efficiency perspective. SIGIR-AP 2024: 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, Tokyo, Japan, 9-12 December 2024. New York, NY, United States: ACM. doi: 10.1145/3673791.3698411

Optimizing LLMs with direct preferences: a data efficiency perspective

2024

Conference Publication

Influence of metadata on quality evaluation of unstructured information artefacts

Zhou, Hui, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2024). Influence of metadata on quality evaluation of unstructured information artefacts. The Australasian Conference on Information Systems (ACIS 2024), Canberra, ACT Australia, 4-6 December, 2024. AIS Electronic Library.

Influence of metadata on quality evaluation of unstructured information artefacts

2024

Other Outputs

Multimodal Entity Linking Evaluation Dataset for Art (Version 3.0)

Demartini, Gianluca, Le, Thai Linh, Krestel, Ralf and Sierra, Alejandro (2024). Multimodal Entity Linking Evaluation Dataset for Art (Version 3.0). The University of Queensland. (Dataset) doi: 10.48610/8a1ccdf

Multimodal Entity Linking Evaluation Dataset for Art (Version 3.0)

2024

Journal Article

Crowdsourced Fact-checking: Does It Actually Work?

Barbera, David La, Maddalena, Eddy, Soprano, Michael, Roitero, Kevin, Demartini, Gianluca, Ceolin, Davide, Spina, Damiano and Mizzaro, Stefano (2024). Crowdsourced Fact-checking: Does It Actually Work?. Information Processing & Management, 61 (5) 103792, 103792. doi: 10.1016/j.ipm.2024.103792

Crowdsourced Fact-checking: Does It Actually Work?

2024

Conference Publication

Hate speech detection with generalizable target-aware fairness

Chen, Tong, Wang, Danny, Liang, Xurong, Risius, Marten, Demartini, Gianluca and Yin, Hongzhi (2024). Hate speech detection with generalizable target-aware fairness. KDD '24: 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain, 25-29 August 2024. New York, NY, United States: ACM. doi: 10.1145/3637528.3671821

Hate speech detection with generalizable target-aware fairness

2024

Journal Article

Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms

Soprano, Michael, Roitero, Kevin, Gadiraju, Ujwal, Maddalena, Eddy and Demartini, Gianluca (2024). Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms. ACM Transactions on Social Computing, 7 (1-4), 1-49. doi: 10.1145/3674884

Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms

2024

Journal Article

Human-AI cooperation to tackle misinformation and polarization

Spina, Damiano, Sanderson, Mark, Angus, Daniel, Demartini, Gianluca, McKay, Dana, Saling, Lauren L. and White, Ryen W. (2024). Human-AI cooperation to tackle misinformation and polarization. Communications of the ACM, 67 (7), 40-45. doi: 10.1145/3588431

Human-AI cooperation to tackle misinformation and polarization