Skip to menu Skip to content Skip to footer

2024

Journal Article

Cognitive Biases in Fact-Checking and Their Countermeasures: A Review

Soprano, Michael, Roitero, Kevin, La Barbera, David, Ceolin, Davide, Spina, Damiano, Demartini, Gianluca and Mizzaro, Stefano (2024). Cognitive Biases in Fact-Checking and Their Countermeasures: A Review. Information Processing & Management, 61 (3) 103672, 103672. doi: 10.1016/j.ipm.2024.103672

Cognitive Biases in Fact-Checking and Their Countermeasures: A Review

2024

Journal Article

Who Determines What Is Relevant? Humans or AI? Why Not Both? : A spectrum of human–AI collaboration in assessing relevance

Faggioli, Guglielmo, Dietz, Laura, Clarke, Charles, Demartini, Gianluca, Hagen, Matthias, Hauff, Claudia, Kando, Noriko, Kanoulas, Evangelos, Potthast, Martin, Stein, Benno and Wachsmuth, Henning (2024). Who Determines What Is Relevant? Humans or AI? Why Not Both? : A spectrum of human–AI collaboration in assessing relevance. Communications of the ACM, 67 (4), 31-34. doi: 10.1145/3624730

Who Determines What Is Relevant? Humans or AI? Why Not Both? : A spectrum of human–AI collaboration in assessing relevance

2023

Journal Article

Data bias management

Demartini, Gianluca, Roitero, Kevin and Mizzaro, Stefano (2023). Data bias management. Communications of the ACM, 67 (1), 28-32. doi: 10.1145/3611641

Data bias management

2023

Journal Article

Human-AI cooperation to tackle misinformation and polarization

Spina, Damiano, Sanderson, Mark, Angus, Daniel, Demartini, Gianluca, Mckay, Dana, Saling, Lauren L. and White, Ryen W. (2023). Human-AI cooperation to tackle misinformation and polarization. Communications of the ACM, 66 (7), 40-45. doi: 10.1145/3588431

Human-AI cooperation to tackle misinformation and polarization

2020

Journal Article

CrowdCO-OP: sharing risks and rewards in crowdsourcing

Fan, Shaoyang, Gadiraju, Ujwal, Checco, Alessandro and Demartini, Gianluca (2020). CrowdCO-OP: sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction, 4 (CSCW2) 132, 1-24. doi: 10.1145/3415203

CrowdCO-OP: sharing risks and rewards in crowdsourcing

2020

Journal Article

Adversarial attacks on crowdsourcing quality control

Checco, Alessandro, Bates, Jo and Demartini, Gianluca (2020). Adversarial attacks on crowdsourcing quality control. Journal of Artificial Intelligence Research, 67, 375-408. doi: 10.1613/jair.1.11332

Adversarial attacks on crowdsourcing quality control

2024

Journal Article

Crowdsourced Fact-checking: Does It Actually Work?

Barbera, David La, Maddalena, Eddy, Soprano, Michael, Roitero, Kevin, Demartini, Gianluca, Ceolin, Davide, Spina, Damiano and Mizzaro, Stefano (2024). Crowdsourced Fact-checking: Does It Actually Work?. Information Processing & Management, 61 (5) 103792, 103792. doi: 10.1016/j.ipm.2024.103792

Crowdsourced Fact-checking: Does It Actually Work?

2024

Journal Article

Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms

Soprano, Michael, Roitero, Kevin, Gadiraju, Ujwal, Maddalena, Eddy and Demartini, Gianluca (2024). Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms. ACM Transactions on Social Computing, 7 (1-4), 1-49. doi: 10.1145/3674884

Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms

2024

Journal Article

Human-AI cooperation to tackle misinformation and polarization

Spina, Damiano, Sanderson, Mark, Angus, Daniel, Demartini, Gianluca, McKay, Dana, Saling, Lauren L. and White, Ryen W. (2024). Human-AI cooperation to tackle misinformation and polarization. Communications of the ACM, 67 (7), 40-45. doi: 10.1145/3588431

Human-AI cooperation to tackle misinformation and polarization

2024

Journal Article

Editorial: Special Issue on Human in the Loop Data Curation

Demartini, Gianluca, Sadiq, Shazia and Yang, Jie (2024). Editorial: Special Issue on Human in the Loop Data Curation. Journal of Data and Information Quality, 16 (1) 3, 1-2. doi: 10.1145/3650209

Editorial: Special Issue on Human in the Loop Data Curation

2024

Journal Article

On the impact of showing evidence from peers in crowdsourced truthfulness assessments

Xu, Jiechen, Han, Lei, Sadiq, Shazia and Demartini, Gianluca (2024). On the impact of showing evidence from peers in crowdsourced truthfulness assessments. ACM Transactions on Information Systems, 42 (3) 87, 1-26. doi: 10.1145/3637872

On the impact of showing evidence from peers in crowdsourced truthfulness assessments

2024

Journal Article

How many crowd workers do I need? On statistical power when crowdsourcing relevance judgments

Roitero, Kevin, Barbera, David La, Soprano, Michael, Demartini, Gianluca, Mizzaro, Stefano and Sakai, Tetsuya (2024). How many crowd workers do I need? On statistical power when crowdsourcing relevance judgments. ACM Transactions on Information Systems, 42 (1) 21, 1-26. doi: 10.1145/3597201

How many crowd workers do I need? On statistical power when crowdsourcing relevance judgments

2023

Journal Article

Active learning with feature matching for clinical named entity recognition

Le, Linh, Demartini, Gianluca, Zuccon, Guido, Zhao, Genghong and Zhang, Xia (2023). Active learning with feature matching for clinical named entity recognition. Natural Language Processing Journal, 4 100015, 1-11. doi: 10.1016/j.nlp.2023.100015

Active learning with feature matching for clinical named entity recognition

2023

Journal Article

A data-driven analysis of behaviors in data curation processes

Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2023). A data-driven analysis of behaviors in data curation processes. ACM Transactions on Information Systems, 41 (3) 72, 1-35. doi: 10.1145/3567419

A data-driven analysis of behaviors in data curation processes

2023

Journal Article

DataOps-4G: on supporting generalists in data quality discovery

Yu, Shaochen, Chen, Tianwa, Han, Lei, Demartini, Gianluca and Sadiq, Shazia (2023). DataOps-4G: on supporting generalists in data quality discovery. IEEE Transactions on Knowledge and Data Engineering, 35 (5), 4668-4681. doi: 10.1109/tkde.2022.3151605

DataOps-4G: on supporting generalists in data quality discovery

2023

Journal Article

On the role of human and machine metadata in relevance judgment tasks

Xu, Jiechen, Han, Lei, Sadiq, Shazia and Demartini, Gianluca (2023). On the role of human and machine metadata in relevance judgment tasks. Information Processing and Management, 60 (2) 103177, 1-14. doi: 10.1016/j.ipm.2022.103177

On the role of human and machine metadata in relevance judgment tasks

2022

Journal Article

Combining human and machine confidence in truthfulness assessment

Qu, Yunke, Barbera, David La, Roitero, Kevin, Mizzaro, Stefano, Spina, Damiano and Demartini, Gianluca (2022). Combining human and machine confidence in truthfulness assessment. Journal of Data and Information Quality, 15 (1) 5, 1-17. doi: 10.1145/3546916

Combining human and machine confidence in truthfulness assessment

2022

Journal Article

Task design in complex crowdsourcing experiments: Item assignment optimization

Ceschia, Sara, Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano, Di Gaspero, Luca and Schaerf, Andrea (2022). Task design in complex crowdsourcing experiments: Item assignment optimization. Computers and Operations Research, 148 105995, 1-13. doi: 10.1016/j.cor.2022.105995

Task design in complex crowdsourcing experiments: Item assignment optimization

2022

Journal Article

Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

Demartini, Gianluca, Yang, Jie and Sadiq, Shazia (2022). Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022. ACM SIGIR Forum, 56 (2), 1-8. doi: 10.1145/3582900.3582921

Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

2022

Journal Article

Analytics of learning tactics and strategies in an online learnersourcing environment

Lahza, Hatim, Khosravi, Hassan and Demartini, Gianluca (2022). Analytics of learning tactics and strategies in an online learnersourcing environment. Journal of Computer Assisted Learning, 39 (1), 94-112. doi: 10.1111/jcal.12729

Analytics of learning tactics and strategies in an online learnersourcing environment