Skip to menu Skip to content Skip to footer

2024

Journal Article

How many crowd workers do I need? On statistical power when crowdsourcing relevance judgments

Roitero, Kevin, Barbera, David La, Soprano, Michael, Demartini, Gianluca, Mizzaro, Stefano and Sakai, Tetsuya (2024). How many crowd workers do I need? On statistical power when crowdsourcing relevance judgments. ACM Transactions on Information Systems, 42 (1) 21, 1-26. doi: 10.1145/3597201

How many crowd workers do I need? On statistical power when crowdsourcing relevance judgments

2023

Journal Article

Active learning with feature matching for clinical named entity recognition

Le, Linh, Demartini, Gianluca, Zuccon, Guido, Zhao, Genghong and Zhang, Xia (2023). Active learning with feature matching for clinical named entity recognition. Natural Language Processing Journal, 4 100015, 1-11. doi: 10.1016/j.nlp.2023.100015

Active learning with feature matching for clinical named entity recognition

2023

Journal Article

A data-driven analysis of behaviors in data curation processes

Han, Lei, Chen, Tianwa, Demartini, Gianluca, Indulska, Marta and Sadiq, Shazia (2023). A data-driven analysis of behaviors in data curation processes. ACM Transactions on Information Systems, 41 (3) 72, 1-35. doi: 10.1145/3567419

A data-driven analysis of behaviors in data curation processes

2023

Journal Article

DataOps-4G: on supporting generalists in data quality discovery

Yu, Shaochen, Chen, Tianwa, Han, Lei, Demartini, Gianluca and Sadiq, Shazia (2023). DataOps-4G: on supporting generalists in data quality discovery. IEEE Transactions on Knowledge and Data Engineering, 35 (5), 4668-4681. doi: 10.1109/tkde.2022.3151605

DataOps-4G: on supporting generalists in data quality discovery

2023

Journal Article

On the role of human and machine metadata in relevance judgment tasks

Xu, Jiechen, Han, Lei, Sadiq, Shazia and Demartini, Gianluca (2023). On the role of human and machine metadata in relevance judgment tasks. Information Processing and Management, 60 (2) 103177, 1-14. doi: 10.1016/j.ipm.2022.103177

On the role of human and machine metadata in relevance judgment tasks

2022

Journal Article

Combining human and machine confidence in truthfulness assessment

Qu, Yunke, Barbera, David La, Roitero, Kevin, Mizzaro, Stefano, Spina, Damiano and Demartini, Gianluca (2022). Combining human and machine confidence in truthfulness assessment. Journal of Data and Information Quality, 15 (1) 5, 1-17. doi: 10.1145/3546916

Combining human and machine confidence in truthfulness assessment

2022

Journal Article

Task design in complex crowdsourcing experiments: Item assignment optimization

Ceschia, Sara, Roitero, Kevin, Demartini, Gianluca, Mizzaro, Stefano, Di Gaspero, Luca and Schaerf, Andrea (2022). Task design in complex crowdsourcing experiments: Item assignment optimization. Computers and Operations Research, 148 105995, 1-13. doi: 10.1016/j.cor.2022.105995

Task design in complex crowdsourcing experiments: Item assignment optimization

2022

Journal Article

Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

Demartini, Gianluca, Yang, Jie and Sadiq, Shazia (2022). Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022. ACM SIGIR Forum, 56 (2), 1-8. doi: 10.1145/3582900.3582921

Report on the 1st Workshop on Human-in-the-Loop Data Curation (HIL-DC 2022) at CIKM 2022

2022

Journal Article

Analytics of learning tactics and strategies in an online learnersourcing environment

Lahza, Hatim, Khosravi, Hassan and Demartini, Gianluca (2022). Analytics of learning tactics and strategies in an online learnersourcing environment. Journal of Computer Assisted Learning, 39 (1), 94-112. doi: 10.1111/jcal.12729

Analytics of learning tactics and strategies in an online learnersourcing environment

2022

Journal Article

A neural model to jointly predict and explain truthfulness of statements

Brand, Erik, Roitero, Kevin, Soprano, Michael, Rahimi, Afshin and Demartini, Gianluca (2022). A neural model to jointly predict and explain truthfulness of statements. Journal of Data and Information Quality, 15 (1) 4, 1-19. doi: 10.1145/3546917

A neural model to jointly predict and explain truthfulness of statements

2022

Journal Article

Information resilience: the nexus of responsible and agile approaches to information use

Sadiq, Shazia, Aryani, Amir, Demartini, Gianluca, Hua, Wen, Indulska, Marta, Burton-Jones, Andrew, Khosravi, Hassan, Benavides-Prado, Diana, Sellis, Timos, Someh, Ida, Vaithianathan, Rhema, Wang, Sen and Zhou, Xiaofang (2022). Information resilience: the nexus of responsible and agile approaches to information use. The VLDB Journal, 31 (5), 1059-1084. doi: 10.1007/s00778-021-00720-2

Information resilience: the nexus of responsible and agile approaches to information use

2021

Journal Article

The many dimensions of truthfulness: crowdsourcing misinformation assessments on a multidimensional scale

Soprano, Michael, Roitero, Kevin, La Barbera, David, Ceolin, Davide, Spina, Damiano, Mizzaro, Stefano and Demartini, Gianluca (2021). The many dimensions of truthfulness: crowdsourcing misinformation assessments on a multidimensional scale. Information Processing and Management, 58 (6) 102710, 1-22. doi: 10.1016/j.ipm.2021.102710

The many dimensions of truthfulness: crowdsourcing misinformation assessments on a multidimensional scale

2021

Journal Article

On the state of reporting in crowdsourcing experiments and a checklist to aid current practices

Ramírez, Jorge, Sayin, Burcu, Baez, Marcos, Casati, Fabio, Cernuzzi, Luca, Benatallah, Boualem and Demartini, Gianluca (2021). On the state of reporting in crowdsourcing experiments and a checklist to aid current practices. Proceedings of the ACM on Human-Computer Interaction, 5 (CSCW2) 387, 1-34. doi: 10.1145/3479531

On the state of reporting in crowdsourcing experiments and a checklist to aid current practices

2021

Journal Article

Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19

Roitero, Kevin, Soprano, Michael, Portelli, Beatrice, De Luise, Massimiliano, Spina, Damiano, Mea, Vincenzo Della, Serra, Giuseppe, Mizzaro, Stefano and Demartini, Gianluca (2021). Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19. Personal and Ubiquitous Computing, 27 (1), 1-31. doi: 10.1007/s00779-021-01604-6

Can the crowd judge truthfulness? A longitudinal study on recent misinformation about COVID-19

2021

Journal Article

Evaluating the quality of learning resources: a Learnersourcing approach

Abdi, Solmaz, Khosravi, Hassan, Sadiq, Shazia and Demartini, Gianluca (2021). Evaluating the quality of learning resources: a Learnersourcing approach. IEEE Transactions on Learning Technologies, 14 (1) 9353264, 81-92. doi: 10.1109/tlt.2021.3058644

Evaluating the quality of learning resources: a Learnersourcing approach

2020

Journal Article

Making AI Machines Work for Humans in FoW

Amer-Yahia, Sihem, Basu Roy, Senjuti, Chen, Lei, Morishima, Atsuyuki, Abello Monedero, James, Bourhis, Pierre, Charoy, François, Danilevsky, Marina, Das, Gautam, Demartini, Gianluca, Dubey, Abhishek, Elbassuoni, Shady, Gross-Amblard, David, Hoareau, Emilie, Inoguchi, Munenari, Kenworthy, Jared, Kitahara, Itaru, Lee, Dongwon, Li, Yunyao, Borromeo, Ria Mae, Papotti, Paolo, Rao, Raghav, Roy, Sudeepa, Senellart, Pierre, Tajima, Keishi, Thirumuruganathan, Saravanan, Tommasi, Marion, Umemoto, Kazutoshi, Wiggins, Andrea and Yoshida, Koichiro (2020). Making AI Machines Work for Humans in FoW. SIGMOD Record, 49 (2), 30-35. doi: 10.1145/3442322.3442327

Making AI Machines Work for Humans in FoW

2020

Journal Article

Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities

Demartini, Gianluca, Mizzaro, Stefano and Spina, Damiano (2020). Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities. The Bulletin of the Technical Committee on Data Engineering, 65-74.

Human-in-the-loop Artificial Intelligence for Fighting Online Misinformation: Challenges and Opportunities

2019

Journal Article

The evolution of power and standard wikidata editors: comparing editing behavior over time to predict lifespan and volume of edits

Sarasua, Cristina, Checco, Alessandro, Demartini, Gianluca, Difallah, Djellel, Feldman, Michael and Pintscher, Lydia (2019). The evolution of power and standard wikidata editors: comparing editing behavior over time to predict lifespan and volume of edits. Computer Supported Cooperative Work: CSCW: An International Journal, 28 (5), 843-882. doi: 10.1007/s10606-018-9344-y

The evolution of power and standard wikidata editors: comparing editing behavior over time to predict lifespan and volume of edits

2019

Journal Article

Health cards to assist decision making in consumer health search

Jimmy, , Zuccon, Guido, Demartini, Gianluca and Koopman, Bevan (2019). Health cards to assist decision making in consumer health search. AMIA Annual Symposium. Proceedings, 2019, 1091-1100.

Health cards to assist decision making in consumer health search

2019

Journal Article

Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data

Ahmed, Wasim, Bath, Peter A., Sbaffi, Laura and Demartini, Gianluca (2019). Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data. Health Information and Libraries Journal, 36 (1), 60-72. doi: 10.1111/hir.12247

Novel insights into views towards H1N1 during the 2009 Pandemic: a thematic analysis of Twitter data