Professional Service

This is a list of scientific events in whose organization I have been involved.

Seminars / Invited Talks

• “Your PhD and You”, Maastricht University, April 2024.
• “Your PhD and You”, Universitat Pompeu Fabra, Barcelona, June 2023.
• “Your PhD and You”, Student luncheon, ACM SIGIR, Madrid, July 2022. [video]
• “Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors”, 18th Dutch-Belgian Information Retrieval Workshop, November 2019.
• “Useless Evaluation versus User-less Evaluation”, Dagstuhl Seminar 19052 on Computational Methods for Melody and Voice Processing in Music Recordings, January 2019.
• “Your PhD and You”, National University of Distance Education, Spain, November 2018. [video]
• “The Measure Dilemma”, RecSys meetup Amsterdam, June 2018.
• “Evaluation, or the Research of How We Do Research”, W.I.S.V. Christiaan Huygens, Delft, February 2018.
• “Stochastic Simulation for Evaluation Research”, Delft RecSys meetup, June 2017.
• “A Plan for Sustainable MIR Evaluation”, MediaEval Workshop, Hilversum, October 2016.
• “Evaluation in (Music) Information Retrieval through the Audio Music Similarity task”, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, January 2014.
• “Symbolic Melodic Similarity (through Shape Similarity)”, Escola Superior de Música de Catalunya, Barcelona, December 2013.
• “Validity and Reliability of Cranfield-like Evaluation in Information Retrieval”, Information Retrieval Group, University of Glasgow, September 2013.

Tutorials

• “Statistical Analysis of Results in Music Information Retrieval: Why and How”, ISMIR Conference, 2018.

Organization

General

• Delft Data Science Seminar on Trusted Data Analytics, Delft, 2018.
• MediaEval AcousticBrainz Genre Task, 2017, 2018.

Program

• Program Chair, International Society for Music Information Retrieval Conference (ISMIR), 2019.
• Short Paper Chair, International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023.
• Workshop Chair, International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2022.

Editorship

• Transactions of the International Society for Music Information Retrieval, 2020–2022.
• ACM SIGIR Forum, 2020–present.
• Transactions of the International Society for Music Information Retrieval, Special issue on the 20th anniversary of ISMIR, 2020.

Reviewing

Conference Meta-reviewer

• International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2024.
• European Conference on Information Retrieval (ECIR), 2023, 2024
• International Society for Music Information Retrieval Conference (ISMIR), 2015, 2016, 2017, 2018, 2020, 2021.

Conference Reviewer

• International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2019, 2020, 2021, 2022.
• European Conference on Information Retrieval (ECIR), 2020, 2021, 2023.
• ACM International Conference on Web Search and Data Mining (WSDM), 2021 (Outstanding reviewer award), 2022, 2023, 2024.
• ACM International Conference on Information and Knowledge Management (CIKM), 2015, 2023, 2024.
• International Society for Music Information Retrieval Conference (ISMIR), 2012, 2013, 2014 (Outstanding reviewer award).
• The Web Conference (WWW), 2020.
• AAAI Conference on Human Computation and Crowdsourcing (HCOMP), 2018.
• International Symposium on String Processing and Information Retrieval (SPIRE), 2016.
• Workshop on Surprise, Opposition, and Obstruction in Adaptive and Personalized Systems (SOAP), @UMAP2016, @UMAP2017.
• International Workshop on Social Media Retrieval and Analysis (SoMeRA), @SIGIR2014, @ICDM2015.
• International Workshop on Advances in Music Information Research (AdMIRe), @WWW2012.

Workshop Proposal Reviewer

• International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2020.

Journal Reviewer

• ACM Transactions on Information Systems.
• ACM Transactions on Recommender Systems.
• Transactions of the International Society for Music Information Retrieval.
• Journal of the Association for Information Science and Technology.
• Journal of Information Systems.
• ACM Transactions on the Web.
• IEEE Transactions on Multimedia.
• Journal of Information Science.
• Journal of Knowledge and Information Systems.
• IEEE Transactions on Knowledge and Data Engineering.
• IEEE Transactions on Audio, Speech and Language Processing.
• Journal of Information Sciences.
• Journal of Mathematics and Music.
• International Journal of Multimedia Information Retrieval.
• Journal of Network and Computer Applications.

Others

• Participant, Dagstuhl Seminar 23031 on Frontiers of Information Access Experimentation for Research and Education, 2023.
• Participant, Dagstuhl Seminar 19052 on Computational Methods for Melody and Voice Processing in Music Recordings, 2019.
• Advisory Committee, 1st Million Song Dataset Challenge, 2012.
• Panelist, Evaluation Initiatives in Music Information Retrieval, 13th ISMIR Conference, 2012.