Publications

This is a list of publications I have co-authored. You can also see the list sorted by type.

2024

  1. The Treatment of Ties in Rank-Biased Overlap
    M. Corsi, and J. Urbano, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024.

2023

  1. Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education
    C. Bauer, B. Carterette, N. Ferro, N. Fuhr, J. Beel, T. Breuer, C.L.A. Clarke, A. Crescenzi, G. Demartini, G.M. Di Nunzio, L. Dietz, G. Faggioli, B. Ferwerda, M. Fröbe, M. Hagen, A. Hanbury, C. Hauff, D. Jannach, N. Kando, E. Kanoulas, B.P. Knijnenburg, U. Kruschwitz, M. Li, M. Maistro, L. Michiels, A. Papenmeier, M. Potthast, P. Rosso, A. Said, P. Schaer, C. Seifert, D. Spina, B. Stein, N. Tintarev, J. Urbano, H. Wachsmuth, M.C. Willemsen, J. Zobel, ACM SIGIR Forum, 2023.
  2. Mitigating Mainstream Bias in Recommendation via Cost-sensitive Learning
    R.Z. Li, J. Urbano and A. Hanjalic, ACM SIGIR International Conference on the Theory of Information Retrieval, 2023.

2021

  1. How do Metric Score Distributions affect the Type I Error Rate of Statistical Significance Tests in Information Retrieval?
    J. Urbano, M. Corsi and A. Hanjalic, ACM SIGIR International Conference on the Theory of Information Retrieval, 2021.
  2. New Insights into Metric Optimization for Ranking-based Recommendation
    R.Z. Li, J. Urbano and A. Hanjalic, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021.
  3. Leave No User Behind: Towards Improving the Utility of Recommender Systems for Non-mainstream Users
    R.Z. Li, J. Urbano and A. Hanjalic, ACM International Conference on Web Search and Data Mining, 2021.

2020

  1. Special Collection: 20th Anniversary of ISMIR
    A. Flexer, F. Levé, G. Peeters and J. Urbano, Transactions of the International Society for Music Information Retrieval, 2020.
  2. Introduction to the Special Collection "20th Anniversary of ISMIR"
    A. Flexer, F. Levé, G. Peeters and J. Urbano, Transactions of the International Society for Music Information Retrieval, 2020.
  3. Music Tempo Estimation: Are we done yet?
    H. Schreiber, J. Urbano and M. Müller, Transactions of the International Society for Music Information Retrieval, 2020.
  4. One Deep Music Representation to Rule Them All?: A Comparative Analysis of Different Representation Learning Strategies
    J. Kim, J. Urbano, C. Liem and A. Hanjalic, Neural Computing and Applications, 2020.

2019

  1. Proceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019
    A. Flexer, G. Peeters, J. Urbano and A. Volk, Delft, The Netherlands, 2019.
  2. Are Nearby Neighbors Relatives?: Testing Deep Music Embeddings
    J. Kim, J. Urbano, C. Liem and A. Hanjalic, Frontiers in Applied Mathematics and Statistics, 2019.
  3. Towards Stochastic Simulations of Relevance Profiles
    K. Roitero, A. Brunello, J. Urbano and S. Mizzaro, ACM International Conference on Information and Knowledge Management, 2019.
  4. The AcousticBrainz Genre Dataset: Multi-Source, Multi-Level, Multi-Label, and Large-Scale
    D. Bogdanov, A. Porter, H. Schreiber, J. Urbano and S. Oramas, International Society for Music Information Retrieval Conference, 2019.
  5. Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors
    J. Urbano, H. Lima and A. Hanjalic, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019.
  6. A New Perspective on Score Standardization
    J. Urbano, H. Lima and A. Hanjalic, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019.
  7. Mapping by Observation: building a User-tailored Music Conducting System from Spontaneous Movements
    A. Sarasúa, J. Urbano and E. Gómez, Frontiers in Digital Humanities, 2019.

2018

  1. The MediaEval 2018 AcousticBrainz Genre Task: Content-based Music Genre Recognition from Multiple Sources
    D. Bogdanov, A. Porter, J. Urbano and H. Schreiber, MediaEval Benchmark Workshop, 2018.
  2. Stochastic Simulation of Test Collections: Evaluation Scores
    J. Urbano and T. Nagler, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2018.
  3. Statistical Analysis of Results in Music Information Retrieval: Why and How
    J. Urbano and A. Flexer, International Society for Music Information Retrieval Conference, 2018.
  4. A Semi-Automatic and Low-Cost Method to Learn Patterns for Named Entity Recognition
    M. Marrero and J. Urbano, Natural Language Engineering, 2018.

2017

  1. The MediaEval 2017 AcousticBrainz Genre Task: Content-based Music Genre Recognition from Multiple Sources
    D. Bogdanov, A. Porter, J. Urbano and H. Schreiber, MediaEval Benchmark Workshop, 2017.
  2. The Treatment of Ties in AP Correlation
    J. Urbano and M. Marrero, ACM SIGIR International Conference on the Theory of Information Retrieval, 2017.
    Best short paper award.

2016

  1. A Plan for Sustainable MIR Evaluation
    B. McFee, E.J. Humphrey and J. Urbano, International Society for Music Information Retrieval Conference, 2016.
  2. Toward Estimating the Rank Correlation between the Test Collection Results and the True System Performance
    J. Urbano and M. Marrero, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2016.
  3. Test Collection Reliability: A Study of Bias and Robustness to Statistical Assumptions via Stochastic Simulation
    J. Urbano, Information Retrieval Journal, 2016.

2015

  1. MelodyShape at MIREX 2015 Symbolic Melodic Similarity
    J. Urbano, Music Information Retrieval Evaluation eXchange, 2015.
    Best results in the MIREX 2015 Symbolic Melodic Similarity task.
  2. How do Gain and Discount Functions Affect the Correlation between DCG and User Satisfaction?
    J. Urbano and M. Marrero, European Conference on Information Retrieval, 2015.
  3. Information Extraction Grammars
    M. Marrero and J. Urbano, European Conference on Information Retrieval, 2015.

2014

  1. Music Information Retrieval: Recent Developments and Applications
    M. Schedl, E. Gómez and J. Urbano, Foundations and Trends in Information Retrieval, 2014.
  2. What is the Effect of Audio Quality on the Robustness of MFCCs and Chroma Features?
    J. Urbano, D. Bogdanov, P. Herrera, E. Gómez and X. Serra, International Society for Music Information Retrieval Conference, 2014.
  3. MelodyShape at MIREX 2014 Symbolic Melodic Similarity
    J. Urbano, Music Information Retrieval Evaluation eXchange, 2014.
    Best results in the MIREX 2014 Symbolic Melodic Similarity task.
  4. Harvesting Microblogs for Contextual Music Similarity Estimation: A Co-occurrence-based Framework
    M. Schedl, D. Hauger and J. Urbano, Journal of Multimedia Systems, 2014.
  5. Modeling Software Development Practices using Reusable Project Patterns: A Case Study
    D. Martín, J. García, J. Urbano and A. Amescua, Journal of Software, Evolution and Process, 2014.

2013

  1. Evaluation in Audio Music Similarity
    J. Urbano, PhD dissertation, 2013.
  2. MIREX 2013 Symbolic Melodic Similarity: A Geometric Model supported with Hybrid Sequence Alignment
    J. Urbano, Music Information Retrieval Evaluation eXchange, 2013.
    Best results in the MIREX 2013 Symbolic Melodic Similarity task.
  3. Evaluation in Music Information Retrieval
    J. Urbano, M. Schedl and X. Serra, Journal of Intelligent Information Systems, 2013.
  4. The Neglected User in Music Information Retrieval Research
    M. Schedl, A. Flexer and J. Urbano, Journal of Intelligent Information Systems, 2013.
  5. On the Measurement of Test Collection Reliability
    J. Urbano, M. Marrero and D. Martín, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2013.
  6. A Comparison of the Optimality of Statistical Significance Tests for Information Retrieval Evaluation
    J. Urbano, M. Marrero and D. Martín, International ACM SIGIR Conference on Research and Development in Information Retrieval, 2013.
  7. Practical Experiences in Modelling Software Engineering Practices: the Project Patterns Approach
    J. García, D. Martín, J. Urbano and A. Amescua, Software Quality Journal, 2013.
  8. Named Entity Recognition: Fallacies, Challenges and Opportunities
    M. Marrero, J. Urbano, S. Sánchez-Cuadrado, J. Morato and J. M. Gómez-Berbís, Journal of Computer Standards and Interfaces, 2013.
  9. Minimal Test Collections for Low-Cost Evaluation of Audio Music Similarity and Retrieval Systems
    J. Urbano and M. Schedl, International Journal of Multimedia Information Retrieval, 2013.
  10. A Study of COTS Integration Projects: Product Characteristics, Organization, and Life Cycle Models
    K. Megas, W. B. Frakes, J. Urbano, G. Belli and R. Anguswamy, ACM SIGAPP Symposium on Applied Computing, 2013.
  11. Overview of EIREX 2012: Social Media
    J. Urbano, M. Marrero, D. Martín and J. Morato, ACM Computing Research Repository, 2013.

2012

  1. Notes from the ISMIR 2012 Late-Breaking Session on Evaluation in Music Information Retrieval
    G. Peeters, J. Urbano and G. J. F. Jones, International Society for Music Information Retrieval Conference, 2012.
  2. MIREX 2012 Symbolic Melodic Similarity: Hybrid Sequence Alignment with Geometric Representations
    J. Urbano, J. Lloréns, J. Morato and S. Sánchez-Cuadrado, Music Information Retrieval Evaluation eXchange, 2012.
    Best results in the MIREX 2012 Symbolic Melodic Similarity task.
  3. How Significant is Statistically Significant? The case of Audio Music Similarity and Retrieval
    J. Urbano, J. S. Downie, B. McFee and M. Schedl, International Society for Music Information Retrieval Conference, 2012.
  4. Current Challenges in the Evaluation of Predominant Melody Extraction Algorithms
    J. Salamon and J. Urbano, International Society for Music Information Retrieval Conference, 2012.
  5. Patterns as Objects to Manage Knowledge in Software Development Organizations
    D. Martín, J. García, J. Urbano and J. Lloréns, Journal of Knowledge Management Research & Practice, 2012.
  6. Towards Minimal Test Collections for Evaluation of Audio Music Similarity and Retrieval
    J. Urbano and M. Schedl, WWW International Workshop on Advances in Music Information Research, 2012.
  7. Information Retrieval Systems Adapted to the Biomedical Domain
    M. Marrero, S. Sánchez-Cuadrado, J. Urbano, J. Morato and J. A. Moreiro, ACM Computing Research Repository, 2012.
  8. Overview of EIREX 2011: Crowdsourcing
    J. Urbano, D. Martín, M. Marrero and J. Morato, ACM Computing Research Repository, 2012.

2011

  1. The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track
    J. Urbano, M. Marrero, D. Martín, J. Morato, K. Robles and J. Lloréns, Text REtrieval Conference, 2011.
    Best overall results in the TREC 2011 Crowdsourcing Track (as per NIST ground truth).
  2. Overview of EIREX 2010: Computing
    J. Urbano, M. Marrero, D. Martín and J. Morato, ACM Computing Research Repository, 2011.
  3. The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track: Notebook Paper
    J. Urbano, M. Marrero, D. Martín, J. Morato, K. Robles and J. Lloréns, Text REtrieval Conference Notebook, 2011.
    Best overall results in the TREC 2011 Crowdsourcing Track (as per NIST ground truth).
  4. MIREX 2011 Symbolic Melodic Similarity: Sequence Alignment with Geometric Representations
    J. Urbano, J. Lloréns, J. Morato and S. Sánchez-Cuadrado, Music Information Retrieval Evaluation eXchange, 2011.
    Best results in the MIREX 2011 Symbolic Melodic Similarity task.
  5. Information Retrieval Meta-Evaluation:Challenges and Opportunities in the Music Domain
    J. Urbano, International Society for Music Information Retrieval Conference, 2011.
  6. Audio Music Similarity and Retrieval: Evaluation Power and Stability
    J. Urbano, D. Martín, M. Marrero and J. Morato, International Society for Music Information Retrieval Conference, 2011.
  7. Bringing Undergraduate Students Closer to a Real-World Information Retrieval Setting: Methodology and Resources
    J. Urbano, M. Marrero, D. Martín and J. Morato, ACM SIGCSE Annual Conference on Innovation and Technology in Computer Science Education, 2011.
  8. Melodic Similarity through Shape Similarity
    J. Urbano, J. Lloréns, J. Morato and S. Sánchez-Cuadrado, Exploring Music Contents, 2011.
    An improved version of the system described in this paper obtained the best results in the MIREX 2010, 2011, 2012, 2013, 2014 and 2015 Symbolic Melodic Similarity task.
  9. Modeling Software Development Practices using Reusable Project Patterns: A Case Study
    D. Martín, J. García, J. Urbano and A. Amescua, European Systems & Software Process Improvement and Innovation Conference, 2011.
  10. Virtualización: Una Solución para la Eficiencia, Seguridad y Administración de Intranets
    D. Martín, M. Marrero, J. Urbano, E. Barra and J. A. Moreiro, El Profesional de la Información, 2011.
  11. Intranets: Pasado, Presente y Futuro
    J. Urbano, Docupedia: Enciclopedia colaborativa de información y documentación, 2011.

2010

  1. On the Definition of Patterns for Semantic Annotation
    M. Marrero, J. Urbano, J. Morato and S. Sánchez Cuadrado, ACM CIKM Workshop on Exploiting Semantic Annotations in Information Retrieval, 2010.
  2. Crawling the Web for Structured Documents
    J. Urbano, J. Lloréns, Y. Andreadakis and M. Marrero, ACM International Conference on Information and Knowledge Management, 2010.
  3. Improving the Generation of Ground Truths based on Partially Ordered Lists
    J. Urbano, M. Marrero, D. Martín and J. Lloréns, International Society for Music Information Retrieval Conference, 2010.
  4. MIREX 2010 Symbolic Melodic Similarity: Local Alignment With Geometric Representations
    J. Urbano, J. Lloréns, J. Morato and S. Sánchez-Cuadrado, Music Information Retrieval Evaluation eXchange, 2010.
    Best results in the MIREX 2010 Symbolic Melodic Similarity task.
  5. Crowdsourcing Preference Judgments for Evaluation of Music Similarity Tasks
    J. Urbano, J. Morato, M. Marrero and D. Martín, ACM SIGIR Workshop on Crowdsourcing for Search Evaluation, 2010.
    Most innovative paper award, supported by Microsoft Bing.
  6. Using the Shape of Music to Compute the Similarity between Symbolic Musical Pieces
    J. Urbano, J. Lloréns, J. Morato and S. Sánchez Cuadrado, International Symposium on Computer Music Modeling and Retrieval, 2010.
  7. Sistemas de Recuperación de Información Adaptados al Dominio Biomédico
    M. Marrero, S. Sánchez Cuadrado, J. Urbano, J. Morato and J. A. Moreiro, El Profesional de la Información, 2010.
  8. Computer Support for a Cross-Discipline Research Consortium
    W. B. Frakes, G. Belli, J. Urbano and R. Anguswamy, International Conference on Computer Supported Education, 2010.
  9. Formalización y Desambiguación de Vocabularios de Metadatos mediante Ontologías
    V. Palacios, S. Sánchez-Cuadrado, J. Morato and J. Urbano, Conferencia IADIS Ibero-Americana WWW/INTERNET, 2010.
  10. Recuperación y Acceso a la Información
    J. Urbano, J. Morato, M. Marrero and S. Sánchez-Cuadrado, OpenCourseWare, 2010.
  11. Diseño de Software Avanzado
    J. Urbano, G. Génova, J. Lloréns, M. Valiente, E. Barra, M. Alejandres, OpenCourseWare, 2010.