Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Autor: Hendriksen, Mariya, Zhang, Shuo, Reinanda, Ridho, Yahya, Mohamed, Meij, Edgar, de Rijke, Maarten

We examine the brittleness of the image-text retrieval (ITR) evaluation pipeline with a focus on concept granularity. We start by analyzing two common benchmarks, MS-COCO and Flickr30k, and compare them with augmented, fine-grained versions, MS-COCO-

Externí odkaz: http://arxiv.org/abs/2407.15239

Demonstrating and Reducing Shortcuts in Vision-Language Representation Learning

Autor: Bleeker, Maurits, Hendriksen, Mariya, Yates, Andrew, de Rijke, Maarten

Vision-language models (VLMs) mainly rely on contrastive training to learn general-purpose representations of images and captions. We focus on the situation when one image is associated with several captions, each caption containing both information

Externí odkaz: http://arxiv.org/abs/2402.17510

Towards Contrastive Learning in Music Video Domain

Autor: Veldkamp, Karel, Hendriksen, Mariya, Szlávik, Zoltán, Keijser, Alexander

Contrastive learning is a powerful way of learning multimodal representations across various domains such as image-caption retrieval and audio-visual representation learning. In this work, we investigate if these findings generalize to the domain of

Externí odkaz: http://arxiv.org/abs/2309.00347

Optimised treatment of patients with enlarged lateral lymph nodes in rectal cancer: protocol of an international, multicentre, prospective registration study after extensive multidisciplinary training (LaNoReC)

Autor: Susan Van Dieren, Joost Nederend, Pieter J Tanis, Roel Hompes, Klaas Havenga, Melissa W Taggart, Robert Riedl, Michail Doukas, Evert-Jan G. Boerma, Marinke Westerterp, Corrie A M Marijnen, Jaap Stoker, Andrew Ruszkiewicz, Tsuyoshi Konishi, Jarno Melenhorst, Karin Muller, Krista Gerbrands, Michael Croft, Michael Wilks, Johanne G. Bloemen, Peter A. Neijenhuis, Koen C.M.J. Peeters, Miranda Kusters, Martijn Intven, Jan Peringa, Maria Verseveld, Eline G M van Geffen, Tania C Sluckin, Sanne-Marije J A Hazen, Karin Horsthuis, Geerard Beets, Marilyne M Lange, Regina G H Beets-Tan, Marc R. W. Engelbrecht, Elisabeth D. Geijsen, Philip Meijnen, Jurriaan B. Tuynman, Ingrid M. Bruijnzeel, Bas Lamme, Femke M. Alberts, Rogier M. P. H. Crolla, Joanne Verdult, Johan H. Wijsman, Charlotte S. van Kessel, Erik Jan Mulder, Jan Binne Hulshoff, Ivan M. Cherepanin, Hans F. J. Fabry, G. Y. Mireille, Frank J. M. Kemper, Fatih Polat, Jacobus W. A. Burger, Jeltsje S. Cnossen, Shira H. de Bie, Robbert J. I. Bosker, Aaldert K. Talsma, Leonora S. F. Boogerd, Marc J. P. M. Govaert, Merel M. Scheurkogel, Imogeen E. Antonisse, Joost Rothbarth, Marianne de Vries, Marcel A. H. Ribbert, Anthony W. H. van de Ven, Susan ter Borg, Jennifer W. Bradshaw, Heleen M. Ceha, Fleur I. de Korte, Andreas W. K. S. Marinelli, Tjeerd S. Aukema, Liselotte W. van Bockel, Aukje A. J. M. van Tilborg, Tom Rozema, Amarins Brandsma, Stefan Hoogendoorn, Saskia R. Offerman, Hanneke Vos, Henderik L. van Westreenen, Jeroen W. A. Leijtens, Fabian A. Holman, Laura A. Velema, L Els, van Persijn van Meerten, Frans C. H. Bakers, Iryna Samarska, Nina Šefčovičová, Maaike Berbée, Bastiaan B. Pultrum, Dennis B. Rouw, Matthew Albert, L. René Arensman, Hanneke Basart, Esther C. J. Consten, Bart C.T. van de Laar, Inne Somers, Paul M. Verheijen, Thomas A. Fassaert, Christiaan Hoff, Eino B. van Duyn, Ellen M. Hendriksen, Hugo A.J. Gielkens, Arend G. J. Aalbers, Brechtje A. Grotenhuis, Michalda S. Dunker, Anne M. van Geel, Christof Meischl, W. Hermien Schreurs, Patty H. Spruit, Michael F. Gerhards, Thomas M. Karsten, Eveline J.T. Krul, Sebastiaan van Koeverden, Andre J. A. Bremers, Heidi Rütten, Johannes H. W. de Wilt, Mariska den Hartogh, Vera Oppedijk, Jan Willem T. Dekker, Debora Eschbach-Zandbergen, Daphne Roos, Arjan van Tilburg, Ernst Jan, Spillenaar Bilgen, Nikki Knijn, Marnix A. J. de Roos, Ilse van Dop, Tracy Fitzsimmons, Hidde M. Kroon, Michael Penniment, Mitchell Raeside, Tarik Sammour, Steven J. Oosterling, Jeroen A. W. Tielbeek, Ronald J. C. L. M. Vuylsteke, Erik J. R. J. van der Hoeven, Anke B. Smits, Anniek H. Boer, Edgar J. B. Furnée, Robbert J. de Haas, Manon N. G. J. A. Braat, Wilhelmina M. U. van Grevenstein, Milan C. Richir, Patricia J. A. M. Brouwers, Tilly Leseman, Eric H. J. Belgers, Jasenko Krdzalic, Roy F. A. Vliegen

Publikováno v: BMJ Open, Vol 14, Iss 10 (2024)

Introduction Inadequate treatment of enlarged lateral lymph nodes (LLNs) in rectal cancer patients is associated with an increased lateral local recurrence (LLR) risk, despite neoadjuvant treatment and total mesorectal excision (TME) surgery. There i

Externí odkaz: https://doaj.org/article/340de40a283a4148be1229eb0c6c7cba

Use of a digital tool to support the diagnostic process in memory clinics–a usability study

Autor: Aniek M. van Gils, Hanneke F. M. Rhodius-Meester, Dédé Handgraaf, Heleen M. A. Hendriksen, Astrid van Strien, Niki Schoonenboom, Annemieke Schipper, Mariska Kleijer, Annemiek Griffioen, Majon Muller, Antti Tolonen, Jyrki Lötjönen, Wiesje M. van der Flier, Leonie N. C. Visser

Publikováno v: Alzheimer’s Research & Therapy, Vol 16, Iss 1, Pp 1-14 (2024)

Abstract Background Both memory clinic professionals and patients see value in digital tools, yet these hardly find their way to clinical practice. We explored the usability of a digital tool to support the diagnostic work-up in daily memory clinic p

Externí odkaz: https://doaj.org/article/f0bec7b8e71a414fbd5ad2e4051e493a