Towards Highly Expressive Machine Learning Models of Non-Melanoma Skin Cancer

Autor:	Thomas, Simon M., Lefevre, James G., Baxter, Glenn, Hamilton, Nicholas A.
Rok vydání:	2022
Předmět:	Computer Science - Machine Learning Computer Science - Artificial Intelligence Computer Science - Computation and Language Computer Science - Computer Vision and Pattern Recognition Electrical Engineering and Systems Science - Image and Video Processing I.2.7 I.2.10
Druh dokumentu:	Working Paper
Popis:	Pathologists have a rich vocabulary with which they can describe all the nuances of cellular morphology. In their world, there is a natural pairing of images and words. Recent advances demonstrate that machine learning models can now be trained to learn high-quality image features and represent them as discrete units of information. This enables natural language, which is also discrete, to be jointly modelled alongside the imaging, resulting in a description of the contents of the imaging. Here we present experiments in applying discrete modelling techniques to the problem domain of non-melanoma skin cancer, specifically, histological images of Intraepidermal Carcinoma (IEC). Implementing a VQ-GAN model to reconstruct high-resolution (256x256) images of IEC images, we trained a sequence-to-sequence transformer to generate natural language descriptions using pathologist terminology. Combined with the idea of interactive concept vectors available by using continuous generative methods, we demonstrate an additional angle of interpretability. The result is a promising means of working towards highly expressive machine learning systems which are not only useful as predictive/classification tools, but also means to further our scientific understanding of disease. Comment: 12 figures, 29 pages
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2207.05749 Zobrazit plný text záznamu View this record from Arxiv