Nutrition5k: Towards Automatic Nutritional Understanding of Generic Food

Autor:	Thames, Quin, Karpur, Arjun, Norris, Wade, Xia, Fangting, Panait, Liviu, Weyand, Tobias, Sim, Jack
Rok vydání:	2021
Předmět:	Computer Science - Computer Vision and Pattern Recognition Computer Science - Machine Learning
Druh dokumentu:	Working Paper
Popis:	Understanding the nutritional content of food from visual data is a challenging computer vision problem, with the potential to have a positive and widespread impact on public health. Studies in this area are limited to existing datasets in the field that lack sufficient diversity or labels required for training models with nutritional understanding capability. We introduce Nutrition5k, a novel dataset of 5k diverse, real world food dishes with corresponding video streams, depth images, component weights, and high accuracy nutritional content annotation. We demonstrate the potential of this dataset by training a computer vision algorithm capable of predicting the caloric and macronutrient values of a complex, real world dish at an accuracy that outperforms professional nutritionists. Further we present a baseline for incorporating depth sensor data to improve nutrition predictions. We will publicly release Nutrition5k in the hope that it will accelerate innovation in the space of nutritional understanding. Comment: 8 pages, 3 of appendices. CVPR 2021
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2103.03375 Zobrazit plný text záznamu View this record from Arxiv