Exploring approaches to computational representation and classification of user-generated meal logs
By: Guanlan Hu , Adit Anand , Pooja M. Desai and more
Potential Business Impact:
Helps people eat healthier by understanding food logs.
This study examined the use of machine learning and domain specific enrichment on patient generated health data, in the form of free text meal logs, to classify meals on alignment with different nutritional goals. We used a dataset of over 3000 meal records collected by 114 individuals from a diverse, low income community in a major US city using a mobile app. Registered dietitians provided expert judgement for meal to goal alignment, used as gold standard for evaluation. Using text embeddings, including TFIDF and BERT, and domain specific enrichment information, including ontologies, ingredient parsers, and macronutrient contents as inputs, we evaluated the performance of logistic regression and multilayer perceptron classifiers using accuracy, precision, recall, and F1 score against the gold standard and self assessment. Even without enrichment, ML outperformed self assessments of individuals who logged meals, and the best performing combination of ML classifier with enrichment achieved even higher accuracies. In general, ML classifiers with enrichment of Parsed Ingredients, Food Entities, and Macronutrients information performed well across multiple nutritional goals, but there was variability in the impact of enrichment and classification algorithm on accuracy of classification for different nutritional goals. In conclusion, ML can utilize unstructured free text meal logs and reliably classify whether meals align with specific nutritional goals, exceeding self assessments, especially when incorporating nutrition domain knowledge. Our findings highlight the potential of ML analysis of patient generated health data to support patient centered nutrition guidance in precision healthcare.
Similar Papers
FoodLogAthl-218: Constructing a Real-World Food Image Dataset Using Dietary Management Applications
CV and Pattern Recognition
Helps apps recognize food from your own photos.
MealMeter: Using Multimodal Sensing and Machine Learning for Automatically Estimating Nutrition Intake
Applications
Tracks food eaten by body signals.
SnappyMeal: Design and Longitudinal Evaluation of a Multimodal AI Food Logging Application
Human-Computer Interaction
AI helps you easily track what you eat.