Skip to content

Task-specialized multi-modal fusion network for food nutrition estimation

Jul 2026 · Multimedia Systems · Vol 32 · 0 citations · 50 references
Computer Science

TL;DR

This work designs a dual-backbone feature extraction architecture for food nutrition estimation, and introduces the Adaptive Spatial Feature Fusion (ASFF), which fuse ingredient semantic features with visual features through Softmax weighted interaction to enhance feature fusion.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation

Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and broader food computing systems. The existing approaches have progressed along two largely separate axes, vision models that rely on calibrated RGB-depth captures and i...

Aman Kumar, Avinash Anand, Chaitanya Lakhchaura et al. · 0 citations
Open access 2026

ViT-FoodNA: An End-to-End Transformer-Based Multimodal Framework for Food Recognition and Nutrition Analysis

A multimodal transformer-based framework called ViT-FoodNA that integrates these tasks into one end-to-end framework and uses the self-attention mechanism to learn fine-grained intermodal dependencies, which enhances its resistance to visual ambiguity and missing ingredients in a list.

E. Anitha, A. Banu · 0 citations
Open access Aug 2026

Leveraging Convolutional Neural Networks Preprocessing for Accurate Age and Gender Classification in Personalized Nutrition

Imagine having a personalized nutrition plan that caters to your unique dietary needs based on your age and gender. Such a system could revolutionize the way we approach health and wellness. A key component of this vision is the accurate classification of age and gender from facial images, which can be leveraged to pro...

Muhammad Aulia Nur Fadhillah, Shidiq Al Hakim, Rodiah Rodiah et al. · 0 citations
Open access Aug 2026

Explainable Food Image Classification of Indonesian Cuisine Using Xception and ConvNeXt-Tiny with Grad-CAM Visualization

Food image classification is an important task in computer vision because it can provide an image-level recognition component for potential applications in dietary assessment, nutritional monitoring, food recommendation, and AI-assisted digital health services. However, Indonesian food classification remains challengin...

Joharini Joharini, M. Andra · 0 citations
Open access Aug 2026

Biometrically Anchored and Psychological States Aware Deep Learning for Enhanced Personalized Food Recommendation Systems

The VAE-based FRS (VAEFRS) system achieved optimization through its training process, which used a Conditional Tabular Generative Adversarial Network (CTGAN)-augmented training manifold to obtain full coverage of high-dimensional features while preventing overfitting issues.

E. Anitha, A. Banu · 0 citations
Review Sep 2026

Deep learning for food image classification: a structured review of CNNs and lightweight deployment

A structured literature review of CNN-based food image classification studies published between 2020 and 2025 identifies persistent gaps in statistical validation, class imbalance treatment, explainability, reproducibility, public code availability and deployment-oriented evaluation.

Luka Leskovec, A. R. Borges, Fernanda Brito Correia et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.