AIDA

Explainable multimodal deep learning for personalized oncology, with a focus on robust fusion, missing modalities, and clinical validation in non-small cell lung cancer.

AIDA

Clinical Application

AIDA

Explainable multimodal deep learning for personalized oncology, with a focus on robust fusion, missing modalities, and clinical validation in non-small cell lung cancer.

Multimodal Deep Learning Explainable AI Personalized Oncology

Overview

AIDA develops explainable multimodal deep learning for healthcare scenarios where single-modality pipelines are not enough. The project investigates when and how to fuse heterogeneous evidence, how to learn stronger shared representations, and how to maintain robustness when data are incomplete or some modalities are missing.

The translational application is personalized oncology in non-small cell lung cancer, where radiomic, pathomic, and electronic health record data are combined to predict response, relapse, progression-free survival, and overall survival. The project also studies clinical trust through explainability mechanisms designed for physicians and domain experts.

Research Directions

  • Multimodal representation learning across radiomics, pathomics, and electronic health records.
  • Explainable AI methods for attention, counterfactual reasoning, and user-facing clinical transparency.
  • Prospective validation in non-small cell lung cancer with comparison against conventional clinical markers.

Related Publications

  1. Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer
    Filippo Ruffini, Camillo Maria Caruso, Claudia Tacconi, Lorenzo Nibid, Francesca Miccolis, Marta Lovino, Carlo Greco, Edy Ippolito, Michele Fiore, Alessio Cortellini, and 9 more authors
    arXiv preprint arXiv:2601.10386, 2026
    multimodal learning clinical prognosis medical imaging
    AIDA digilung
  2. Predicting lung cancer survival with attention-based CT slices combination
    Domenico Paolo, Carlo Greco, Edy Ippolito, Michele Fiore, Sara Ramella, Paolo Soda, Matteo Tortora, Alessandro Bria, and Rosa Sicilia
    2026
  3. Not another imputation method: A transformer-based model for missing values in tabular datasets
    Camillo Maria Caruso, Paolo Soda, and Valerio Guarrasi
    2026
    multimodal learning clinical prediction foundation models
  4. Hierarchical embedding attention for overall survival prediction in lung cancer from unstructured EHRs
    Domenico Paolo, Carlo Greco, Alessio Cortellini, Sara Ramella, Paolo Soda, Alessandro Bria, and Rosa Sicilia
    2025
    oncology foundation models generative AI
  5. Benchmarking GAN-Based vs Classical Data Augmentation on Biomedical Images
    Massimiliano Mantegna, Lorenzo Tronchin, Matteo Tortora, and Paolo Soda
    2025
  6. A systematic review of intermediate fusion in multimodal deep learning for biomedical applications
    Valerio Guarrasi, Fatih Aksu, Camillo Maria Caruso, Francesco Di Feola, Aurora Rofena, Filippo Ruffini, and Paolo Soda
    2025
    multimodal learning
  7. Multi-scale texture loss for CT denoising with GANs
    Francesco Di Feola, Lorenzo Tronchin, Valerio Guarrasi, and Paolo Soda
    2025
    generative AI radiomics
  8. MARIA: A multimodal transformer model for incomplete healthcare data
    Camillo Maria Caruso, Paolo Soda, and Valerio Guarrasi
    2025
    multimodal learning foundation models clinical prediction
  9. Can Foundation Models Really Segment Tumors? A Benchmarking Odyssey in Lung CT Imaging
    Elena Mulero Ayllón, Massimiliano Mantegna, Linlin Shen, Paolo Soda, Valerio Guarrasi, and Matteo Tortora
    2025
    foundation models medical imaging
  10. Multi-stage intermediate fusion for multimodal learning to classify non-small cell lung cancer subtypes from CT and PET
    Fatih Aksu, Fabrizia Gelardi, Arturo Chiti, and Paolo Soda
    2025
    radiomics oncology multimodal learning
  11. Exploring Negated Entites for Named Entity Recognition in Italian Lung Cancer Clinical Reports
    Domenico Paolo, Alessandro Bria, Carlo Greco, Marco Russano, Sara Ramella, Paolo Soda, and Rosa Sicilia
    2024
  12. A deep learning approach for overall survival prediction in lung cancer with missing values
    Camillo Maria Caruso, Valerio Guarrasi, Sara Ramella, and Paolo Soda
    2024
    clinical prediction oncology
  13. Toward a Multimodal Deep Learning Approach for Histological Subtype Classification in NSCLC
    Fatih Aksu, Fabrizia Gelardi, Arturo Chiti, and Paolo Soda
    2024
    oncology multimodal learning medical imaging
  14. Named Entity Recognition in Italian Lung Cancer Clinical Reports using Transformers
    Domenico Paolo, Alessandro Bria, Carlo Greco, Marco Russano, Sara Ramella, Paolo Soda, and Rosa Sicilia
    2023
    oncology foundation models medical imaging