https://arxiv.org/abs/2506.13971
[2506.13971] Multimodal Fusion with Semi-Supervised Learning Minimizes Annotation Quantity for...
Abstract page for arXiv paper 2506.13971: Multimodal Fusion with Semi-Supervised Learning Minimizes Annotation Quantity for Modeling Videoconference...
semi supervised learningmultimodal fusion
https://deepai.org/publication/interpretable-multimodal-fusion-networks-reveal-mechanisms-of-brain-cognition
Interpretable multimodal fusion networks reveal mechanisms of brain cognition | DeepAI
Jun 16, 2020 - 06/16/20 - Multimodal fusion benefits disease diagnosis by providing a more comprehensive perspective. Developing algorithms is challenging d...
multimodal fusionbrain cognitionnetworksrevealmechanisms
https://openreview.net/forum?id=xAR2jnDZObi&referrer=%5Bthe%20profile%20of%20Vaishnavi%20Subramanian%5D(%2Fprofile%3Fid%3D~Vaishnavi_Subramanian1)
Multimodal fusion of imaging and genomics for lung cancer recurrence prediction | OpenReview
Lung cancer has a high rate of recurrence in early-stage patients. Predicting the post-surgical recurrence in lung cancer patients has traditionally been...
multimodal fusion
https://openreview.net/forum?id=KJ5h-yfUHa
Attention Bottlenecks for Multimodal Fusion | OpenReview
We propose a new multimodal fusion model for video that exchanges cross-modal information between modalities via a small number of 'attention bottleneck'...
multimodal fusionattentionbottlenecksopenreview
https://aclanthology.org/2020.findings-emnlp.35/
Dual Low-Rank Multimodal Fusion - ACL Anthology
Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang. Findings of the Association for Computational Linguistics: EMNLP 2020. 2020.
multimodal fusionduallowrankacl
https://www.news-medical.net/news/20181004/Multimodal-fusion-model-can-better-predict-cognitive-impairment.aspx
Multimodal fusion model can better predict cognitive impairment
Jun 19, 2019 - A new study has shown that by combining imaging and neuropsychological testing, one can more accurately assess the cognitive status of individuals.
multimodal fusionmodelbetterpredictcognitive
https://openreview.net/forum?id=3dzeN4vEFy
Multi-Task Network Guided Multimodal Fusion for Fake News Detection | OpenReview
Fake news detection has become a hot research topic in the multimodal domain. Existing multimodal fake news detection research utilizes a series of feature...
fake news detectionmulti taskmultimodal fusionnetworkguided
https://pmc.ncbi.nlm.nih.gov/articles/PMC10734907/
Data-driven multimodal fusion: approaches and applications in psychiatric research - PMC
In the era of big data, where vast amounts of information are being generated and collected at an unprecedented rate, there is a pressing demand for innovative...
data drivenmultimodal fusionapproaches
https://www.utwente.nl/en/eemcs/ps/education/master%20theses/Adarsh/
Assignment: Evaluating and Improving Multimodal Fusion Robustness in Drone-Based Object Detection |...
evaluating and improvingmultimodal fusion
https://www.mdpi.com/1424-8220/22/20/7918
Visual Relationship Detection with Multimodal Fusion and Reasoning
Visual relationship detection aims to completely understand visual scenes and has recently received increasing attention. However, current methods only use the...
multimodal fusionvisualrelationshipdetectionreasoning
https://openreview.net/forum?id=AobzdtqiMe
Federated Multimodal Fusion for Action Recognition Leveraging Vision-Language Embeddings and...
Federated learning (FL) for Video Action Recognition (VAR) faces significant challenges in balancing privacy preservation, communication efficiency, and model...
multimodal fusionfor actionfederated
https://www.preprints.org/manuscript/202505.1631
Eye Guided Multimodal Fusion: Toward an Adaptive Learning Framework Using Explainable Artificial...
Interpreting diagnostic imaging and identifying relevant features in healthcare present significant challenges. For novices, the risk of misdiagnosis can be...
multimodal fusion
https://deepai.org/publication/autonomous-soundscape-augmentation-with-multimodal-fusion-of-visual-and-participant-linked-inputs
Autonomous Soundscape Augmentation with Multimodal Fusion of Visual and Participant-linked Inputs |...
Mar 15, 2023 - 03/15/23 - Autonomous soundscape augmentation systems typically use trained models to pick optimal maskers to effect a desired perceptual cha...
multimodal fusion
https://www.preprints.org/manuscript/202509.0094
GBV-Net: Hierarchical Fusion of Facial Expressions and Physiological Signals for Multimodal Emotion...
A core challenge in multimodal emotion recognition lies in the precise capture of the inherent multimodal interactive nature of human emotions. Addressing the...
https://arxiv.org/abs/2407.18552v4
[2407.18552v4] Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross...
Abstract page for arXiv paper 2407.18552v4: Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention
emotion recognition
https://ojp.gov/library/publications/identifying-illicit-drug-dealers-instagram-large-scale-multimodal-data-fusion
Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion | Office of...
https://openreview.net/forum?id=aP6R9C5skC&referrer=%5Bthe%20profile%20of%20Kun%20Yi%5D(%2Fprofile%3Fid%3D~Kun_Yi2)
Frequency Spectrum Is More Effective for Multimodal Representation and Fusion: A Multimodal...
Multimodal content, such as mixing text with images, presents significant challenges to rumor detection in social media. Existing multimodal rumor detection...
frequency spectrummore effective
https://www.brunel.ac.uk/research/Research-degrees/PhD-Topics/Topics?id=388c01ba-b189-4d72-9676-343fdb60ac65
AI-Driven Multimodal Biomedical Data Fusion
AI-Driven Multimodal Biomedical Data Fusion Technological advances in biomedicine now enable the collection of high-dimensional, heterogeneous data across...
ai drivenbiomedical datamultimodalfusion
https://deepai.org/publication/research-on-facial-expression-recognition-based-on-multimodal-data-fusion-and-neural-network
Research on facial expression recognition based on Multimodal data fusion and neural network |...
Sep 26, 2021 - 09/26/21 - Facial expression recognition is a challenging task when neural network is applied to pattern recognition. Most of the current rec...
facial expression recognition
https://arxiv.org/abs/2001.09485v1
[2001.09485v1] Multimodal Data Fusion based on the Global Workspace Theory
Abstract page for arXiv paper 2001.09485v1: Multimodal Data Fusion based on the Global Workspace Theory
multimodal databased onglobal workspace2001fusion
https://www.preprints.org/manuscript/202503.2247
Multimodal Fall Detection Using Spatial-Temporal Attention and Bi-LSTM Based Feature Fusion[v1] |...
Human fall detection is a significant healthcare concern, particularly among the elderly, due to its links to muscle weakness, cardiovascular issues, and...
https://www.umu.se/en/research/groups/train-lab/discriminative-models--multimodal-fusion/
Discriminative models & Multimodal Fusion
modelsmultimodalfusion
https://www.easychair.org/publications/keyword/zWBS
Keyword: Attention-based Multimodal Fusion
keywordattentionbasedmultimodalfusion
https://www.spandidos-publications.com/10.3892/etm.2023.11870/abstract
3D multimodal image fusion based on MRI in the preoperative evaluation of microvascular...
Experimental and Therapeutic Medicine is an international journal devoted to laboratory and clinical medicine.
https://www.amazon.science/publications/leveraging-efficient-training-and-feature-fusion-in-transformers-for-multimodal-classification
Leveraging efficient training and feature fusion in transformers for multimodal classification -...
People navigate a world that involves many different modalities and make decision on what they observe. Many of the classification problems that we face in the...
efficient trainingleveragingfeature
https://www.inderscience.com/info/inarticle.php?artid=149699
Article: Intelligent home interactive gesture recognition method based on multimodal feature fusion...
Inderscience is a global company, a dynamic leading independent journal publisher disseminates the latest research across the broad fields of science,...
intelligent homegesture recognition
https://arxiv.org/html/2412.02283
VR Based Emotion Recognition Using Deep Multimodal Fusion With Biosignals Across Multiple...
emotion recognition
https://openreview.net/forum?id=2MF4aDRfiE
Provable Dynamic Fusion for Low-Quality Multimodal Data | OpenReview
The inherent challenge of multimodal fusion is to precisely capture the cross-modal correlation and flexibly conduct cross-modal interaction. To fully release...
low qualitymultimodal dataprovabledynamicfusion
https://openreview.net/forum?id=KI1G4N5mBm&referrer=%5Bthe%20profile%20of%20Jaywon%20Koo%5D(%2Fprofile%3Fid%3D~Jaywon_Koo1)
Multimodal Multi-loss Fusion Network for Sentiment Analysis | OpenReview
This paper investigates the optimal selection and fusion of feature encoders across multiple modalities and combines these in one neural network to improve...
fusion networksentiment analysismultimodallossopenreview
https://www.easychair.org/publications/preprint/9f4s
MobileFuse: Multimodal Image Fusion at the Edge
image fusionmultimodaledge
https://www.preprints.org/manuscript/202605.0313
Keyframe Selection and Multimodal Fusion for Product Recognition in E-Commerce Live Streaming[v1] |...
Product recognition in e-commerce live streaming is hindered by rapid viewpoint changes, occlusions, motion blur, and inconsistencies between visual and spoken...
https://m4d.iti.gr/
Multimodal Data Fusion and Analytics Group
multimodal datafusionanalyticsgroup
https://arxiv.org/abs/1802.00924
[1802.00924] Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning
Abstract page for arXiv paper 1802.00924: Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning
multimodal sentiment analysis
https://openreview.net/forum?id=dpGns2IHRW
UniCat: Crafting a Stronger Fusion Baseline for Multimodal Re-Identification | OpenReview
Multimodal Re-Identification (ReID) is a popular retrieval task that aims to re-identify objects across diverse data streams, prompting many researchers to...
re identificationunicatcraftingstrongerfusion
https://deepai.org/publication/knowledge-base-completion-using-web-based-question-answering-and-multimodal-fusion
Knowledge Base Completion using Web-Based Question Answering and Multimodal Fusion | DeepAI
Nov 14, 2022 - 11/14/22 - Over the past few years, large knowledge bases have been constructed to store massive amounts of knowledge. However, these knowled...
knowledge baseweb based
https://pmc.ncbi.nlm.nih.gov/articles/PMC4917230/
Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental...
It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the...
https://deepai.org/publication/muse-toolbox-the-multimodal-sentiment-analysis-continuous-annotation-fusion-and-discrete-class-transformation-toolbox
MuSe-Toolbox: The Multimodal Sentiment Analysis Continuous Annotation Fusion and Discrete Class...
Jul 25, 2021 - 07/25/21 - We introduce the MuSe-Toolbox - a Python-based open-source toolkit for creating a variety of continuous and discrete emotion gold ...
multimodal sentiment analysis
https://pmc.ncbi.nlm.nih.gov/articles/PMC7984774/
Multimodal fusion of EEG-fNIRS: a mutual information-based hybrid classification framework - PMC
Multimodal data fusion is one of the current primary neuroimaging research directions to overcome the fundamental limitations of individual modalities by...
https://www.scirp.org/journal/paperinformation?paperid=1096
Multimodal Belief Fusion for Face and Ear Biometrics
Discover a robust and efficient multimodal biometric system using GMM and DS theory for face and ear biometrics. Explore the fusion of Gabor wavelet filters...
for facemultimodalbelieffusionear
https://www.preprints.org/manuscript/202605.0163
A Systematic Review of Data-Driven Multimodal Fusion Methods for Simultaneous EEG-fMRI[v1] |...
Simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provide complementary views of brain activity, capturing neural...
https://www.mdpi.com/1424-8220/20/18/5328
FusionSense: Emotion Classification Using Feature Fusion of Multimodal Data and Deep Learning in a...
Using multimodal signals to solve the problem of emotion recognition is one of the emerging trends in affective computing. Several studies have utilized state...
https://www.ornl.gov/publication/2023-annual-report-multimodal-data-fusion-3d-gamma-ray-imaging-safeguards
2023 Annual Report: Multimodal Data Fusion with 3D Gamma-Ray Imaging for Safeguards | ORNL
2023 annual report
https://openreview.net/forum?id=YVnTOmu9a8
Chemical Language Meets Geometric Graphs: A Multimodal Fusion Approach for Molecular Properties |...
Rapid and accurate prediction of the physicochemical properties of molecules given their structures remains a key challenge in cheminformatics. Machine...
https://www.mdpi.com/1424-8220/23/13/5855
Node-Loss Detection Methods for CZ Silicon Single Crystal Based on Multimodal Data Fusion
Monocrystalline silicon is an important raw material in the semiconductor and photovoltaic industries. In the Czochralski (CZ) method of growing...
https://openreview.net/forum?id=ad6Q54fHMr
A Multimodal Hybrid Late-Cascade Fusion Network for Enhanced 3D Object Detection | OpenReview
We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB...
https://pmc.ncbi.nlm.nih.gov/articles/PMC11240882/
Learning Spatiotemporal Brain Dynamics in Adolescents via Multimodal MEG and fMRI Data Fusion Using...
Brain function is understood to be regulated by complex spatiotemporal dynamics, and can be characterized by a combination of observed brain response patterns...