CLAMP: Contrastive learning with adaptive multi-loss and progressive fusion for multimodal aspect-based sentiment analysis.

Abstract

Multimodal aspect-based sentiment analysis (MABSA) seeks to identify aspect terms within paired image-text data and determine their fine-grained sentiment polarities, representing a fundamental task for improving the effectiveness of applications such as product review systems and public opinion monitoring. Existing methods face challenges such as cross-modal alignment noise and insufficient consistency in fine-grained representations. Global modality alignment methods often overlook the connection between aspect terms and their corresponding local visual regions; bridging the representation gap between text and images remains a challenge. To address these limitations, this paper introduces an end‑to‑end Contrastive Learning framework with Adaptive Multi-loss and Progressive Attention Fusion (CLAMP). The framework is composed of three novel modules: Progressive Attention Fusion network, Multi-task Contrastive Learning, and Adaptive Multi-loss Aggregation. The Progressive Attention Fusion network enhances fine-grained alignment between textual features and image regions via hierarchical, multi-stage cross-modal interactions, effectively suppressing irrelevant visual noise. Secondly, multi-task contrastive learning combines global modal contrast and local granularity alignment to enhance cross-modal representation consistency. Adaptive Multi‑loss Aggregation employs a dynamic uncertainty‑based weighting mechanism to calibrate loss contributions according to each task's uncertainty, thereby mitigating gradient interference. Evaluation on standard public benchmarks demonstrates that CLAMP consistently outperforms the vast majority of state‑of‑the‑art methods.