Amazing technological breakthrough possible @S-Logix

Office Address

  • #5, First Floor, 4th Street Dr. Subbarayan Nagar Kodambakkam, Chennai-600 024 Landmark : Samiyar Madam
  • +91- 81240 01111

Social List

U2Fusion: A unified unsupervised image fusion network - 2020

Research Area:  Machine Learning


This study proposes a novel unified and unsupervised end-to-end image fusion network, termed as U2Fusion , which is capable of solving different fusion problems, including multi-modal, multi-exposure, and multi-focus cases. Using feature extraction and information measurement, U2Fusion automatically estimates the importance of corresponding source images and comes up with adaptive information preservation degrees. Hence, different fusion tasks are unified in the same framework. Based on the adaptive degrees, a network is trained to preserve the adaptive similarity between the fusion result and source images. Therefore, the stumbling blocks in applying deep learning for image fusion, e.g., the requirement of ground-truth and specifically designed metrics, are greatly mitigated. By avoiding the loss of previous fusion capabilities when training a single model for different tasks sequentially, we obtain a unified model that is applicable to multiple fusion tasks. Moreover, a new aligned infrared and visible image dataset, RoadScene (available at ), is released to provide a new option for benchmark evaluation. Qualitative and quantitative experimental results on three typical image fusion tasks validate the effectiveness and universality of U2Fusion. Our code is publicly available at .

Author(s) Name:  Han Xu; Jiayi Ma; Junjun Jiang; Xiaojie Guo; Haibin Ling

Journal name:  IEEE Transactions on Pattern Analysis and Machine Intelligence

Conferrence name:  

Publisher name:  IEEE

DOI:  10.1109/TPAMI.2020.3012548

Volume Information:  ( Volume: 44, Issue: 1, Jan. 1 2022) Page(s): 502 - 518