Feature distribution alignments for object detection in the thermal domain

Mohamed Amine Marnissi (1) , Hajer Fradi (2, 3) , Anis Sahbani (4) , Najoua Essoukri Ben Amara (5)

1 ENISo - National Engineering School of Sousse / Ecole Nationale d'Ingénieurs de Sousse
2 LTCI - Laboratoire Traitement et Communication de l'Information
3 ISSATS - Institut Supérieur des Sciences Appliquées et de Technologie de Sousse
4 ISIR - Institut des Systèmes Intelligents et de Robotique
5 LATIS - Laboratory of Advanced Technology and Intelligent Systems

Infrared imaging has recently played an important role in a wide range of applications including video surveillance, robotics and night vision. However, the manufacturing cost of high-resolution infrared cameras is more expensive regarding similar quality in visible cameras. This could explain the fact that thermal databases are less available compared to visible ones. In this paper, we mainly emphasis the need for aligning features from visible and thermal domains for object detection in order to ensure effective results in both domains without the need to retrain data and to perform additional annotations. To address that, we incorporate feature distribution alignments into Faster R-CNN architecture at different levels. The resulting proposed adaptive detector has the advantage of covering different aspects of the domain shift in order to improve the overall performance. Using KAIST and FLIR ADAS datasets, the effectiveness of the proposed detector is assessed and better results are obtained compared to the baseline detector and to the obtained results by other existing works.Our code is available at https://github.com/AmineMarnissi/UDAT.

Domaines: Intelligence artificielle [cs.AI]

Mohamed Amine Marnissi, Hajer Fradi, Anis Sahbani, Najoua Essoukri Ben Amara. Feature distribution alignments for object detection in the thermal domain. The Visual Computer, 2022, ⟨10.1007/s00371-021-02386-x⟩. ⟨hal-03909913⟩