Removing Raindrops from Nighttime Vehicle Onboard Images Using Generative Adversarial Networks with U-shaped Transformer Structure Generators and a Method for Generating Nighttime Raindrop Images for Training

DOI

Bibliographic Information

Other Title
  • U 型Transformer 構造の生成器を持つGAN による夜間雨滴画像からの雨滴除去手法と学習用夜間雨滴画像の生成法の提案

Abstract

In this paper, we propose a method for raindrop removal from rain-drop coated images acquired during nighttime rainy weather. To the best of our knowledge, no previous deep learning-based method for raindrop removal has been developed for nighttime images. This is because it is difficult to identify raindrop regions in images acquired at night, making it difficult to remove raindrops, and there is no nighttime raindrop image dataset to train a deep learning neural network.To solve these problems, we propose a method to create nighttime raindrop images from daytime images without raindrops by using a deep learning based semantic segmentation method and a method used in the field of computer graphics. In order to improve the ability to identify raindrop regions, we propose a GAN architecture that incorporates the U-shaped Transformer structure into the GAN generator. In addition, we propose to apply histogram flattening to the input images as a preprocessing step during training so that the GAN can be trained stably on a nighttime raindrop image dataset. Experimental results are presented to verify the effectiveness of the proposed method.

Journal

Keywords

Details 詳細情報について

  • CRID
    1390580394707823232
  • DOI
    10.11351/jsaeronbun.55.172
  • ISSN
    18830811
    02878321
  • Text Lang
    ja
  • Data Source
    • JaLC
  • Abstract License Flag
    Disallowed

Report a problem

Back to top