Eye-Contact Transformer: Eye-Contact Detection of Distant Pedestrians Considering Scene Context

DOI

Bibliographic Information

Other Title
  • Eye-contact Transformer: シーンコンテクストを考慮した遠方歩行者のアイコンタクト検出

Abstract

It is very important for safe driving to understand whether a pedestrian is aware of our own vehicle. Eye-contact plays an important role in determining the awareness of each pedestrian. Traditionally, eye gaze estimation has been widely used for such eye contact detection, but this method cannot be applied in road environments since the distance between pedestrians and vehicles is large. Therefore, this paper proposes a method that can detect eye-contact from pedestrians accurately even in complex traffic environments by capturing the relationship between the sequence of pedestrian's skeleton and scene context of the surrounding environment based on Transformer-based model. Through the experiments using in-vehicle camera image dataset, we confirmed the effectiveness of the proposed method.

Journal

Keywords

Details 詳細情報について

Report a problem

Back to top