Do the AUC and log-loss evaluate CTR prediction models properly?

Bibliographic Information

Other Title
  • CTR 予測モデルの評価に AUC や log-loss は適切か?

Description

<p>Click-through rate (CTR) prediction is one of the most important task for web advertising platform companies. However, CTR prediction is a non-standard machine learning task, so conventional metrics, for example, area under the Receiver Operating Characteristic curve (AUC), and log-loss, a.k.a. cross-entropy, and so on, can be improper. Our target is develop a new metrices for CTR prediction. In this article, we state the drawbacks of such conventional metrics and perspective of a metric based on the calibration plot approach.</p>

Journal

Details 詳細情報について

  • CRID
    1390845713072711424
  • NII Article ID
    130007658628
  • DOI
    10.11517/pjsai.jsai2019.0_3k3j203
  • ISSN
    27587347
  • Text Lang
    ja
  • Data Source
    • JaLC
    • CiNii Articles
  • Abstract License Flag
    Disallowed

Report a problem

Back to top