Auto-Differentiated Fixed Point Notation on Low-Powered Hardware Acceleration
-
- Nsinga Robert
- Graduate School of Advanced Technology and Science
-
- Karungaru Stephen
- Graduate School of Advanced Technology and Science
-
- Terada Kenji
- Graduate School of Advanced Technology and Science
説明
<p>Using less electric power or speeding up processing is catching the interests of researchers in deep learning. Quanti-zation has offered distillation mechanisms that substitute floating numbers for integers, but little has been suggested about the floating numbers themselves. The use of Q-format notation reduces computational overheads that frees resources for the in-troduction of more operations. Our experiments, conditioned on varying regimes, introduce automatic differentiation on algo-rithms like the fast Fourier transforms and Winograd minimal filtering to reduce computational complexity (expressed in total number of MACs) and suggest a path towards the assistive intelligence concept. Empirical results show that, under specific heuristics, the Q-format number notation can overcome the shortfalls of floating numbers, especially for embedded systems. Further benchmarks like the FPBench standard give more details by comparing our proposals with common deep learning operations.</p>
収録刊行物
-
- 信号処理
-
信号処理 26 (5), 131-140, 2022-09-01
信号処理学会
- Tweet
詳細情報 詳細情報について
-
- CRID
- 1390011793672543360
-
- ISSN
- 18801013
- 13426230
-
- 本文言語コード
- en
-
- データソース種別
-
- JaLC
- IRDB
- Crossref
-
- 抄録ライセンスフラグ
- 使用不可