Projects per year
Abstract
Artificial Neural Networks (NNs) can effectively be used to solve many classification and regression problems, and deliver state-of-the-art performance in the application domains of natural language processing (NLP) and computer vision (CV). However, the tremendous amount of data movement and excessive convolutional workload of these networks hampers large-scale mobile and embedded productization. Therefore these models are generally mapped to energy-efficient accelerators without floating-point support. Weight and data quantization is an effective way to deploy high-precision models to efficient integer-based platforms. In this paper a quantization method for platforms without wide accumulation registers is being proposed. Two constraints to maximize the bit width of weights and input data for a given accumulator size are introduced. These constraints exploit knowledge about the weight and data distribution of individual layers. Using these constraints, we propose a layer-wise quantization heuristic to find a good fixed-point network approximation. To reduce the number of configurations to consider, only solutions that fully utilize the available accumulator bits are being tested. We demonstrate that 16-bit accumulators are able to obtain a Top-1 classification accuracy within 1% of the floating-point baselines on the CIFAR-10 and ILSVRC2012 image classification benchmarks.
Original language | English |
---|---|
Title of host publication | Proceedings - 21st Euromicro Conference on Digital System Design, DSD 2018 |
Editors | Nikos Konofaos, Martin Novotny, Amund Skavhaug |
Place of Publication | Piscataway |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 357-364 |
Number of pages | 8 |
ISBN (Electronic) | 9781538673768 |
ISBN (Print) | 978-1-5386-7377-5 |
DOIs | |
Publication status | Published - 12 Oct 2018 |
Event | 21st Euromicro Conference on Digital System Design, DSD 2018 - Prague, Czech Republic Duration: 29 Aug 2018 → 31 Aug 2018 Conference number: 21 http://dsd-seaa2018.fit.cvut.cz/dsd/ |
Conference
Conference | 21st Euromicro Conference on Digital System Design, DSD 2018 |
---|---|
Abbreviated title | DSD 2018 |
Country/Territory | Czech Republic |
City | Prague |
Period | 29/08/18 → 31/08/18 |
Internet address |
Keywords
- Convolutional neural networks
- Fixed-point efficient inference
- Narrow accumulators
- Quantization
Fingerprint
Dive into the research topics of 'Quantization of constrained processor data paths applied to convolutional neural networks'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Brainwave
Huisken, J. A., Jiao, H., Singh, K., Sanchez, V., de Bruin, E., van der Hagen, D. & de Mol-Regels, M.
1/09/16 → 30/11/21
Project: Research direct
-
Wearable Brainwave Processing Platform
Bergmans, J. W. M., van der Hagen, D., Sanchez, V., Corporaal, H., Pineda de Gyvez, J. & Huisken, J. A.
1/09/16 → 30/11/21
Project: Research direct