Samenvatting
In the human brain, learning is continuous, while currently in AI, learning algorithms are pre-trained, making the model non-evolutive and predetermined. However, even in AI models, environment and input data change over time. Thus, there is a need to study continual learning algorithms. In particular, there is a need to investigate how to implement such continual learning algorithms on-chip. In this work, we focus on Oscillatory Neural Networks (ONNs), a neuromorphic computing paradigm performing auto-associative memory tasks, like Hopfield Neural Networks (HNNs). We study the adaptability of the HNN unsupervised learning rules to on-chip learning with ONN. In addition, we propose a first solution to implement unsupervised on-chip learning using a digital ONN design. We show that the architecture enables efficient ONN on-chip learning with Hebbian and Storkey learning rules in hundreds of microseconds for networks with up to 35 fully-connected digital oscillators.
Originele taal-2 | Engels |
---|---|
Artikelnummer | 1196796 |
Aantal pagina's | 13 |
Tijdschrift | Frontiers in Neuroscience |
Volume | 17 |
DOI's | |
Status | Gepubliceerd - 15 jun. 2023 |
Financiering
This work was supported by the European Union's Horizon 2020 research and innovation program, EU H2020 NEURONN project under Grant No. 871501 ( www.neuronn.eu ).
Financiers | Financiernummer |
---|---|
European Union’s Horizon Europe research and innovation programme | 871501 |
European Commission |