A neural network contained in single node: Folding a Deep Neural Network in Time using Feedback-Modulated Delay-Loops

Deep neural networks are among the most widely applied machine learning tools showing outstanding performance in a broad range of tasks. In this talk, a method for folding a deep neural network of arbitrary size into a single neuron with multiple time-delayed feedback loops is presented. The network states emerge in time as a temporal unfolding of the neuron's dynamics and by adjusting the feedback-modulation within the loops, the network's connection weights can be adapted. These connection weights are determined, i.e. learned, via a back-propagation algorithm. This approach fully recovers standard Deep Neural Networks (DNN), encompasses sparse DNNs, and extends the DNN concept toward dynamical systems implementations. This new method, which we have called Folded-in-time DNN (Fit-DNN), exhibits promising performance in a set of benchmark tasks.

Zoom: https://us02web.zoom.us/j/83829318876?pwd=Z2pqbUtIMEV3NUQvU0hpakp0NGtsUT09

Meeting ID: 838 2931 8876

Passcode: 797728

Detalls de contacte:

Tobias Galla
971 25 98 77
Contact form

Aquesta web utilitza cookies per a la recollida de dades amb un propòsit estadístic. Si continues navegant, vol dir que acceptes la instal·lació de la cookie.

Més informació D'accord