Dynamic cortex memory (`DCMCell`)

[MartinuzziFrancesco]

Paper

https://link.springer.com/chapter/10.1007/978-3-319-11179-7_1

Equations

$$\begin{align} \mathbf{x}_l^t &= \varphi_l\left( \mathbf{W}_{li} \mathbf{x}^t + \mathbf{W}_{lh} \mathbf{h}^{t-1} + \mathbf{W}_{lc} \mathbf{s}_c^{t-1} + \mathbf{w}_{ll} \odot \mathbf{x}_l^{t-1} + \mathbf{w}_{l\phi} \odot \mathbf{x}_\phi^{t-1} + \mathbf{w}_{l\omega} \odot \mathbf{x}_\omega^{t-1} \right) \\[1ex] \mathbf{x}_\phi^t &= \varphi_\phi\left( \mathbf{W}_{\phi i} \mathbf{x}^t + \mathbf{W}_{\phi h} \mathbf{h}^{t-1} + \mathbf{W}_{\phi c} \mathbf{s}_c^{t-1} + \mathbf{w}_{\phi l} \odot \mathbf{x}_l^{t-1} + \mathbf{w}_{\phi \phi} \odot \mathbf{x}_\phi^{t-1} + \mathbf{w}_{\phi \omega} \odot \mathbf{x}_\omega^{t-1} \right) \\[1ex] \mathbf{v}_c^t &= \mathbf{W}_{ci} \mathbf{x}^t + \mathbf{W}_{ch} \mathbf{h}^{t-1} \\[1ex] \mathbf{s}_c^t &= \mathbf{x}_l^t \odot f_c(\mathbf{v}_c^t) + \mathbf{x}_\phi^t \odot \mathbf{s}_c^{t-1} \\[1ex] \mathbf{x}_\omega^t &= \varphi_\omega\left( \mathbf{W}_{\omega i} \mathbf{x}^t + \mathbf{W}_{\omega h} \mathbf{h}^{t-1} + \mathbf{W}_{\omega c} \mathbf{s}_c^{t-1} + \mathbf{w}_{\omega l} \odot \mathbf{x}_l^t + \mathbf{w}_{\omega \phi} \odot \mathbf{x}_\phi^t + \mathbf{w}_{\omega \omega} \odot \mathbf{x}_\omega^{t-1} \right) \\[1ex] \mathbf{x}_c^t &= \mathbf{x}_\omega^t \odot g_c(\mathbf{s}_c^t) \end{align}$$

Official implementation

none