Skip to content

Multiplicative interactions #138

Description

@MartinuzziFrancesco

Paper

https://openreview.net/pdf?id=rylnK6VtDH

Equations

This modification would use the following forward pass instead of the usual one:

$$\begin{equation} f(\mathbf{x}, \mathbf{h}) = \mathbf{h}^\top \mathbf{W} \mathbf{x} + \mathbf{h}^\top \mathbf{U} + \mathbf{V} \mathbf{x} + \mathbf{b} \end{equation}$$

The idea would be to make it generic, following #5

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions