Yann LeCun
@ylecun
@alain_co @heyshrutimishra Forcing the internal dynamics to be linear is overly restrictive, IMHO.
It requires a very large dimension for the state representation.
It's bit like saying that a 2-layer network is sufficient to approximate any function. It's trues, but impractical. In the end, you do need