Assuming I could define a custom gradient for the nil embedding, the memory a.k.a variables A, B, TA, and TB can be in a separate memory component. The main benefit of this would be to more easily play around with different models around the memory.
Assuming I could define a custom gradient for the nil embedding, the memory a.k.a variables A, B, TA, and TB can be in a separate memory component.
The main benefit of this would be to more easily play around with different models around the memory.