Coupa Software Inc interview question

Explain the difference between RNN and a transformer.

Interview Answer

Anonymous

22 Dec 2022

RNN has variable length & is normally stacked deeper than a transformer. (RNN isn't truly bidirectional in its attention mechanism).