Beam Search for seq2seq decoder?

Is there an implementation of beam search available for use inside a seq2seq model’s decoder?

Right now I’m just using greedy decoding to predict the next token, but I’ve heard folks extolling the virtues of beam search and so I’m just wondering if anything is in the framework now, or if not, if any folks can share how they are implementing beam search in seq2seq.

1 Like