Code

Fix generation with large sequences#2561

Code

Merged

vince62s merged 6 commits intoOpenNMT:masterOpenNMT/OpenNMT-py:masterfrom l-k-11235:fix-generation-with-large-sequencesl-k-11235/OpenNMT-py:fix-generation-with-large-sequencesCopy head branch name to clipboardFeb 22, 2024

+31-30

Commits

Commits on Feb 13, 2024

• fixed a bug in generation when the sequence is larger than 2048 tokens

  l-k-11235

  committed
  54514b8

  Copy full SHA for 54514b8

• fixed the dynamic resizing of rotary embeddings

  l-k-11235

  committed
  b7e8b8f

  Copy full SHA for b7e8b8f

Commits on Feb 21, 2024

• refactored dynamic resizing of rotary embeddings

  l-k-11235

  committed
  23c94bb

  Copy full SHA for 23c94bb

• resize only if the sequence is too long

  l-k-11235

  committed
  3f06486

  Copy full SHA for 3f06486

Commits on Feb 22, 2024

• some code cleaning

  l-k-11235

  committed
  9250a5a

  Copy full SHA for 9250a5a

• removed samples

  l-k-11235

  committed
  36c4f6e

  Copy full SHA for 36c4f6e