Code

Prioritized replay buffer#175

Code

Merged

saleml merged 10 commits intomasterGFNOrg/torchgfn:masterfrom prioritized_replay_bufferGFNOrg/torchgfn:prioritized_replay_bufferCopy head branch name to clipboardApr 3, 2024

+178-17

Commits

Commits on Mar 30, 2024

• log_rewards are stored properly in the case that the external trajectory contains log_rewards and the internal trajectory is None (this can happen with empty initalized trajectory)

  josephdviviano

  committed
  e087f41

  Copy full SHA for e087f41

• can use either standard or prioritized replay buffer

  josephdviviano

  committed
  61f7fd2

  Copy full SHA for 61f7fd2

• added a prioritized replay buffer

  josephdviviano

  committed
  75e3198

  Copy full SHA for 75e3198

Commits on Mar 31, 2024

• bugfix on assert

  josephdviviano

  committed
  7449a92

  Copy full SHA for 7449a92

Commits on Apr 2, 2024

• removed self._index

  josephdviviano

  committed
  184c5f5

  Copy full SHA for 184c5f5

• trajectories and transitions now initalize log_rewards correctly, so extend always works, which means we no longer need the extra condition (but we are leaving in the sanity check for now).

  josephdviviano

  committed
  00cab17

  Copy full SHA for 00cab17

• small efficiency improvements to prioritized replay buffer

  josephdviviano

  committed
  a670356

  Copy full SHA for a670356

• changes to default settings for hypergrid

  josephdviviano

  committed
  213653c

  Copy full SHA for 213653c

• reworking of prioritized replay buffer logic

  josephdviviano

  committed
  04e50e9

  Copy full SHA for 04e50e9

• added comment

  josephdviviano

  committed
  5472055

  Copy full SHA for 5472055