maskless_step
and maskless_backward_step
should throw an error if you don't return a tensor
#145
Labels
enhancement
New feature or request
Right now when writing environments, it's quite natural to manipulate the states object in place, and return the modified state. However the
Env
class expects aTensor
to be returned, not aStates
class instance.E.g.,:
throws a bug downstream,
The fix is simply to return
states.tensor
.The text was updated successfully, but these errors were encountered: