You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, thanks for the great code base; it has been super useful for my work.
I noticed that by default, the RelevanceBasicBlock or RelevanceBottleneckLayers, in the case of identity residual the residual sent down the branch stream is zero.
By default, do you guys set that to zero, or in the final method, do you also use ratio-based splitting for the residual blocks with identitity?
Thanks again
-Ashwath
The text was updated successfully, but these errors were encountered:
Hi, thanks for the great code base; it has been super useful for my work.
I noticed that by default, the RelevanceBasicBlock or RelevanceBottleneckLayers, in the case of identity residual the residual sent down the branch stream is zero.
By default, do you guys set that to zero, or in the final method, do you also use ratio-based splitting for the residual blocks with identitity?
Thanks again
-Ashwath
The text was updated successfully, but these errors were encountered: