InvariantPointAttention v0.1.0
- Export
IPCrossA
andIPCrossAStructureModuleLayer
layers. - Export
IPA
andIPAStructureModuleLayer
layers, a special case of cross-attention, where the frames of the keys are the same as for the queries. - Export
BackboneUpdate
layer. - Export
right_to_left_mask
andleft_to_right_mask
functions. - Export
virtual_residues
function. - Export
softmax1
function.
Merged pull requests:
- Expand (#8) (@bicycle1885)
- Numerical stability tweaks (#9) (@murrellb)
- Adding softmax1 with optional use. (#10) (@murrellb)
- Softmax1 customgrad (#11) (@billera)
- Head scaling + clean up (#16) (@anton083)
Closed issues: