Skip to content

Commit

Permalink
Dense layer does not need to store output for backward pass.
Browse files Browse the repository at this point in the history
  • Loading branch information
james-choncholas committed Oct 24, 2024
1 parent d431069 commit 55508ed
Showing 1 changed file with 0 additions and 3 deletions.
3 changes: 0 additions & 3 deletions tf_shell_ml/dense.py
Original file line number Diff line number Diff line change
Expand Up @@ -87,15 +87,12 @@ def call(self, inputs, training=False):
if self.activation is not None:
outputs = self.activation(outputs)

self._layer_output = outputs

return outputs

def backward(self, dy, rotation_key):
"""dense backward"""
x = self._layer_input
z = self._layer_intermediate
y = self._layer_output
kernel = self.weights[0]
grad_weights = []

Expand Down

0 comments on commit 55508ed

Please sign in to comment.