From feaa5ff09ce1170b79a0cbc51bedc7d1b17bdeb7 Mon Sep 17 00:00:00 2001 From: Michael Abbott <32575566+mcabbott@users.noreply.github.com> Date: Wed, 6 Mar 2024 09:29:08 -0600 Subject: [PATCH] add a sentence comparing to freeze/thaw --- docs/src/training/training.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/src/training/training.md b/docs/src/training/training.md index 6dd80897b5..0370c86a3d 100644 --- a/docs/src/training/training.md +++ b/docs/src/training/training.md @@ -384,6 +384,9 @@ Flux.thaw!(opt_state) The earlier "implicit" equivalent was to pass to `gradient` an object referencing only part of the model, such as `Flux.params(bimodel.layers.enc)`. +While `adjust!` and `freeze!`/`thaw!` make temporary modifications to the optimiser state, +permanently removing some fields of a new layer type from training is usually done +when defining the layer, by calling for example [`@layer`](@ref Flux.@layer)` NewLayer trainable=(weight,)`. ## Implicit or Explicit?