Fixes vit_jax_augreg Colab.

1. Flax introduced a new format for GroupNorm weights in checkpoints (google/flax#1721) which is fixed with the added `_fix_groupnorm()`. 2. It was reported in #249 that passing a list as argument does not work anymore. This has been fixed by converting the EagerTensor to a numpy array and adding the batch dimension via fancy indexing. PiperOrigin-RevId: 487740672
google-research · Nov 11, 2022 · 0d80400 · 0d80400
1 parent 60104c1
commit 0d80400
Show file tree

Hide file tree

Showing 2 changed files with 781 additions and 779 deletions.
diff --git a/vit_jax/checkpoint.py b/vit_jax/checkpoint.py
@@ -135,6 +135,8 @@ def load(path):
   params = checkpoints.convert_pre_linen(recover_tree(keys, values))
   if isinstance(params, flax.core.FrozenDict):
     params = params.unfreeze()
+  if version.parse(flax.__version__) >= version.parse('0.3.6'):
+    params = _fix_groupnorm(params)
   return params