TRAK v0.2.0
Some (mild) backward incompatibilities introduced. In particular,
exp_name
is now a required argument when scoring.
What's Changed
-
handle pre-emption for featurizing
-
support scoring & featurizing data shards in parallel
-
reduce memory footprint by ~1.5x
-
migrate to torch.func
-
bump torch dep requirement to 2.0.0 because of torch.func
-
python >=3.8 for pytorch 2.0
-
project and store in float16 by default
-
tie experiment name to scoring targets; simplify saver; add logging
-
save scores as mmap
-
normalization factor for numerical stability
-
clean up quickstart
-
no-op projector
-
pass in an instance of a class for tasks, rather than init inside of gradientcomputer
-
bug fixes
New Contributors
@AlaaKhaddaj made their first contribution in #38
Full Changelog: v0.1.3...v0.2.0