New Features
- Gaudi Integration for Pytorch TLT Image Anomaly Detection
- Gaudi Integration for Pytorch TLT Image Classification (Disease Prediction)
- Enabled 58 torchvision models for compatibility with TLT Anomaly Detection
- Distributed fine tuning example with Slurm
- Enabled bfloat16 automatic option to Pytorch image classification models for training and inference
Bug Fixes / Improvements
- Updated TLT installer for better dependency management
- Added security context to Kubernetes Llama2 fine tuning template to allow running as a non-root user
- Updated the Hugging Face token to be volume mounted in to the container when fine tuning with Kubernetes
- Updated the Llama2 fine tuning Docker image to use Python 3.10 and updated library versions
Validated Configuration
- Ubuntu 20.04/22.04 LTS
- Intel® Optimization for TensorFlow 2.14.0
- Intel® Extension for PyTorch 2.2.0
- PyTorch 2.2.0
- TorchVision 0.17.0
- Intel® Neural Compressor 2.4.1
- TensorFlow Hub 0.15.0
Known Issues
- TLT distributed module currently has an issue with horovod installation due to torch version conflict.
- dinov2 models are enabled for image anomaly detection use case, but not currently compatible for training and inference yet
GitHub pages
https://intelai.github.io/transfer-learning/v0.7.0/
