Convert a pytorch torch.nn custom module class to a diffusers style model

[nighting0le01]

Hi how can i convert my custom pure torch.nn.module model to be similar to diffusers model. I want to basically add my custom VAE and use with training a regular VAE.

[sayakpaul]

I don't think there will be much. You can follow this PR to get a rough understanding of what needs to be done:

#4384

[nighting0le01]

Thanks sayak, can you point me to some relevant documentation for this and also on how to incorporate my VAE into a custom pipeline? I would like to have 2 VAE Encoder and 2 VAE Decoder in the pipeline in the end. the VAE decoder is actually a Unet.

[sayakpaul]

This should be helpful: https://huggingface.co/docs/diffusers/main/en/using-diffusers/custom_pipeline_overview.