Adding MobileVIT Model [WIP]

[shivance]

This PR adds the mobilevit model to Metalhead.

See this issue : #112

PR Checklist

• Tests are added
• Documentation, if applicable

[shivance]

@darsnack it's initial commit. I'm still working on it.

I find official implementation of mobilevit in apple/cvnets .
They have defined a config file to name all the layers and all their specs, and explicitly coded mobilevit class here.

What design pattern should I follow ?

[shivance]

@darsnack how can I reuse metalhead's mobilenetv2 layers in mobilevit ? Could you redirect me to a particular method?

I downloaded mobilevit-small from huggingface and printed the model in pytorch. The whole description of model is here. At this stage I'm finding it little bit hard to progress. Confused about where to begin with.