May 2020
tl;dr: A new plug-and-play module of SKNet. Two-stream SENet.
This is a solid work to extend SENet (squeeze and excitation). It chooses adaptive receptive field. Either 3x3 or 5x5.
Compared to inception network, which has multiple parallel path of diff RF, SKNet adaptively chooses which path to focus more.
This inspired ResNeSt and is actually almost exactly the same.
- Split, Fuse and Select.
- SK Unit is a plug-and-play module and used to replace a normal 3x3 conv.
- 5x5 --> 3x3 with dilation = 2.
- Questions and notes on how to improve/revise the current work