Describe C-COIL approach

[joshdevins]

Just wondering if you could add somewhere a description of your MS MARCO submission "C-COIL + RoBERTa" from 14/07/2021. Which modifications to COIL have you made and what was the motivation?

[luyug]

I have planned to write a tutorial on that submission but have been distracted by other projects. I hope to get it done as soon as possible, at least by the end of the week. Let's leave this issue open; feel free to ping me if you don't hear from me.

[hguan6]

Hi Luyu. Can you send a copy of your C-COIL initializer paper to my email: [email protected]? I suppose your coCondenser can also be used to initialize COIL. Did you try coCondenser+COIL? Does it improve COIL?

[joshdevins]

Or add it to the repo/README: https://github.com/luyug/COIL/tree/main/examples/c-coil

[luyug]

Hello, thanks for reminding me on this! C-COIL is actually Condenser + COIL and the Condenser paper is no longer under review. https://arxiv.org/abs/2104.08253

We have not done experiments with coCondenser initialized COIL, partly because coCondenser can achieve okay performance on its own being a dense retriever and partly because of our limited GPU resource. I think such experiments are definitely interesting but the question is whether we can build better software/infrastructure to support COIL.

[joshdevins]

Maybe just link to https://github.com/luyug/COIL/tree/main/examples/c-coil from the main README then since there's no mention of C-COIL there. Then we can close this issue probably.