Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the network inflation factors #7

Open
hex0102 opened this issue Jul 5, 2018 · 4 comments
Open

About the network inflation factors #7

hex0102 opened this issue Jul 5, 2018 · 4 comments

Comments

@hex0102
Copy link

hex0102 commented Jul 5, 2018

As I find out in the code, layers in VGG network, ResNet have an inflation factor.
Could someone please help clarify this?
Why need to inflate the network? Is there a reference to address this question?
I also checked the tensorflow repo for the BNN network, there's no inflation factor.

@itayhubara
Copy link
Owner

you don't have to inflate the network but it improves accuracy. WRPN paper: https://arxiv.org/abs/1709.01134

@hex0102
Copy link
Author

hex0102 commented Jul 5, 2018

@itayhubara Thank you very much for your quick reply and help. The reference is really useful.
I'm checking out this paper.

@hex0102
Copy link
Author

hex0102 commented Aug 16, 2018

@itayhubara It seems like that for VGG_CIFAR10, the attained accuracy for the inflated network doesn't improve very much (limited to 1%). Are there any reasons to explain this?

@itayhubara
Copy link
Owner

VGG_CIFAR10 is a very large network to begin with...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants