Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Neural codec bitstreaming POC #6

Open
johndpope opened this issue Oct 1, 2024 · 0 comments
Open

Neural codec bitstreaming POC #6

johndpope opened this issue Oct 1, 2024 · 0 comments

Comments

@johndpope
Copy link

johndpope commented Oct 1, 2024

just looking for some high level insights -
i skimmed in the paper that you were doing testing with IMF bit streaming....
what language did you build that out in? rust? wasm? c++ or??

if i was to build a codec for academic purposes - is your first call to go web?

there seems to be demand for good streaming in this space - and the IMF model seems like SOTA.
you didn't attempt to go 1024x1024 ? would it mean doubling the m latent -> 32 -> 64?

Im confused how the model would be pushed down to the client - when i did some training - it was 2gb.
this technology has to pre-download the model - then the streaming is fine....

thanks for any insights
if there's any open source projects that could help - i'm all ears.
i did see this for webcodecs
https://github.com/w3c/webcodecs/tree/main/samples

johndpope/IMF#38

UPDATE - I did some digging and found this NVC repo
microsoft/DCVC#63

did you use an onnx deployed to browser ? or just local python and consume streaming locally and run tests?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant