ResponseStreamReader does not handle chunked encoding

[markpatton]

We've had an issue with Water Butler being unable to read streams with chunked encoding.

If you look at the constructor of ResponseStreamReader(BaseStream) in waterbutler/core/streams/http.py you will see that if size is None and unsizable is False, the attempt to turn size into an int will fail. This seems to happen with chunked encoding. As a workaround for our testing, we just set self._size to None in that circumstance.

[felliott]

Thanks, @markpatton!

That unsizable flag seems to be some leftover code from a long time ago. The only place where I could find it being used was here, and that code doesn't do that anymore. I'm not sure what the correct behavior is here yet, but I'll look into it.

Cheers,
@felliott

[felliott]

Update: this should be fixed in the next release of WaterButler.