Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New external data pointers do not allow for individually-compressed files #37

Open
jamesrhester opened this issue Feb 22, 2022 · 0 comments

Comments

@jamesrhester
Copy link

proteindiffraction.org contains archives where the top-level downloadable file is a tar file, and the individual files are compressed using gzip or bzip2. This way of storing files is not anticipated by the external data pointer definitions, which assume that compression is performed on the overall archive only (e.g. tar.gz or tar.bz2). I propose adding a new column to array_data, _array_data.external_file_compression with enumerated values corresponding to common compression formats. Where the value for this attribute is not 'None', after a file has been downloaded and extracted it will be decompressed according to the specified format.

@jamesrhester jamesrhester changed the title New external data pointers does not allow for individually-compressed files New external data pointers do not allow for individually-compressed files Feb 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant