Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempting to fetch too many images from the archive leads to an error #36

Open
LTDakin opened this issue Oct 4, 2024 · 0 comments
Open
Labels
bug Something isn't working

Comments

@LTDakin
Copy link
Contributor

LTDakin commented Oct 4, 2024

[2024-10-04 19:00:52,507] [PID 97990] [Thread-4] [root] [INFO] Executing stacking operation on 13 files
[2024-10-04 19:06:09,689] [PID 97990] [Thread-4] [root] [ERROR] <urlopen error retrieval incomplete: got only 39927378 out of 67115520 bytes>
Traceback (most recent call last):
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/tasks.py", line 23, in execute_data_operation
    operation_class(input_data).operate()
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/data_operations/stacking.py", line 52, in operate
    image_data_list = self.get_fits_npdata(input_files)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/data_operations/data_operation.py", line 109, in get_fits_npdata
    fits_path = get_fits(file_info['basename'], file_info['source'])
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ldakin/Desktop/PTR_dev/ptr_datalab/datalab/datalab_session/s3_utils.py", line 138, in get_fits
    urllib.request.urlretrieve(fits_url, basename_file_path)
  File "/opt/homebrew/Cellar/[email protected]/3.11.9_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/urllib/request.py", line 280, in urlretrieve
    raise ContentTooShortError(
urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 39927378 out of 67115520 bytes>
@LTDakin LTDakin added the bug Something isn't working label Oct 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant