Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release version 1.5.0 #751

Merged
merged 72 commits into from
Sep 6, 2023
Merged

Release version 1.5.0 #751

merged 72 commits into from
Sep 6, 2023

Conversation

mlubej
Copy link
Contributor

@mlubej mlubej commented Sep 6, 2023

No description provided.

zigaLuksic and others added 30 commits May 26, 2023 11:38
* fix remaining annotations to new-style

* Add required import rule
* add and register new pytest flag

* disable geopedia tests in ci
* separate lazy-loading mechanism from actual loading

* move gzip functionality to separate subclass

* separate file-ending checks

* reorder decorators

* switch away from mimetypes for extensions

* add forgotten test fix

* rename to `_check_path_extension`
* add zarr extra

* add the FeatureIOZarr

* reorder and expand error message

* improve fs switching

* add zarr flags to appropriate methods

* remove redundant defaults

* adapt tests to also check for zarr

* make `remove_redundant_files` more blackboxy for the greater good

* add test for checking that numpy and zarr files overwrite eachother

* add test that different bakends still detect collisions

* fix S3 issues

* add test that ensures that mixed eopatches load properly

* add zarr tests to 3.9

* add missing annotation

* try different approach to CI

* add missing skips

* Update core/eolearn/core/eodata_io.py

Co-authored-by: Matic Lubej <[email protected]>

* use utility for getting full path from filesystem

* add utility for path splitting

* use the utility function

* fix double . issue

---------

Co-authored-by: Matic Lubej <[email protected]>
* add tests for partial loading

* add test for merging

* propagate temporal selection all the way to the FeatureIO objects

* make test cover all types

* implement partial loading

* adjust comment to avoid pylint

* remove test that is outside current scope

* fix test so ti works :D

* Update core/eolearn/tests/test_eodata_merge.py

Co-authored-by: Matic Lubej <[email protected]>

---------

Co-authored-by: Matic Lubej <[email protected]>
* add some basic tests

* adjust tests with new knowledge

* extend EOPatch signature

* make passing arguments easier

* refactor saving

* remove partial saving stuff, future MR

* some final polish
* add tests

* propagate parameters to right locations

* fix consolidate_timestamps

* make it work for zarr

* fix chunkies and make it work on S3

* last adjustments

* remove unneeded parameters
* rename old approach

* make it work

* add test

* clean up old-style files at save

* final polish

* add another meta_info test case
* adjust times and add explicit getter

* remove issues outside of merging

* fix timestamp consolidation

* fix merging

* fix type issues

* add custom message.

* Apply suggestions from code review

Co-authored-by: Matic Lubej <[email protected]>

* fix merging edgecase and add test

* apply linters

---------

Co-authored-by: Matic Lubej <[email protected]>
* add parameters to methods and core tasks

* revert save_timestamps option for future MR

* refactor load_eopatch_content
* thread parameters into functions

* add tesst

* add test for loading

* implement for saving

* fix loading

* also do adjustments for copy tasks
* Adjust statistics for clustering in 3.11

* apply to 3.10 as well

* apparently on 3.8 is same

* apparently messed something up in the initial testing

* finally fix 3.8 issue
* implement checkers

* fix more warnings in tests

* add more tests and fix init

* upgrade tests a bit further

* get rid of the annoying REFERENCE_SCENES in the test patch

* specialize warning

* fix remaining tests in core

* remove warnings from raster_io

* remove rest of warnings

* remove default value for temporal dim

* updating the temporal dim skips validation for timeless dicts

* remove redundant ignore-warnings

* Update core/eolearn/tests/test_core_tasks.py

Co-authored-by: Matic Lubej <[email protected]>

---------

Co-authored-by: Matic Lubej <[email protected]>
* extend types in core functions

* add test

* implement

* fix type issues

* extract function

* avoid double loading of timestamps

* add option to infer when partially saving

* correct annotation
* add test

* improve and fix test

* add implementation

* rename InferredSelection to TemporalSelection
* deprecate deepcopytask

* deprecate some interpolation tasks

* deprecate superpixel tasks
* fix lightgbm version

* correct types in cloud mask task

* remove redundant annotation
Matic Lubej and others added 26 commits August 25, 2023 15:32
* add requirement to mask requirements

* use utility from s2cloudless, remove unnecessary methods

* add s2c requirement to pyproject.toml
* add test for explicit loading of nonexistant timestamps

* fix implementation
* introduce Feature type alias

* fix meteoblue (issue due to nonstandard import)
* adjust the core example

* update time-lapse notebook

* adjust io example

* remove bbox plotting in visualization example

* adjust mask and land-cover examples

* Reer

* minor edits

---------

Co-authored-by: Matic Lubej <[email protected]>
* update tests for erosion

* add morphological filter regression tasks

* remove usage of skimage in morphology

* update tests

---------

Co-authored-by: Ziga Luksic <[email protected]>
* use cv2_disk from s2cloudless, remove unnecessary code

* use cv2_disk from cv2 for snow masking

* fix types after change

* revert legacy task
* Inline **kwargs in sampling

* Inline kwargs for tiff tasks
* remove compress_level parameter from usable functions

* update savers, hard-code compression values

* remove compression param from tests

* fix compression-related tests

* formatting + linters

* add deprecation warnings when `compress_level` param is used

* add test for compression deprecation

* add test for compression cleanup and backwards compatibility

* review comments

* add backwards compatibility test for loading uncompressed data
* remove redundant versions

* process features extras

* process mask extras

* fix pyproject extra
* prepare core

* adjust remaining READMEs

* adjust installed subpackages

* slight tweaks to setup.py files

* correct setup.py and remove interpackage deps

* detect deprecated packages
* remove features tasks

* clean geometry

* clean ml_tools

* clean geometry and mask

* clean io

* remove meteoblue

* adjust requirements and remove lgbm models

* remove geopedia task as well

* remove sen2core

* remove ClassifierType
…744)

* inline `BaseVectorImportTask`

* remove deprecated `ml_tools.utils`
* updates to the eo-learn readme

* readme improvements

* update extra dependency list, mention extra-tasks in eo-learn-examples

* Update README.md

Co-authored-by: Žiga Lukšič <[email protected]>

* resolve review comments

* remove brackets

* shorten list

---------

Co-authored-by: Žiga Lukšič <[email protected]>
…#746)

* make sure extra submodules are included when collecting list of tasks

* add deprecation note into docstrings

* fix copy task docstring
* simplify extras

* update version

* correct error messages

* add changelog info
@codecov-commenter
Copy link

codecov-commenter commented Sep 6, 2023

Codecov Report

Patch coverage: 95.27% and project coverage change: +3.59% 🎉

Comparison is base (7706787) 88.79% compared to head (5fbdbb8) 92.38%.
Report is 1 commits behind head on master.

❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the GitHub App Integration for your organization. Read more.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #751      +/-   ##
==========================================
+ Coverage   88.79%   92.38%   +3.59%     
==========================================
  Files          57       41      -16     
  Lines        5454     4270    -1184     
==========================================
- Hits         4843     3945     -898     
+ Misses        611      325     -286     
Files Changed Coverage Δ
eolearn/core/eoexecution.py 92.00% <ø> (ø)
eolearn/core/utils/types.py 0.00% <0.00%> (ø)
eolearn/visualization/eoworkflow.py 94.28% <ø> (ø)
eolearn/visualization/utils.py 0.00% <0.00%> (ø)
eolearn/coregistration/coregistration.py 88.46% <33.33%> (ø)
eolearn/features/utils.py 89.88% <70.58%> (ø)
eolearn/io/geometry_io.py 82.05% <87.50%> (ø)
eolearn/core/eoworkflow.py 95.67% <90.47%> (ø)
eolearn/geometry/morphology.py 96.96% <92.85%> (ø)
eolearn/core/eodata_io.py 93.91% <93.91%> (ø)
... and 31 more

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Matic Lubej and others added 2 commits September 6, 2023 16:06
* avoid underscore in extras

* switch to single extra extra

---------

Co-authored-by: Ziga Luksic <[email protected]>
@zigaLuksic zigaLuksic merged commit 83f14c7 into master Sep 6, 2023
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants