Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: add new cylc workflow #194

Draft
wants to merge 75 commits into
base: jghrefactor/A2g-add-labeled-version-of-floes
Choose a base branch
from
Draft

feature: add new cylc workflow #194

wants to merge 75 commits into from

Commits on Nov 11, 2024

  1. add cylc flow file

    @hollandjg
    hollandjg committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    268e25a View commit details
    Browse the repository at this point in the history

  2. add rose-suite config

    @hollandjg
    hollandjg committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    573c870 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. fix IFT command

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    3ca97fa View commit details
    Browse the repository at this point in the history

  2. set working directory to share subdirectory

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    bdc588b View commit details
    Browse the repository at this point in the history

  3. remove pseudo-tty from docker call – ruined the logs

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    a76c2d8 View commit details
    Browse the repository at this point in the history

  4. update path for soit

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    7b5a614 View commit details
    Browse the repository at this point in the history

  5. re-add data_target path for batch processing version

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    c120443 View commit details
    Browse the repository at this point in the history

  6. update package version for sort shadowing

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    195ff2c View commit details
    Browse the repository at this point in the history

  7. add CLI test script readme

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    e5fd858 View commit details
    Browse the repository at this point in the history

  8. change working directory to work/

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    c607d84 View commit details
    Browse the repository at this point in the history

  9. fix path for tracker step

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    fae3eec View commit details
    Browse the repository at this point in the history

  10. add test case to cylc examples

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    04e9c91 View commit details
    Browse the repository at this point in the history

  11. add ne_greenland test configuration

    @hollandjg
    hollandjg committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    c41113a View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. add global cylc config file – limit number of jobs running locally

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    c02cc81 View commit details
    Browse the repository at this point in the history

  2. add configuration files for cylc testcases

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1e44751 View commit details
    Browse the repository at this point in the history

  3. add loading and saving of signed Integer images

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    93ff9c6 View commit details
    Browse the repository at this point in the history

  4. symlink the run directory

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    8be7960 View commit details
    Browse the repository at this point in the history

  5. add test of buckley processing

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    cbea83e View commit details
    Browse the repository at this point in the history

  6. simplify job inheritance

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    5777771 View commit details
    Browse the repository at this point in the history

  7. fix bug which occurs when using subdirectories

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b30186c View commit details
    Browse the repository at this point in the history

  8. update tracking for subdirectories

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1070510 View commit details
    Browse the repository at this point in the history

  9. remove extra variable definition

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a73ee3a View commit details
    Browse the repository at this point in the history

  10. remove extra newline

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    d598fbc View commit details
    Browse the repository at this point in the history

  11. make test script more generic 

    Each directory has files named the same way, so it's easy to run a processing batch on each
    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    3cbfcc7 View commit details
    Browse the repository at this point in the history

  12. extend date range on test case to 14th september

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    fa094ca View commit details
    Browse the repository at this point in the history

  13. update test cases

    @hollandjg
    hollandjg committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    481611f View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. add command line tool to colorize labeled images

    @hollandjg
    hollandjg committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    3e57ccc View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. rename label_colorizer

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    a7aa83b View commit details
    Browse the repository at this point in the history

  2. update fsdproc load to use "date" rather than "datetime"

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    fa8bd25 View commit details
    Browse the repository at this point in the history

  3. add randomization option

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    8d26b7e View commit details
    Browse the repository at this point in the history

  4. simplify cycle description with new names

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    b7a189d View commit details
    Browse the repository at this point in the history

  5. add a queue for the preprocess tasks – limit to one at once on my mac… 

    …hine
    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    4b59502 View commit details
    Browse the repository at this point in the history

  6. add colorize function to preprocessing

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    e11ff95 View commit details
    Browse the repository at this point in the history

  7. add global execution retry delays

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    676cc7a View commit details
    Browse the repository at this point in the history

  8. remnove extra newline

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    55a406d View commit details
    Browse the repository at this point in the history

  9. add limit to number of fetchdata

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    ac5e2b2 View commit details
    Browse the repository at this point in the history

  10. add new batch examples for fram-strait May 2020

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    a098979 View commit details
    Browse the repository at this point in the history

  11. add tqdm progress bar to colorizer

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    0168745 View commit details
    Browse the repository at this point in the history

  12. add python gitignore

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    738cd37 View commit details
    Browse the repository at this point in the history

  13. rename FETCHDATA to LOAD

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    67cf329 View commit details
    Browse the repository at this point in the history

  14. make subtask names lowercase

    @hollandjg
    hollandjg committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    4d53121 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. update retries so that SOIT, LOAD tasks get retried multiple times, p… 

    …reprocessing and tracking just once
    @hollandjg
    hollandjg committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    9b13b51 View commit details
    Browse the repository at this point in the history

  2. make sure max_value is an integer

    @hollandjg
    hollandjg committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    fe0a330 View commit details
    Browse the repository at this point in the history

  3. add colorize function to pipeline test

    @hollandjg
    hollandjg committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    70f4f98 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. Update IFTPipeline.jl/src/feature-extraction.jl 

    Co-authored-by: Carlos Paniagua <[email protected]>
    @hollandjg @cpaniaguam
    hollandjg and cpaniaguam authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    f312e41 View commit details
    Browse the repository at this point in the history

  2. Update IFTPipeline.jl/test/test-feature-extract.jl 

    Co-authored-by: Carlos Paniagua <[email protected]>
    @hollandjg @cpaniaguam
    hollandjg and cpaniaguam authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    9cd2d48 View commit details
    Browse the repository at this point in the history

  3. Update IFTPipeline.jl/test/test-feature-extract.jl 

    Co-authored-by: Carlos Paniagua <[email protected]>
    @hollandjg @cpaniaguam
    hollandjg and cpaniaguam authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    ff262b1 View commit details
    Browse the repository at this point in the history

  4. change back to main version of IceFloeTracker

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    f04717c View commit details
    Browse the repository at this point in the history

  5. fix duplicated end statement

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    13eeb0c View commit details
    Browse the repository at this point in the history

  6. rename "original" to "Lopez" preprocessing

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    0f3e578 View commit details
    Browse the repository at this point in the history

  7. move landmask recalculation into preprocessing – not needed for Buckley

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    12b70ef View commit details
    Browse the repository at this point in the history

  8. add rose-meta.conf

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e2c1950 View commit details
    Browse the repository at this point in the history

  9. reformat arguments for Lopez preprocessing – shorter lines

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    d29a3a4 View commit details
    Browse the repository at this point in the history

  10. update test readme

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    4aee9a8 View commit details
    Browse the repository at this point in the history

  11. add error checking for preprocessing type

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    d7f3f1b View commit details
    Browse the repository at this point in the history

  12. update default config for rose suite

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e66ff8a View commit details
    Browse the repository at this point in the history

  13. simplify looping logic

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    9b45ad5 View commit details
    Browse the repository at this point in the history

  14. update load image script and environment variables

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    b1dfe5d View commit details
    Browse the repository at this point in the history

  15. update queue comments

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    a3f3038 View commit details
    Browse the repository at this point in the history

  16. add installation arguments for each of the CLI tools

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    555ee8c View commit details
    Browse the repository at this point in the history

  17. remove duplicated fsdproc arguments

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    7b90cdf View commit details
    Browse the repository at this point in the history

  18. update metadata

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    2293fff View commit details
    Browse the repository at this point in the history

  19. lower runahead limit to 1

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    1a484e2 View commit details
    Browse the repository at this point in the history

  20. add missing line return escape

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    c4887e8 View commit details
    Browse the repository at this point in the history

  21. add explicit precompilation

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    d383f01 View commit details
    Browse the repository at this point in the history

  22. add architecture-specific precompilation to dockerfile

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    b79e7f8 View commit details
    Browse the repository at this point in the history

  23. rename preprocess_lopez (from _original)

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    ee38e92 View commit details
    Browse the repository at this point in the history

  24. add actual test of the container again

    @hollandjg
    hollandjg committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    4df19c6 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2024

  1. update feature-extration to use a mapping for conversion functions

    @hollandjg
    hollandjg committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    10792d4 View commit details
    Browse the repository at this point in the history

  2. fix type errors

    @hollandjg
    hollandjg committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    ce68a73 View commit details
    Browse the repository at this point in the history

  3. add Gray to map

    @hollandjg
    hollandjg committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    afa9905 View commit details
    Browse the repository at this point in the history

  4. fix type error

    @hollandjg
    hollandjg committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    be7c689 View commit details
    Browse the repository at this point in the history

  5. reduce repetition in test definitions

    @hollandjg
    hollandjg committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    5ea9a0e View commit details
    Browse the repository at this point in the history

  6. fix broken function definition

    @hollandjg
    hollandjg committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    234a43b View commit details
    Browse the repository at this point in the history

  7. Merge branch 'jghrefactor/A2g-add-labeled-version-of-floes' into jghr… 

    …efactor/A2h-add-new-cylc-workflow
    @hollandjg
    hollandjg authored Nov 26, 2024
    Configuration menu
    Copy the full SHA
    5f36e28 View commit details
    Browse the repository at this point in the history