Allow optional strands

Contents (#118)

IMPORTANT: There is 1 breaking change.

New features

• Allow manifest and values schema strands to be optional

Operations

• Extend test matrix to python versions up to 3.11

Dependencies

• Remove flake8 and black dependencies

Refactoring

• 💥 BREAKING CHANGE: Remove unused allow_missing argument of Twine.validate

---

Upgrade instructions

💥 Remove unused `allow_missing` argument of `Twine.validate`

Remove use of the allow_missing argument in Twine.validate and set the optional field to true in the individual strands of the twine if required.

Switch to poetry and drop python3.7 support

Contents (#115)

Operations

• Switch to poetry for package management
• Use ruff instead of flake8, black, and isort
• Drop support for python3.7
• Stop using tox to test

Dependencies

• Add ruff dev dependency

Other

• Update copyright years

Loosen `jsonschema` dependency

Contents (#114)

Dependencies

• Allow jsonschema>=4,<5

Move children schema to strands remove use of deprecated module

Contents (#112)

Operations

• Add ReadTheDocs config file
• Fix codecov upload
• Use reusable workflows
• Test with python3.9 too
• Upgrade actions

Dependencies

• Fix documentation requirements

Refactoring

• Move children and manifest schemas to Strands

Fixes

• Fix accordion usage in docs
• Swap deprecated/removed pkg_resources for importlib

Use trusted publisher for PyPI

Contents (#110)

Operations

• Update workflows to use PyPI trusted publisher and run tests before release

Chores

• Update pre-commit config

Enable code scanning

Summary

Enable code security scanning and update CI workflows.

Contents (#109)

Operations

• Add codeql.yml workflow to enable code-scanning
• Use new octue/check-semantic-version and octue/generate-pull-request-description GitHub actions
• Update versions of other GitHub actions used in workflows

Chores

• Upgrade flake8 pre-commit hook

Update manifest schema

Contents (#108)

Fixes

• Update manifest schema to be compatible with files fields in serialised datasets and to remove outdated fields within serialised files

Remove deprecated code

Summary

Contents (#106)

IMPORTANT: There is 1 breaking change.

Refactoring

• 💥 BREAKING CHANGE: Removes the deprecated code that allowed datasets to still be provided as lists in manifests and manifest schemas.

Revert "Add output location strand"

Summary

Reverts #104.

Contents (#105)

Reversions

• Revert "Add output location strand"

Add output location strand

Summary

Add the ability to provide an output location in twine.json - this is a path to a Google Cloud Storage directory where all output datasets will be uploaded to.

Contents (#104)

New features

• Add output location strand