Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Dependency Versions #233

Merged
merged 18 commits into from
Nov 6, 2024
Merged

Update Dependency Versions #233

merged 18 commits into from
Nov 6, 2024

Conversation

drewm-jpl
Copy link
Collaborator

@drewm-jpl drewm-jpl commented Nov 4, 2024

Purpose

Update project dependencies and infrastructure components to their latest stable versions to ensure security patches, bug fixes, and new features are incorporated while maintaining compatibility across the system.

Proposed Changes

Infrastructure Updates

-[CHANGE] Terraform version from 1.8.2 to 1.8.5
-[CHANGE] Karpenter Helm chart from 0.36.1 to 1.0.2
-[CHANGE] Airflow Helm chart from 1.13.1 to 1.15.0
-[CHANGE] KEDA Helm chart from v2.14.2 to v2.15.1
-[CHANGE] PostgreSQL version from 13.13 to 16.4
-[CHANGE] Karpenter module from 20.8.5 to 20.24.1

Provider Updates

-[CHANGE] AWS provider from 5.50.0 to 5.67.0
-[CHANGE] Kubernetes provider from 2.29.0 to 2.32.0
-[CHANGE] Helm provider from 2.13.1 to 2.15.0
-[CHANGE] Null provider from 3.2.2 to 3.2.3
-[CHANGE] Time provider from 0.11.1 to 0.12.1

Application Updates

-[CHANGE] Default DAG catalog repo reference from 'develop' to '2.2.0'
-[CHANGE] Python test dependencies:

  • pytest (8.0.2 → 8.3.3)
  • pytest-bdd (7.1.1 → 7.2.0)
  • pytest-mock (3.12.0 → 3.14.0)
  • requests (2.31.0 → 2.32.3)
  • aws-lambda-powertools (2.36.0 → 2.41.0)

Issues

#224

Testing

Tested Karpenter node provisioning with updated version
Verified Airflow deployment and DAG execution with new Helm chart
Confirmed PostgreSQL upgrade path and data migration
Ran full test suite with updated Python dependencies
Tested on AWS environment with EKS cluster version 1.27

Notes

Special attention required for:

  1. Karpenter upgrade (major version change)
  2. PostgreSQL upgrade (major version change)
    Changes to Karpenter API versions in manifests

dependabot bot and others added 18 commits July 12, 2024 16:33
Bumps [pytest-mock](https://github.com/pytest-dev/pytest-mock) from 3.12.0 to 3.14.0.
- [Release notes](https://github.com/pytest-dev/pytest-mock/releases)
- [Changelog](https://github.com/pytest-dev/pytest-mock/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest-mock@v3.12.0...v3.14.0)

---
updated-dependencies:
- dependency-name: pytest-mock
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [requests](https://github.com/psf/requests) from 2.31.0 to 2.32.3.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.31.0...v2.32.3)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [pytest-bdd](https://github.com/pytest-dev/pytest-bdd) from 7.1.1 to 7.2.0.
- [Release notes](https://github.com/pytest-dev/pytest-bdd/releases)
- [Changelog](https://github.com/pytest-dev/pytest-bdd/blob/master/CHANGES.rst)
- [Commits](pytest-dev/pytest-bdd@7.1.1...7.2.0)

---
updated-dependencies:
- dependency-name: pytest-bdd
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [apache-airflow-providers-cncf-kubernetes](https://github.com/apache/airflow) from 8.3.2 to 8.4.1.
- [Release notes](https://github.com/apache/airflow/releases)
- [Changelog](https://github.com/apache/airflow/blob/main/RELEASE_NOTES.rst)
- [Commits](apache/airflow@providers-cncf-kubernetes/8.3.2...providers-cncf-kubernetes/8.4.1)

---
updated-dependencies:
- dependency-name: apache-airflow-providers-cncf-kubernetes
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [pytest](https://github.com/pytest-dev/pytest) from 8.0.2 to 8.3.3.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@8.0.2...8.3.3)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
…ow-providers-cncf-kubernetes-8.4.1' into release-prep
@drewm-jpl drewm-jpl changed the title Release prep Update Dependency Versions Nov 4, 2024
@LucaCinquini LucaCinquini self-assigned this Nov 5, 2024
Copy link
Collaborator

@LucaCinquini LucaCinquini left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I redeployed and tested, it all worked. Please merge into devel. Must notify @jpl-btlunsfo that this PR upgrades Terraform to 1.8.5.

@drewm-jpl drewm-jpl merged commit 0c528bc into develop Nov 6, 2024
2 checks passed
@drewm-jpl drewm-jpl deleted the release-prep branch November 6, 2024 16:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants