Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to python 3.12, pandas 2.1.2 #713

Merged
merged 6 commits into from
Oct 31, 2023
Merged

Update to python 3.12, pandas 2.1.2 #713

merged 6 commits into from
Oct 31, 2023

Conversation

visr
Copy link
Member

@visr visr commented Oct 31, 2023

Part of #654
Fixes #645

I ran pixi add pandas=2.1.2 python=3.12 pyogrio=0.7.2 using pixi v0.5.0 so as not to update the lockfile format.

The new pyogrio release is needed to be able to use Python 3.12. We only update the Python version in the Pixi lockfile and on CI, this does not change our minimum supported Python version.

The pandas update to 2.1.2 fixes a regression present in 2.1.0 and 2.1.1, no further changes were needed in our code.

@Hofer-Julian I simply removed the pandas < 2.1 restriction in the pyproject.toml, assuming that is fine since with the release of pandas 2.1.2 most people won't get 2.1.0 or 2.1.1 anymore, though I guess we could exclude multiple patch releases.

Fixes #654
Fixes #645

I ran `pixi add pandas=2.1.2 python=3.12 pyogrio=0.7.2` using pixi v0.5.0 so as not to update the lockfile format.

The new pyogrio release is needed to be able to use Python 3.12. We only update the Python version in the Pixi lockfile and on CI, this does not change our minimum supported Python version.

The pandas update to 2.1.2 fixes a regression present in 2.1.0 and 2.1.1, no further changes were needed in our code.
@visr visr requested a review from Hofer-Julian October 31, 2023 10:15
Copy link
Contributor

@Hofer-Julian Hofer-Julian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks mostly good to me.
But tests are still failing

pixi.toml Outdated Show resolved Hide resolved
visr added 4 commits October 31, 2023 14:12
Just like in the pixi tasks.

pip was failing to build pyarrow in CI.
This reverts commit 37fa611.

The deps are needed since we don't use pixi here.
@visr
Copy link
Member Author

visr commented Oct 31, 2023

Locally tests pass for me, but that is using the pixi environment. On CI we don't use pixi yet but pip, leading to ERROR: Failed building wheel for pyarrow.

@Hofer-Julian
Copy link
Contributor

Locally tests pass for me, but that is using the pixi environment. On CI we don't use pixi yet but pip, leading to ERROR: Failed building wheel for pyarrow.

pyarrow doesn't provide python 3.12 wheels yet.
Seems like we have to wait for that.

@visr
Copy link
Member Author

visr commented Oct 31, 2023

Ok support for that is merged upstream, we just need to wait for a pyarrow 14 release on PyPI.
https://pypi.org/project/pyarrow/#history

@Hofer-Julian
Copy link
Contributor

Ok support for that is merged upstream, we just need to wait for a pyarrow 14 release on PyPI. https://pypi.org/project/pyarrow/#history

I'd be fine with only merging the pixi part and start testing 3.12 for Ribasim Python as soon as the pyarrow wheels for 3.12 are out.

@visr visr mentioned this pull request Oct 31, 2023
@visr
Copy link
Member Author

visr commented Oct 31, 2023

Sounds good, done. I kept pre-commit CI on 3.12 as well since that is also working fine.

@visr visr requested a review from Hofer-Julian October 31, 2023 16:32
@Hofer-Julian Hofer-Julian merged commit 84d44b6 into main Oct 31, 2023
15 checks passed
@Hofer-Julian Hofer-Julian deleted the py312 branch October 31, 2023 18:27
@visr visr mentioned this pull request Nov 3, 2023
4 tasks
visr added a commit that referenced this pull request Nov 13, 2023
Part of #654
Fixes #645

I ran `pixi add pandas=2.1.2 python=3.12 pyogrio=0.7.2` using pixi
v0.5.0 so as not to update the lockfile format.

The new pyogrio release is needed to be able to use Python 3.12. We only
update the Python version in the Pixi lockfile and on CI, this does not
change our minimum supported Python version.

The pandas update to 2.1.2 fixes a regression present in 2.1.0 and
2.1.1, no further changes were needed in our code.

@Hofer-Julian I simply removed the `pandas < 2.1` restriction in the
pyproject.toml, assuming that is fine since with the release of pandas
2.1.2 most people won't get 2.1.0 or 2.1.1 anymore, though I guess we
could exclude multiple patch releases.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Start supporting pandas >=2.1
2 participants