feat(datasets): Add Support Python 3.11 for kedro-datasets

[SajidAlamQB]

Description

Add Python 3.11 support for Kedro-datasets

Development notes

• Updated Github actions with new job that checks if plugin == kedro-datasets and adds 3.11 to the setup matrix if it does. This helps unit tests to run on python 3.11 only for kedro-datasets.

Checklist

• Opened this PR as a 'Draft Pull Request' if it is work-in-progress
• Updated the documentation to reflect the code changes
• Added a description of this change in the relevant RELEASE.md file
• Added tests to cover my changes

[astrojuanlu]

Collecting tables>=3.6 (from kedro-datasets==1.5.1)
  Downloading tables-3.7.0.tar.gz (8.2 MB)

weird! latest version is 3.8, and it definitely has precompiled wheels for 3.11 https://pypi.org/project/tables/3.8.0/#files

I can't reproduce locally:

docker run -it --rm --platform linux/amd64 python:3.11-slim bash
root@48174f6489bd:/# pip install "tables>=3.6"
Collecting tables>=3.6
  Downloading tables-3.8.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.5/6.5 MB 12.9 MB/s eta 0:00:00

you can try adding tables >= 3.8 ; python_version >= '3.11' (didn't test this syntax, but you get the idea)

[astrojuanlu]

Oh but earlier in the logs we see this:

Collecting tables>=3.6 (from kedro-datasets==1.5.1)
  Downloading tables-3.8.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.5 MB)

so, I think pip might be backtracking here because of some incompatibility.

Since this is ubuntu-latest, maybe you can do apt-get install libhdf5-dev, so even without a wheel the installation works. But I'd try the >=3.8 first so that we can identify where the incompatibility is coming from.

[astrojuanlu]

Welp, there seems to be some incompatibility with the dependencies 😬 After 47 minutes of heavy backtracking, still no solution https://github.com/kedro-org/kedro-plugins/actions/runs/5865409178/job/15902606193?pr=297

I contributed some additional logging to pip that made it to >= 23.1 pypa/pip#10937 and maybe it can help in this situation. My recommendation is to do pip install -vv (or alternatively, set the environment variable PIP_VERBOSE=2 https://pip.pypa.io/en/stable/topics/configuration/#environment-variables) so we can see the INFO: Will try a different candidate, due to conflict: messages.

[noklam]

Lgtm!

[ankatiyar]

Thanks @SajidAlamQB! ⭐

[astrojuanlu]

Fantastic job @SajidAlamQB and team 👏🏽