Skip to content

Commit

Permalink
GH-45204: [Integration][Archery] Remove skips for nanoarrow IPC compr…
Browse files Browse the repository at this point in the history
…ession ZSTD/uncompressible golden files (#45205)

### Rationale for this change

After apache/arrow-nanoarrow#693 , ZSTD compression is now supported in the nanoarrow IPC reader. The list of skips lives in archery, though, and I'd like those checks to run (here and on our own CI!).

### What changes are included in this PR?

The line skipping compression checks for nanoarrow IPC were modified to only skip lz4 (which is not yet implemented).

### Are these changes tested?

Yes, this code runs as part of the integration CI job. The skipped tester is not run in the Arrow repo, though (because of the "target implementations", which correctly doesn't include nanoarrow here); however, the changes are tested in apache/arrow-nanoarrow#704 .

(That PR will need to merge before this one because this PR updates the nanoarrow build script in a way will cause the integration job to fail before that PR is merged)

### Are there any user-facing changes?

No!
* GitHub Issue: #45204

Lead-authored-by: Dewey Dunnington <[email protected]>
Co-authored-by: Dewey Dunnington <[email protected]>
Signed-off-by: Dewey Dunnington <[email protected]>
  • Loading branch information
paleolimbot authored Jan 10, 2025
1 parent d0b11bb commit 913cb58
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 2 deletions.
3 changes: 2 additions & 1 deletion ci/docker/conda-integration.dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,8 @@ RUN mamba install -q -y \
maven=${maven} \
nodejs=${node} \
yarn=${yarn} \
openjdk=${jdk} && \
openjdk=${jdk} \
zstd && \
mamba clean --all --force-pkgs-dirs

# Install Rust with only the needed components
Expand Down
5 changes: 4 additions & 1 deletion ci/scripts/nanoarrow_build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,10 @@ set -x
mkdir -p ${build_dir}
pushd ${build_dir}

cmake ${source_dir} -DNANOARROW_IPC=ON -DNANOARROW_BUILD_INTEGRATION_TESTS=ON
cmake ${source_dir} \
-DNANOARROW_IPC=ON \
-DNANOARROW_IPC_WITH_ZSTD=ON \
-DNANOARROW_BUILD_INTEGRATION_TESTS=ON
cmake --build .

popd
1 change: 1 addition & 0 deletions dev/archery/archery/integration/runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -200,6 +200,7 @@ def _gold_tests(self, gold_dir):
skip_testers.add("Rust")
if prefix == '2.0.0-compression':
skip_testers.add("JS")
if prefix == '2.0.0-compression' and 'lz4' in name:
# https://github.com/apache/arrow-nanoarrow/issues/621
skip_testers.add("nanoarrow")

Expand Down

0 comments on commit 913cb58

Please sign in to comment.