Skip to content

Commit

Permalink
Update to DataFusion 36 and Arrow 50 (#457)
Browse files Browse the repository at this point in the history
* Update to DataFusion 33

* Fix result

* Update to datafusion 34

* Update to datafusion 35, arrow 50, sqlparser 0.41

* Update to datafusion 35+ on datafusion main

* fmt

* Fix warnings

* Fix SQL list generation

* Update vegafusion-sql

* Update vegafusion-sql

* Update to datafusion 36.0.0rc1

* Bump manylinux to 2.17

* isnan was moved to datafusion-functions

* Update test

* Revert "Update test"

This reverts commit d474eb2.

* preserve order

* fix cargo warning

* replace custom make_list udf with built-in

* use datafusion array and character length functions

* Move length into array module

* Add draft span implementation with DataFusion built-ins

DataFusion doesn't know how to simplify it yet, which breaks our scalar value evaluation.

* fmt

* Update SpanUDF to use ScalaUDFImpl

* Update IndexOfUDF to use ScalaUDFImpl

* Update IsFiniteUDF to use ScalaUDFImpl

* delete old length

* Update member accessor UDFs to use ScalarUDFImpl

* Update object constructor to use ScalarUDFImpl

* Clean up warnings

* Update data_add_tz to use ScalarUDFImpl

* Convert more UDFs to use ScalarUDFImpl

* Convert remaining UDFs to use ScalarUDFImpl

* clippy fix

* Fix isFinite udf

* length should return f64

* Bump manylinux to 2.24

* Only bump manylinux for arm64

* cargo update

* reverts

* bump maturin action and manylinux for aarch64

* Make use of protobuf-src optional in VegaFusion server

* fix feature flag switch

* switch from dssim to pixelmatch crate for test image comparison

* Update datafusion protobuf
  • Loading branch information
jonmmease authored Feb 26, 2024
1 parent 2c24c3f commit 2781aad
Show file tree
Hide file tree
Showing 117 changed files with 4,709 additions and 3,422 deletions.
6 changes: 3 additions & 3 deletions .github/workflows/build_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@ jobs:
with:
cache-on-failure: True
- name: Build wheels (Linux)
uses: messense/maturin-action@9357a23898d2fca5ef8da7ac38aaaedab4ef218f # pin@v1.40.2
uses: messense/maturin-action@60d11847b29f81ca5375519a8eb33cc336ba4bfa # pin@v1.41.1
with:
command: build
manylinux: 2014
Expand Down Expand Up @@ -137,10 +137,10 @@ jobs:
run: |
rustup target add aarch64-unknown-linux-gnu
- name: Build arm64 wheels
uses: messense/maturin-action@6d52485c3b3044e20b4c8ee6ce6f61e20a7645b0 # pin@v1
uses: messense/maturin-action@60d11847b29f81ca5375519a8eb33cc336ba4bfa # pin@v1.41.1
with:
command: build
manylinux: 2014
manylinux: 2_28
rust-toolchain: stable
args: --release -m vegafusion-python-embed/Cargo.toml --features=protobuf-src --strip --target aarch64-unknown-linux-gnu
- name: Upload artifacts
Expand Down
Loading

0 comments on commit 2781aad

Please sign in to comment.