Code

Implement from_json_to_structs#2510

Code

Merged

ttnghia merged 86 commits intoNVIDIA:branch-24.12NVIDIA/spark-rapids-jni:branch-24.12from ttnghia:convert_tablettnghia/spark-rapids-jni:convert_tableCopy head branch name to clipboardNov 23, 2024

+1,309-134

Commits

Commits on Oct 16, 2024

• Implement castStringsToBooleans

  Show description for 1376061
  ttnghia

  committed
  1376061

  Copy full SHA for 1376061

• Merge branch 'branch-24.12' into convert_table

  Show description for ff2f340
  ttnghia

  committed
  ff2f340

  Copy full SHA for ff2f340

• Implement removeQuotes

  Show description for c3fa10d
  ttnghia

  committed
  c3fa10d

  Copy full SHA for c3fa10d

Commits on Oct 17, 2024

• Rewrite using offsets and chars

  Show description for ae2b41f
  ttnghia

  committed
  ae2b41f

  Copy full SHA for ae2b41f

• Fix empty input

  Show description for 8d7ad2e
  ttnghia

  committed
  8d7ad2e

  Copy full SHA for 8d7ad2e

• Misc

  Show description for 9e759c4
  ttnghia

  committed
  9e759c4

  Copy full SHA for 9e759c4

• Add nullifyIfNotQuoted option for removeQuotes

  Show description for 2fff949
  ttnghia

  committed
  2fff949

  Copy full SHA for 2fff949

Commits on Oct 18, 2024

• Implement castStringsToDecimals

  Show description for d09de41
  ttnghia

  committed
  d09de41

  Copy full SHA for d09de41

• Implement removeQuotesForFloats

  Show description for 576b65c
  ttnghia

  committed
  576b65c

  Copy full SHA for 576b65c

• Fix removeQuotesForFloats

  Show description for 2bd5335
  ttnghia

  committed
  2bd5335

  Copy full SHA for 2bd5335

• Implement castStringsToIntegers

  Show description for 21c80a5
  ttnghia

  committed
  21c80a5

  Copy full SHA for 21c80a5

Commits on Oct 19, 2024

• Implement non-legacy castStringsToDates

  Show description for 1a7d192
  ttnghia

  committed
  1a7d192

  Copy full SHA for 1a7d192

Commits on Oct 21, 2024

• WIP for cast_strings_to_dates_legacy

  Show description for dcb463e
  ttnghia

  committed
  dcb463e

  Copy full SHA for dcb463e

• Revert "WIP for cast_strings_to_dates_legacy"

  Show description for f059c21
  ttnghia

  committed
  f059c21

  Copy full SHA for f059c21

Commits on Oct 23, 2024

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  207d6a3

  Copy full SHA for 207d6a3

• Fix compile issues

  Show description for 07b23ea
  ttnghia

  committed
  07b23ea

  Copy full SHA for 07b23ea

Commits on Oct 24, 2024

• WIP: Implement from_json_to_structs

  Show description for de83a25
  ttnghia

  committed
  de83a25

  Copy full SHA for de83a25

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  443ca38

  Copy full SHA for 443ca38

• Fix cmake

  Show description for 6c2bd5e
  ttnghia

  committed
  6c2bd5e

  Copy full SHA for 6c2bd5e

• Fix compile issues

  Show description for 904d857
  ttnghia

  committed
  904d857

  Copy full SHA for 904d857

• Implement castStringsToFloats

  Show description for d84f1fe
  ttnghia

  committed
  d84f1fe

  Copy full SHA for d84f1fe

• WIP

  Show description for 3024583
  ttnghia

  committed
  3024583

  Copy full SHA for 3024583

Commits on Oct 26, 2024

• WIP: Implementing fromJSONToStructs

  Show description for d33d8e2
  ttnghia

  committed
  d33d8e2

  Copy full SHA for d33d8e2

Commits on Oct 28, 2024

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  295c36c

  Copy full SHA for 295c36c

Commits on Oct 29, 2024

• Fix compile errors

  Show description for 1ea9cc8
  ttnghia

  committed
  1ea9cc8

  Copy full SHA for 1ea9cc8

• Cleanup

  Show description for c1bb2d4
  ttnghia

  committed
  c1bb2d4

  Copy full SHA for c1bb2d4

• Revert code as we still need them

  ttnghia

  committed
  f6634b4

  Copy full SHA for f6634b4

• Add error check

  Show description for 06b2c19
  ttnghia

  committed
  06b2c19

  Copy full SHA for 06b2c19

• Add more comments

  Show description for 2dcdd11
  ttnghia

  committed
  2dcdd11

  Copy full SHA for 2dcdd11

• Cleanup

  Show description for f3c391b
  ttnghia

  committed
  f3c391b

  Copy full SHA for f3c391b

Commits on Oct 30, 2024

• Return as-is if the column is date/time

  Show description for 52c42a6
  ttnghia

  committed
  52c42a6

  Copy full SHA for 52c42a6

• Update test

  Show description for 19c64be
  ttnghia

  committed
  19c64be

  Copy full SHA for 19c64be

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  cb9d252

  Copy full SHA for cb9d252

• Update cudf

  Show description for 5d07db1
  ttnghia

  committed
  5d07db1

  Copy full SHA for 5d07db1

• Revert "Update cudf"

  Show description for 39e3a9b
  ttnghia

  committed
  39e3a9b

  Copy full SHA for 39e3a9b

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  8628136

  Copy full SHA for 8628136

• Update cudf

  ttnghia

  committed
  df1428d

  Copy full SHA for df1428d

Commits on Nov 8, 2024

• Merge branch 'branch-24.12' into convert_table

  Show description for 0fd8d0e
  ttnghia

  committed
  0fd8d0e

  Copy full SHA for 0fd8d0e

• Update cudf

  ttnghia

  committed
  1d48906

  Copy full SHA for 1d48906

Commits on Nov 9, 2024

• Change header

  ttnghia

  committed
  d9e1db5

  Copy full SHA for d9e1db5

• Rewrite JSONUtils.cpp

  ttnghia

  committed
  0f053a6

  Copy full SHA for 0f053a6

Commits on Nov 12, 2024

• Implement a common function for converting column

  Show description for 8912e00
  ttnghia

  committed
  8912e00

  Copy full SHA for 8912e00

• Rewrite convert_data_type

  Show description for 3614718
  ttnghia

  committed
  3614718

  Copy full SHA for 3614718

• Remove cast_strings_to_dates

  Show description for 6d9bbdc
  ttnghia

  committed
  6d9bbdc

  Copy full SHA for 6d9bbdc

Commits on Nov 13, 2024

• Implement convert_data_type

  Show description for a832938
  ttnghia

  committed
  a832938

  Copy full SHA for a832938

• Fix compile errors

  Show description for 44b885b
  ttnghia

  committed
  44b885b

  Copy full SHA for 44b885b

• Add CUDF_FUNC_RANGE();

  Show description for ab45de8
  ttnghia

  committed
  ab45de8

  Copy full SHA for ab45de8

• Fix schema

  Show description for 89e74a0
  ttnghia

  committed
  89e74a0

  Copy full SHA for 89e74a0

• Complete from_json_to_structs

  Show description for 27ef532
  ttnghia

  committed
  27ef532

  Copy full SHA for 27ef532

• Fix null mask

  Show description for 5b65712
  ttnghia

  committed
  5b65712

  Copy full SHA for 5b65712

• Write Javadoc

  Show description for 6788471
  ttnghia

  committed
  6788471

  Copy full SHA for 6788471

• Rewrite JNI

  Show description for 49c78ce
  ttnghia

  committed
  49c78ce

  Copy full SHA for 49c78ce

• Merge branch 'branch-24.12' into convert_table

  Show description for 9d16d43
  ttnghia

  committed
  9d16d43

  Copy full SHA for 9d16d43

Commits on Nov 14, 2024

• Remove deprecated function

  Show description for bb9029b
  ttnghia

  committed
  bb9029b

  Copy full SHA for bb9029b

• Revert test

  Show description for 1243599
  ttnghia

  committed
  1243599

  Copy full SHA for 1243599

• Remove header

  Show description for 6f89fcd
  ttnghia

  committed
  6f89fcd

  Copy full SHA for 6f89fcd

• Rewrite Javadoc

  Show description for deb3ebf
  ttnghia

  committed
  deb3ebf

  Copy full SHA for deb3ebf

• Rename variable

  Show description for 9dc641f
  ttnghia

  committed
  9dc641f

  Copy full SHA for 9dc641f

• Rewrite docs

  Show description for 53b121d
  ttnghia

  committed
  53b121d

  Copy full SHA for 53b121d

• Revert test

  Show description for 69265b4
  ttnghia

  committed
  69265b4

  Copy full SHA for 69265b4

• Cleanup headers

  Show description for da4d1f6
  ttnghia

  committed
  da4d1f6

  Copy full SHA for da4d1f6

• Cleanup

  Show description for 1d91e64
  ttnghia

  committed
  1d91e64

  Copy full SHA for 1d91e64

• Rewrite the conversion functions

  Show description for d0fa2ae
  ttnghia

  committed
  d0fa2ae

  Copy full SHA for d0fa2ae

• Move code

  Show description for f375a4d
  ttnghia

  committed
  f375a4d

  Copy full SHA for f375a4d

• Remove call to make_structs_column

  Show description for 034a5ec
  ttnghia

  committed
  034a5ec

  Copy full SHA for 034a5ec

• Cleanup

  Show description for 74d858c
  ttnghia

  committed
  74d858c

  Copy full SHA for 74d858c

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  7a32b6f

  Copy full SHA for 7a32b6f

Commits on Nov 15, 2024

• Optimize conversion further, avoiding to materialize column if not needed

  Show description for 32edcbf
  ttnghia

  committed
  32edcbf

  Copy full SHA for 32edcbf

• Rewrite docs and change function name

  Show description for fe8e359
  ttnghia

  committed
  fe8e359

  Copy full SHA for fe8e359

• Reorganize code

  Show description for 5a819d0
  ttnghia

  committed
  5a819d0

  Copy full SHA for 5a819d0

• Handle schema mismatching

  Show description for fa1946a
  ttnghia

  committed
  fa1946a

  Copy full SHA for fa1946a

Commits on Nov 16, 2024

• Add test

  Show description for 553d7d0
  ttnghia

  committed
  553d7d0

  Copy full SHA for 553d7d0

• Add another test

  Show description for 8a17651
  ttnghia

  committed
  8a17651

  Copy full SHA for 8a17651

• Revert "Add another test"

  Show description for 3773a27
  ttnghia

  committed
  3773a27

  Copy full SHA for 3773a27

• Fix schema mismatch

  Show description for 34cc98d
  ttnghia

  committed
  34cc98d

  Copy full SHA for 34cc98d

• Cleanup

  Show description for bfd461b
  ttnghia

  committed
  bfd461b

  Copy full SHA for bfd461b

• Add another test

  Show description for cf9d6bf
  ttnghia

  committed
  cf9d6bf

  Copy full SHA for cf9d6bf

• Revert "Add another test"

  Show description for 11ff5a7
  ttnghia

  committed
  11ff5a7

  Copy full SHA for 11ff5a7

• Revert "Add test"

  Show description for b3f4882
  ttnghia

  committed
  b3f4882

  Copy full SHA for b3f4882

• Add prefix spark_rapids_jni::

  Show description for 45670a2
  ttnghia

  committed
  45670a2

  Copy full SHA for 45670a2

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  23288da

  Copy full SHA for 23288da

Commits on Nov 18, 2024

• Remove handling for schema mismatching

  Show description for d2b6fb5
  ttnghia

  committed
  d2b6fb5

  Copy full SHA for d2b6fb5

Commits on Nov 19, 2024

• Avoid materializing a column when converting strings

  Show description for 27f5551
  ttnghia

  committed
  27f5551

  Copy full SHA for 27f5551

Commits on Nov 21, 2024

• Merge branch 'branch-24.12' into convert_table

  ttnghia

  committed
  32f2181

  Copy full SHA for 32f2181

• Revert "Remove handling for schema mismatching"

  Show description for efd68dc
  ttnghia

  committed
  efd68dc

  Copy full SHA for efd68dc

• Fix handling for schema mismatching in case of column_view input

  Show description for c725394
  ttnghia

  committed
  c725394

  Copy full SHA for c725394