consistent segfault on simple write

[alex-s-gardner]

This causes a consistent segfault:

import GeoFormatTypes as GFT
import GeoInterface as GI
using DataFrames
using GeoDataFrames

pt = GI.Point(1,1, crs=GFT.EPSG(4326))
df = DataFrame(geometry=pt, test = 1.)

GeoDataFrames.write("test.parquet", df)

GeoInterface v1.3.7
GeoFormatTypes v0.4.2
GeoDataFrames v0.3.10
DataFrames v1.7.0

[visr]

Probably the same as JuliaGeo/GDAL.jl#146. What platform are you on?

[evetion]

Sorry for all the trouble I got you into with advising Parquet for vector data 😅. Thanks for being thorough with testing and reporting.

[alex-s-gardner]

Probably the same as JuliaGeo/GDAL.jl#146. What platform are you on?

I'm using Ubuntu 22.04 LTS

[evetion]

Hmm, unlike the linked GDAL issue, this crashes for me too. 😞

[evetion]

This doesn't crash for me anymore, probably due to the new GDAL.

[alex-s-gardner]

The best issue resolve themselves... works for me too

[evetion]

@visr Can you confirm this?

[visr]

Running the example from the top post on Windows, Julia 1.10.7 gives the same unwind-seh error as JuliaGeo/GDAL.jl#146 but with an actual stacktrace. It seems to be triggered by gdalclose.

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x7ffa49d04d18 -- _Unwind_Resume at /workspace/srcdir/gcc-13.2.0/libgcc\unwind-seh.c:352
in expression starting at REPL[10]:1
_Unwind_Resume at /workspace/srcdir/gcc-13.2.0/libgcc\unwind-seh.c:352
_ZN5arrow8internal7CpuInfo4ImplC1Ev at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libarrow.dll (unknown line)
_ZN5arrow8internal7CpuInfoC1Ev at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libarrow.dll (unknown line)
_ZN5arrow8internal7CpuInfo11GetInstanceEv at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libarrow.dll (unknown line)
.text at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet8internal8standard22DefLevelsBatchToBitmapILb0EEExPKsxxNS0_9LevelInfoEPN5arrow8internal21FirstTimeBitmapWriterE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet8internal8standard21DefLevelsToBitmapSimdILb0EEEvPKsxNS0_9LevelInfoEPNS0_25ValidityBitmapInputOutputE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet8internal17DefLevelsToBitmapEPKsxNS0_9LevelInfoEPNS0_25ValidityBitmapInputOutputE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet21TypedColumnWriterImplINS_12PhysicalTypeILNS_4Type4typeE4EEEE26MaybeCalculateValidityBitsEPKsxPxS8_S8_ at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZZN7parquet21TypedColumnWriterImplINS_12PhysicalTypeILNS_4Type4typeE4EEEE16WriteBatchSpacedExPKsS7_PKhxPKfENKUlxxbE_clExxb at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet18WriteArrowZeroCopyINS_12PhysicalTypeILNS_4Type4typeE4EEEEEN5arrow6StatusERKNS5_5ArrayExPKsSB_PNS_17ArrowWriteContextEPNS_17TypedColumnWriterIT_EEb at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet21TypedColumnWriterImplINS_12PhysicalTypeILNS_4Type4typeE4EEEE15WriteArrowDenseEPKsS7_xRKN5arrow5ArrayEPNS_17ArrowWriteContextEb at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet21TypedColumnWriterImplINS_12PhysicalTypeILNS_4Type4typeE4EEEE10WriteArrowEPKsS7_xRKN5arrow5ArrayEPNS_17ArrowWriteContextEb at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZNSt17_Function_handlerIFN5arrow6StatusERKN7parquet5arrow27MultipathLevelBuilderResultEEZNS3_12_GLOBAL__N_119ArrowColumnWriterV25WriteEPNS2_17ArrowWriteContextEEUlS6_E_E9_M_invokeERKSt9_Any_dataS6_ at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet5arrow12_GLOBAL__N_19WritePathENS0_12ElementRangeEPNS1_8PathInfoEPNS_17ArrowWriteContextESt8functionIFN5arrow6StatusERKNS0_27MultipathLevelBuilderResultEEE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet5arrow25MultipathLevelBuilderImpl5WriteEiPNS_17ArrowWriteContextESt8functionIFN5arrow6StatusERKNS0_27MultipathLevelBuilderResultEEE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet5arrow12_GLOBAL__N_119ArrowColumnWriterV25WriteEPNS_17ArrowWriteContextE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet5arrow14FileWriterImpl16WriteColumnChunkERKSt10shared_ptrIN5arrow12ChunkedArrayEExx at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZN7parquet5arrow14FileWriterImpl16WriteColumnChunkERKN5arrow5ArrayE at a:\.julia\artifacts\b2983af8bfc11e2f3da9321edfd598eb62e72da6\bin\libparquet.dll (unknown line)
_ZNSt17_Function_handlerIFbRKSt10shared_ptrIN5arrow5FieldEERKS0_INS1_5ArrayEEEZN21OGRParquetWriterLayer10FlushGroupEvEUlS5_S9_E_E9_M_invokeERKSt9_Any_dataS5_S9_ at a:\.julia\artifacts\b7315926ec9c640f6803cdba34648ae8fd71cd96\bin\libgdal-36.dll (unknown line)
_ZN19OGRArrowWriterLayer11WriteArraysESt8functionIFbRKSt10shared_ptrIN5arrow5FieldEERKS1_INS2_5ArrayEEEE at a:\.julia\artifacts\b7315926ec9c640f6803cdba34648ae8fd71cd96\bin\libgdal-36.dll (unknown line)
_ZN21OGRParquetWriterLayer10FlushGroupEv at a:\.julia\artifacts\b7315926ec9c640f6803cdba34648ae8fd71cd96\bin\libgdal-36.dll (unknown line)
_ZN21OGRParquetWriterLayer5CloseEv at a:\.julia\artifacts\b7315926ec9c640f6803cdba34648ae8fd71cd96\bin\libgdal-36.dll (unknown line)
_ZN23OGRParquetWriterDataset5CloseEv at a:\.julia\artifacts\b7315926ec9c640f6803cdba34648ae8fd71cd96\bin\libgdal-36.dll (unknown line)
GDALClose at a:\.julia\artifacts\b7315926ec9c640f6803cdba34648ae8fd71cd96\bin\libgdal-36.dll (unknown line)
gdalclose at a:\.julia\packages\GDAL\8oAvY\src\libgdal.jl:7847 [inlined]
destroy at a:\.julia\packages\ArchGDAL\ujstt\src\dataset.jl:1017 [inlined]
#create#230 at a:\.julia\packages\ArchGDAL\ujstt\src\context.jl:270
create at a:\.julia\packages\ArchGDAL\ujstt\src\context.jl:265 [inlined]
#write#9 at a:\.julia\packages\GeoDataFrames\5sjS5\src\io.jl:173
unknown function (ip: 000001209b642836)
write at a:\.julia\packages\GeoDataFrames\5sjS5\src\io.jl:113
unknown function (ip: 000001209b63dbdf)
jl_apply at C:/workdir/src\julia.h:1982 [inlined]
do_call at C:/workdir/src\interpreter.c:126
eval_value at C:/workdir/src\interpreter.c:223
eval_stmt_value at C:/workdir/src\interpreter.c:174 [inlined]
eval_body at C:/workdir/src\interpreter.c:635
jl_interpret_toplevel_thunk at C:/workdir/src\interpreter.c:775
jl_toplevel_eval_flex at C:/workdir/src\toplevel.c:934
jl_toplevel_eval_flex at C:/workdir/src\toplevel.c:877
jl_toplevel_eval_flex at C:/workdir/src\toplevel.c:877
jl_toplevel_eval_flex at C:/workdir/src\toplevel.c:877
ijl_toplevel_eval at C:/workdir/src\toplevel.c:943 [inlined]
ijl_toplevel_eval_in at C:/workdir/src\toplevel.c:985
eval at .\boot.jl:385 [inlined]
eval_user_input at C:\workdir\usr\share\julia\stdlib\v1.10\REPL\src\REPL.jl:150
repl_backend_loop at C:\workdir\usr\share\julia\stdlib\v1.10\REPL\src\REPL.jl:246
#start_repl_backend#46 at C:\workdir\usr\share\julia\stdlib\v1.10\REPL\src\REPL.jl:231
start_repl_backend at C:\workdir\usr\share\julia\stdlib\v1.10\REPL\src\REPL.jl:228
#run_repl#59 at C:\workdir\usr\share\julia\stdlib\v1.10\REPL\src\REPL.jl:389
run_repl at C:\workdir\usr\share\julia\stdlib\v1.10\REPL\src\REPL.jl:375
jfptr_run_repl_96275.1 at a:\.julia\juliaup\julia-1.10.7+0.x64.w64.mingw32\lib\julia\sys.dll (unknown line)
#1014 at .\client.jl:437
jfptr_YY.1014_87040.1 at a:\.julia\juliaup\julia-1.10.7+0.x64.w64.mingw32\lib\julia\sys.dll (unknown line)
jl_apply at C:/workdir/src\julia.h:1982 [inlined]
jl_f__call_latest at C:/workdir/src\builtins.c:812
#invokelatest#2 at .\essentials.jl:892 [inlined]
invokelatest at .\essentials.jl:889 [inlined]
run_main_repl at .\client.jl:421
exec_options at .\client.jl:338
_start at .\client.jl:557
jfptr__start_87065.1 at a:\.julia\juliaup\julia-1.10.7+0.x64.w64.mingw32\lib\julia\sys.dll (unknown line)
jl_apply at C:/workdir/src\julia.h:1982 [inlined]
true_main at C:/workdir/src\jlapi.c:582
jl_repl_entrypoint at C:/workdir/src\jlapi.c:731
mainCRTStartup at C:/workdir/cli\loader_exe.c:58
BaseThreadInitThunk at C:\WINDOWS\System32\KERNEL32.DLL (unknown line)
RtlUserThreadStart at C:\WINDOWS\SYSTEM32\ntdll.dll (unknown line)
Allocations: 15452465 (Pool: 15432556; Big: 19909); GC: 25