refresh data generation on hdfs on Dataproc failed with specific scale factor and parallel args

[wjxiz1992]

comamnd:

python3 nds_gen_data.py hdfs 10 10 /data/full_bench_raw_sf10_1 --overwrite_output --update 1

error:

2022-08-15 07:29:39,299 INFO mapreduce.Job: Task Id : attempt_1660543957812_0005_m_000009_2, Status : FAILED
Error: java.lang.InterruptedException: Process failed with status code 139

        at org.notmysock.tpcds.GenTable$DSDGen.map(GenTable.java:256)
        at org.notmysock.tpcds.GenTable$DSDGen.map(GenTable.java:225)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

I cannot reproduce this error on our internal yarn cluster.

But the following command works well:

python3 nds_gen_data.py hdfs 10 5 /data/full_bench_raw_sf10_1 --overwrite_output --update 1
python3 nds_gen_data.py hdfs 20 5 /data/full_bench_raw_sf10_1 --overwrite_output --update 1
python3 nds_gen_data.py hdfs 10 9 /data/full_bench_raw_sf10_1 --overwrite_output --update 1

[wjxiz1992]

I try to add print log for string list cmd, and see

DEBUG=============================================
[./dsdgen, -dir, /mnt/2/hadoop/yarn/nm-local-dir/usercache/allxu_nvidia_com/appcache/application_1660543957812_0027/container_e02_1660543957812_0027_01_000002/., -force, Y, -scale, 10, -parallel, 10, -child, 10, -update, 1]
DEBUG=============================================

and this cmd should cause the exit code 139.

But when I change parallel to 5, the following cmd is working well:

DEBUG=============================================
[./dsdgen, -dir, /mnt/5/hadoop/yarn/nm-local-dir/usercache/allxu_nvidia_com/appcache/application_1660543957812_0028/container_e02_1660543957812_0028_01_000002/., -force, Y, -scale, 10, -parallel, 5, -child, 2, -update, 1]
DEBUG=============================================