Skip to content

[Spark][CherryPick] compaction with file size condition in parallel #692

[Spark][CherryPick] compaction with file size condition in parallel

[Spark][CherryPick] compaction with file size condition in parallel #692

Triggered via pull request November 15, 2024 03:41
Status Success
Total duration 27m 28s
Artifacts 2

flink-cdc-hdfs-test.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 11 warnings
build
Trying to access closed classloader. Please check if you store classloaders directly or indirectly in static fields. If the stacktrace suggests that the leak occurs in a third party library and cannot be fixed immediately, you can disable this check with the configuration 'classloader.check-leaked-classloader'.
build
Trying to access closed classloader. Please check if you store classloaders directly or indirectly in static fields. If the stacktrace suggests that the leak occurs in a third party library and cannot be fixed immediately, you can disable this check with the configuration 'classloader.check-leaked-classloader'.
build
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
build
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4, arduino/setup-protoc@v2, actions-rs/toolchain@v1, actions-rs/cargo@v1, beyondstorage/setup-hdfs@master. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
one deprecation
build
one deprecation (since 2.12.13)
build
7 deprecations in total; re-run with -deprecation for details
build
Created directory '/home/runner/.ssh'. # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.10 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.10 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.10 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.10 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.10 Identity added: /home/runner/.ssh/id_rsa (runner@fv-az1789-449)
build
WARNING: /opt/hostedtoolcache/hdfs/3.3.6/x64/logs does not exist. Creating. 2024-11-15 03:56:23,596 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = fv-az1789-449/10.1.0.123 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.3.6 STARTUP_MSG: classpath = /opt/hostedtoolcache/hdfs/3.3.6/x64/etc/hadoop:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jackson-core-2.12.7.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-resolver-dns-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.89.Final-linux-x86_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-common-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-compress-1.21.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-memcache-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-xml-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/hadoop-annotations-3.3.6.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/httpcore-4.4.13.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/re2j-1.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.89.Final-osx-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-http2-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jersey-core-1.19.4.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/gson-2.9.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-lang3-3.12.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-x86_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-io-2.8.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jettison-1.5.4.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-util-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-servlet-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-io-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-text-1.10.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-unix-common-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib

Artifacts

Produced during runtime
Name Size
flink-cluster-log Expired
42.1 KB
lakesoul-compaction-log Expired
2.17 KB