Failed to run application/job, command=java -jar app/build/libs/data-caterer.jar

Error: Command failed: java -jar app/build/libs/data-caterer.jar WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/runner/work/data-caterer/data-caterer/app/build/libs/data-caterer.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Exception in thread "main" java.lang.RuntimeException: org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 87.0 failed 1 times, most recent failure: Lost task 1.0 in stage 87.0 (TID 238) (fv-az651-930.mi4nuvdbnkburlvweydx3iqepe.ex.internal.cloudapp.net executor driver): java.sql.BatchUpdateException: Batch entry 1 INSERT INTO account.transactions ("account_number","create_time","transaction_id","amount") VALUES (('ACC13857918717'),('2023-09-08 15:50:45.187+00'),('wcKFA8I57u'),('6244.210129532857'::double precision)) was aborted: ERROR: duplicate key value violates unique constraint "transactions_account_number_key" Detail: Key (account_number)=(ACC13857918717) already exists. Call getNextException to see other errors in the batch. at org.postgresql.jdbc.BatchResultHandler.handleError(BatchResultHandler.java:165) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2413) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2145) at org.postgresql.core.v3.QueryExecutorImpl.flushIfDeadlockRisk(QueryExecutorImpl.java:1502) at org.postgresql.core.v3.QueryExecutorImpl.sendQuery(QueryExecutorImpl.java:1527) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:565) at org.postgresql.jdbc.PgStatement.internalExecuteBatch(PgStatement.java:912) at org.postgresql.jdbc.PgStatement.executeBatch(PgStatement.java:936) at org.postgresql.jdbc.PgPreparedStatement.executeBatch(PgPreparedStatement.java:1733) at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.savePartition(JdbcUtils.scala:751) at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$saveTable$1(JdbcUtils.scala:902) at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$saveTable$1$adapted(JdbcUtils.scala:901) at org.apache.spark.rdd.RDD.$anonfun$foreachPartition$2(RDD.scala:1039) at org.apache.spark.rdd.RDD.$anonfun$foreachPartition$2$adapted(RDD.scala:1039) at org.apache.spark.SparkContext.$anonfun$runJob$5(SparkContext.scala:2438) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:93) at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:166) at org.apache.spark.scheduler.Task.run(Task.scala:141) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Executor.scala:620) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:94) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:623) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "transactions_account_number_key" Detail: Key (account_number)=(ACC13857918717) already exists. at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2725) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2412) ... 24 more Driver stacktrace: at io.github.datacatering.datacaterer.core.sink.SinkFactory.saveData(SinkFactory.scala:52) at io.github.datacatering.datacaterer.core.sink.SinkFactory

Error: Command failed: docker rm data-caterer Error response from daemon: No such container: data-caterer

The following actions uses Node.js version which is deprecated and will be forced to run on node20: burrunan/gradle-cache-action@v1, actions/github-script@v6. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

distributionSha256Sum is not set in gradle/wrapper/gradle-wrapper.properties. Please consider adding the checksum, see https://docs.gradle.org/current/userguide/gradle_wrapper.html#configuring_checksum_verification