Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: fix bind port failed on spark yarn environment #2233

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Merge branch 'master' into master

db5e950
Select commit
Loading
Failed to load commit list.
Open

fix: fix bind port failed on spark yarn environment #2233

Merge branch 'master' into master
db5e950
Select commit
Loading
Failed to load commit list.
Azure Pipelines / microsoft.SynapseML failed Jul 22, 2024 in 53m 27s

Build #20240722.1 had test failures

Details

Tests

  • Failed: 2 (0.11%)
  • Passed: 1,749 (98.65%)
  • Other: 22 (1.24%)
  • Total: 1,773

Annotations

Check failure on line 1895 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L1895

Script failed with exit code: 1

Check failure on line 39 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L39

There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.

Check failure on line 1675 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L1675

Script failed with exit code: 1

Check failure on line 35 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L35

Script failed with error: AggregateError [ETIMEDOUT]: 
    at internalConnectMultiple (node:net:1117:18)
    at internalConnectMultiple (node:net:1185:5)
    at Timeout.internalConnectMultipleTimeout (node:net:1711:5)
    at listOnTimeout (node:internal/timers:575:11)
    at process.processTimers (node:internal/timers:514:7) {
  code: 'ETIMEDOUT',
  [errors]: [Array]
}

Check failure on line 1 in (It is not a test it is a sbt.testing.SuiteSelector)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

(It is not a test it is a sbt.testing.SuiteSelector)

DatabricksUtilities.isClusterActive(clusterId) was false
Raw output
org.scalatest.exceptions.TestFailedException: DatabricksUtilities.isClusterActive(clusterId) was false
	at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
	at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
	at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1231)
	at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:1295)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksTestHelper.$anonfun$databricksTestHelper$2(DatabricksUtilities.scala:434)
	at com.microsoft.azure.synapse.ml.core.test.base.TestBase.$anonfun$tryWithRetries$2(TestBase.scala:204)
	at com.microsoft.azure.synapse.ml.core.test.base.TestBase.$anonfun$tryWithRetries$2$adapted(TestBase.scala:202)
	at scala.collection.TraversableLike$WithFilter.$anonfun$foreach$1(TraversableLike.scala:985)
	at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
	at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
	at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
	at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:984)
	at com.microsoft.azure.synapse.ml.core.test.base.TestBase.tryWithRetries(TestBase.scala:202)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksTestHelper.databricksTestHelper(DatabricksUtilities.scala:433)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksGPUTests.<init>(DatabricksGPUTests.scala:17)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at java.lang.Class.newInstance(Class.java:442)
	at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:454)
	at sbt.TestRunner.runTest$1(TestFramework.scala:140)
	at sbt.TestRunner.run(TestFramework.scala:155)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.$anonfun$apply$1(TestFramework.scala:318)
	at sbt.TestFramework$.sbt$TestFramework$$withContextLoader(TestFramework.scala:278)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.apply(TestFramework.scala:318)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.apply(TestFramework.scala:318)
	at sbt.TestFunction.apply(TestFramework.scala:330)
	at sbt.Tests$.processRunnable$1(Tests.scala:474)
	at sbt.Tests$.$anonfun$makeSerial$1(Tests.scala:480)
	at sbt.std.Transform$$anon$3.$anonfun$apply$2(Transform.scala:46)
	at sbt.std.Transform$$anon$4.work(Transform.scala:68)
	at sbt.Execute.$anonfun$submit$2(Execute.scala:282)
	at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:23)
	at sbt.Execute.work(Execute.scala:291)
	at sbt.Execute.$anonfun$submit$1(Execute.scala:282)
	at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265)
	at sbt.CompletionService$$anon$2.call(CompletionService.scala:64)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Check failure on line 1 in Quickstart - OpenAI Embedding and GPU based KNN.ipynb

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Quickstart - OpenAI Embedding and GPU based KNN.ipynb

Notebook /SynapseMLBuild/build_1.0.4-40-14c433f5-SNAPSHOT/Explore Algorithms/OpenAI/Quickstart - OpenAI Embedding and GPU based KNN.ipynb failed with state FAILED. For more information check the run page:  https://adb-1885762835647850.10.azuredatabricks.net/?o=1885762835647850#job/235056494427851/run/258704644838285 
Raw output
java.lang.RuntimeException: Notebook /SynapseMLBuild/build_1.0.4-40-14c433f5-SNAPSHOT/Explore Algorithms/OpenAI/Quickstart - OpenAI Embedding and GPU based KNN.ipynb failed with state FAILED. For more information check the run page: 
https://adb-1885762835647850.10.azuredatabricks.net/?o=1885762835647850#job/235056494427851/run/258704644838285

	at com.microsoft.azure.synapse.ml.nbtest.DatabricksUtilities$.monitorJob(DatabricksUtilities.scala:349)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksNotebookRun.monitor(DatabricksUtilities.scala:474)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksUtilities$.runNotebook(DatabricksUtilities.scala:371)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksTestHelper.$anonfun$databricksTestHelper$6(DatabricksUtilities.scala:452)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
	at scala.util.Success.$anonfun$map$1(Try.scala:255)
	at scala.util.Success.map(Try.scala:213)
	at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)