Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Adding Spark35 support #2182

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

chore: Adding Spark35 support

616a081
Select commit
Loading
Failed to load commit list.
Open

chore: Adding Spark35 support #2182

chore: Adding Spark35 support
616a081
Select commit
Loading
Failed to load commit list.
Azure Pipelines / microsoft.SynapseML failed Jan 10, 2025 in 1h 24m 10s

Build #20250109.10 had test failures

16 errors / 191 warnings

Details

Tests

  • Failed: 15 (0.88%, 15 new, 0 recurring)
  • Passed: 1,680 (98.07%)
  • Other: 18 (1.05%)
  • Total: 1,713

Annotations

Check failure on line 2613 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L2613 

Script failed with exit code: 1

Check failure on line 4537 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L4537 

Script failed with exit code: 1

Check failure on line 853 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L853 

Script failed with exit code: 1

Check failure on line 973 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Build log #L973 

Script failed with exit code: 1

Check failure on line 1 in (It is not a test it is a sbt.testing.SuiteSelector)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

(It is not a test it is a sbt.testing.SuiteSelector) 

Failed:    response: HttpResponseProxy{HTTP/1.1 400 Bad Request [Cache-Control: no-cache, Pragma: no-cache, Content-Length: 187, Content-Type: application/json; charset=utf-8, Expires: -1, Strict-Transport-Security: max-age=31536000; includeSubDomains, x-ms-request-id: 5cb4602a-d66c-47f8-85e7-488189e0cb7c, x-ms-ratelimit-remaining-subscription-writes: 799, x-ms-ratelimit-remaining-subscription-global-writes: 11999, x-ms-correlation-request-id: db0bd4cb-e345-4b71-9952-1cb05ea84ba2, x-ms-routing-request-id: EASTUS2:20250110T005545Z:db0bd4cb-e345-4b71-9952-1cb05ea84ba2, X-Content-Type-Options: nosniff, X-Cache: CONFIG_NOCACHE, X-MSEdge-Ref: Ref A: DB072C1F9E41416693AB2AA6A89F190A Ref B: BL2AA2011003029 Ref C: 2025-01-10T00:55:44Z, Date: Fri, 10 Jan 2025 00:55:44 GMT] ResponseEntityProxy{[Content-Type: application/json; charset=utf-8,Content-Length: 187,Chunked: false]}}    requestUrl: https://management.azure.com/subscriptions/e342c2c0-f844-4b18-9208-52c8c234c30e/resourceGroups/marhamil-mmlspark/providers/Microsoft.Synapse/workspaces/mmlsparkbuild/bigDataPools/tc1736470541368?api-version=2021-06-01-preview   requestBody:  {   "name": "tc1736470541368",   "location": "eastus2",   "tags": {     "createdBy": "SynapseE2E Tests",     "createdAt": "Fri Jan 10 00:55:41 UTC 2025",     "buildId": "unknown",     "buildNumber": "unknown",   },   "properties": {     "autoPause": {       "delayInMinutes": "10",       "enabled": "true"     },     "autoScale": {       "enabled": "true",       "maxNodeCount": "10",       "minNodeCount": "3"     },     "cacheSize": "20",     "dynamicExecutorAllocation": {       "enabled": "true",       "maxExecutors": "8",       "minExecutors": "2"     },     "isComputeIsolationEnabled": "false",     "nodeCount": "0",     "nodeSize": "Small",     "nodeSizeFamily": "MemoryOptimized",     "provisioningState": "Succeeded",     "sessionLevelPackagesEnabled": "true",     "sparkVersion": "3.5"   } }    responseBody: {"error":{"code":"ValidationFailed","message":"Spark pool request validation failed.","details":[{"code":"InvalidSparkComputeVersion","message":"Spark Compute version: 3.5 is invalid"}]}}
Raw output 
java.lang.RuntimeException: Failed: 
	 response: HttpResponseProxy{HTTP/1.1 400 Bad Request [Cache-Control: no-cache, Pragma: no-cache, Content-Length: 187, Content-Type: application/json; charset=utf-8, Expires: -1, Strict-Transport-Security: max-age=31536000; includeSubDomains, x-ms-request-id: 5cb4602a-d66c-47f8-85e7-488189e0cb7c, x-ms-ratelimit-remaining-subscription-writes: 799, x-ms-ratelimit-remaining-subscription-global-writes: 11999, x-ms-correlation-request-id: db0bd4cb-e345-4b71-9952-1cb05ea84ba2, x-ms-routing-request-id: EASTUS2:20250110T005545Z:db0bd4cb-e345-4b71-9952-1cb05ea84ba2, X-Content-Type-Options: nosniff, X-Cache: CONFIG_NOCACHE, X-MSEdge-Ref: Ref A: DB072C1F9E41416693AB2AA6A89F190A Ref B: BL2AA2011003029 Ref C: 2025-01-10T00:55:44Z, Date: Fri, 10 Jan 2025 00:55:44 GMT] ResponseEntityProxy{[Content-Type: application/json; charset=utf-8,Content-Length: 187,Chunked: false]}} 
	 requestUrl: https://management.azure.com/subscriptions/e342c2c0-f844-4b18-9208-52c8c234c30e/resourceGroups/marhamil-mmlspark/providers/Microsoft.Synapse/workspaces/mmlsparkbuild/bigDataPools/tc1736470541368?api-version=2021-06-01-preview
	 requestBody: 
{
  "name": "tc1736470541368",
  "location": "eastus2",
  "tags": {
    "createdBy": "SynapseE2E Tests",
    "createdAt": "Fri Jan 10 00:55:41 UTC 2025",
    "buildId": "unknown",
    "buildNumber": "unknown",
  },
  "properties": {
    "autoPause": {
      "delayInMinutes": "10",
      "enabled": "true"
    },
    "autoScale": {
      "enabled": "true",
      "maxNodeCount": "10",
      "minNodeCount": "3"
    },
    "cacheSize": "20",
    "dynamicExecutorAllocation": {
      "enabled": "true",
      "maxExecutors": "8",
      "minExecutors": "2"
    },
    "isComputeIsolationEnabled": "false",
    "nodeCount": "0",
    "nodeSize": "Small",
    "nodeSizeFamily": "MemoryOptimized",
    "provisioningState": "Succeeded",
    "sessionLevelPackagesEnabled": "true",
    "sparkVersion": "3.5"
  }
}

	 responseBody: {"error":{"code":"ValidationFailed","message":"Spark pool request validation failed.","details":[{"code":"InvalidSparkComputeVersion","message":"Spark Compute version: 3.5 is invalid"}]}}
	at com.microsoft.azure.synapse.ml.io.http.RESTHelpers$.$anonfun$safeSend$1(RESTHelpers.scala:77)
	at com.microsoft.azure.synapse.ml.io.http.RESTHelpers$.retry(RESTHelpers.scala:40)
	at com.microsoft.azure.synapse.ml.io.http.RESTHelpers$.safeSend(RESTHelpers.scala:57)
	at com.microsoft.azure.synapse.ml.nbtest.SynapseUtilities$.$anonfun$createSparkPools$1(SynapseUtilities.scala:310)
	at com.microsoft.azure.synapse.ml.nbtest.SynapseUtilities$.$anonfun$createSparkPools$1$adapted(SynapseUtilities.scala:297)
	at scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:286)
	at scala.collection.immutable.Range.foreach(Range.scala:158)
	at scala.collection.TraversableLike.map(TraversableLike.scala:286)
	at scala.collection.TraversableLike.map$(TraversableLike.scala:279)
	at scala.collection.AbstractTraversable.map(Traversable.scala:108)
	at com.microsoft.azure.synapse.ml.nbtest.SynapseUtilities$.createSparkPools(SynapseUtilities.scala:297)
	at com.microsoft.azure.synapse.ml.nbtest.SynapseTests.<init>(SynapseTests.scala:75)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at java.lang.Class.newInstance(Class.java:442)
	at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:454)
	at sbt.TestRunner.runTest$1(TestFramework.scala:140)
	at sbt.TestRunner.run(TestFramework.scala:155)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.$anonfun$apply$1(TestFramework.scala:318)
	at sbt.TestFramework$.sbt$TestFramework$$withContextLoader(TestFramework.scala:278)
	at sbt.TestFramework$$a

Check failure on line 1 in Quickstart - Fine-tune a Text Classifier.ipynb

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Quickstart - Fine-tune a Text Classifier.ipynb 

Notebook /SynapseMLBuild/build_1.0.9-spark3.5/Explore Algorithms/Deep Learning/Quickstart - Fine-tune a Text Classifier.ipynb failed with state FAILED. For more information check the run page:  https://adb-1885762835647850.10.azuredatabricks.net/?o=1885762835647850#job/18248729090871/run/861689440582132
Raw output 
java.lang.RuntimeException: Notebook /SynapseMLBuild/build_1.0.9-spark3.5/Explore Algorithms/Deep Learning/Quickstart - Fine-tune a Text Classifier.ipynb failed with state FAILED. For more information check the run page: 
https://adb-1885762835647850.10.azuredatabricks.net/?o=1885762835647850#job/18248729090871/run/861689440582132

	at com.microsoft.azure.synapse.ml.nbtest.DatabricksUtilities$.monitorJob(DatabricksUtilities.scala:350)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksNotebookRun.monitor(DatabricksUtilities.scala:475)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksUtilities$.runNotebook(DatabricksUtilities.scala:372)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksTestHelper.$anonfun$databricksTestHelper$6(DatabricksUtilities.scala:453)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
	at scala.util.Success.$anonfun$map$1(Try.scala:255)
	at scala.util.Success.map(Try.scala:213)
	at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Check failure on line 1 in Quickstart - Fine-tune a Vision Classifier.ipynb

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

Quickstart - Fine-tune a Vision Classifier.ipynb 

Notebook /SynapseMLBuild/build_1.0.9-spark3.5/Explore Algorithms/Deep Learning/Quickstart - Fine-tune a Vision Classifier.ipynb failed with state FAILED. For more information check the run page:  https://adb-1885762835647850.10.azuredatabricks.net/?o=1885762835647850#job/378090779042836/run/1037037192557356
Raw output 
java.lang.RuntimeException: Notebook /SynapseMLBuild/build_1.0.9-spark3.5/Explore Algorithms/Deep Learning/Quickstart - Fine-tune a Vision Classifier.ipynb failed with state FAILED. For more information check the run page: 
https://adb-1885762835647850.10.azuredatabricks.net/?o=1885762835647850#job/378090779042836/run/1037037192557356

	at com.microsoft.azure.synapse.ml.nbtest.DatabricksUtilities$.monitorJob(DatabricksUtilities.scala:350)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksNotebookRun.monitor(DatabricksUtilities.scala:475)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksUtilities$.runNotebook(DatabricksUtilities.scala:372)
	at com.microsoft.azure.synapse.ml.nbtest.DatabricksTestHelper.$anonfun$databricksTestHelper$6(DatabricksUtilities.scala:453)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
	at scala.util.Success.$anonfun$map$1(Try.scala:255)
	at scala.util.Success.map(Try.scala:213)
	at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Check failure on line 1 in pipeline with analyze image

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.SynapseML

pipeline with analyze image 

Failed:    response: HttpResponseProxy{HTTP/1.1 429 Too Many Requests [Cache-Control: no-cache,no-store, Pragma: no-cache, Content-Length: 368, Content-Type: application/json; charset=utf-8, Content-Language: en, Expires: -1, Server: Microsoft-IIS/10.0, request-id: e342c481-9b47-4c83-96c8-75c409968b34, elapsed-time: 178, Strict-Transport-Security: max-age=15724800; includeSubDomains, Date: Fri, 10 Jan 2025 01:09:46 GMT] ResponseEntityProxy{[Content-Type: application/json; charset=utf-8,Content-Length: 368,Chunked: false]}}    requestUrl: https://mmlspark-azure-search.search.windows.net/indexes?api-version=2023-07-01-Preview   requestBody: {"fields":[{"key":true,"name":"id","type":"Edm.String"},{"name":"url","type":"Edm.String"},{"fields":[{"name":"name","type":"Edm.String"},{"name":"score","type":"Edm.Double"},{"fields":[{"fields":[{"name":"name","type":"Edm.String"},{"fields":[{"name":"left","type":"Edm.Int32"},{"name":"top","type":"Edm.Int32"},{"name":"width","type":"Edm.Int32"},{"name":"height","type":"Edm.Int32"}],"name":"faceRectangle","type":"Edm.ComplexType"},{"name":"confidence","type":"Edm.Double"}],"name":"celebrities","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"name","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"landmarks","type":"Collection(Edm.ComplexType)"}],"name":"detail","type":"Edm.ComplexType"}],"name":"categories","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"isAdultContent","type":"Edm.Boolean"},{"name":"isRacyContent","type":"Edm.Boolean"},{"name":"adultScore","type":"Edm.Double"},{"name":"racyScore","type":"Edm.Double"}],"name":"adult","type":"Edm.ComplexType"},{"fields":[{"name":"name","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"tags","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"tags","type":"Collection(Edm.String)"},{"fields":[{"name":"text","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"captions","type":"Collection(Edm.ComplexType)"}],"name":"description","type":"Edm.ComplexType"},{"name":"requestId","type":"Edm.String"},{"fields":[{"name":"width","type":"Edm.Int32"},{"name":"height","type":"Edm.Int32"},{"name":"format","type":"Edm.String"}],"name":"metadata","type":"Edm.ComplexType"},{"fields":[{"name":"age","type":"Edm.Int32"},{"name":"gender","type":"Edm.String"},{"fields":[{"name":"left","type":"Edm.Int32"},{"name":"top","type":"Edm.Int32"},{"name":"width","type":"Edm.Int32"},{"name":"height","type":"Edm.Int32"}],"name":"faceRectangle","type":"Edm.ComplexType"}],"name":"faces","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"dominantColorForeground","type":"Edm.String"},{"name":"dominantColorBackground","type":"Edm.String"},{"name":"dominantColors","type":"Collection(Edm.String)"},{"name":"accentColor","type":"Edm.String"},{"name":"isBwImg","type":"Edm.Boolean"}],"name":"color","type":"Edm.ComplexType"},{"fields":[{"name":"clipArtType","type":"Edm.Int32"},{"name":"lineDrawingType","type":"Edm.Int32"}],"name":"imageType","type":"Edm.ComplexType"},{"fields":[{"name":"name","type":"Edm.String"},{"fields":[{"name":"x","type":"Edm.Int32"},{"name":"y","type":"Edm.Int32"},{"name":"w","type":"Edm.Int32"},{"name":"h","type":"Edm.Int32"}],"name":"rectangle","type":"Edm.ComplexType"}],"name":"brands","type":"Collection(Edm.ComplexType)"},{"fields":[{"fields":[{"name":"x","type":"Edm.Int32"},{"name":"y","type":"Edm.Int32"},{"name":"w","type":"Edm.Int32"},{"name":"h","type":"Edm.Int32"}],"name":"rectangle","type":"Edm.ComplexType"},{"name":"object","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"objects","type":"Collection(Edm.ComplexType)"}],"name":"test--1909886883-20250110010942023"}   responseBody: {"error":{"code":"","message":"An index with the name 'test--1909886883-20250110010942023' in service 'mmlspark-azure-search' could not be created. Index quota has been exceeded for this service. You must either delete unused indexes first, add a delay between ind
Raw output 
java.lang.RuntimeException: Failed: 
	 response: HttpResponseProxy{HTTP/1.1 429 Too Many Requests [Cache-Control: no-cache,no-store, Pragma: no-cache, Content-Length: 368, Content-Type: application/json; charset=utf-8, Content-Language: en, Expires: -1, Server: Microsoft-IIS/10.0, request-id: e342c481-9b47-4c83-96c8-75c409968b34, elapsed-time: 178, Strict-Transport-Security: max-age=15724800; includeSubDomains, Date: Fri, 10 Jan 2025 01:09:46 GMT] ResponseEntityProxy{[Content-Type: application/json; charset=utf-8,Content-Length: 368,Chunked: false]}} 
	 requestUrl: https://mmlspark-azure-search.search.windows.net/indexes?api-version=2023-07-01-Preview
	 requestBody: {"fields":[{"key":true,"name":"id","type":"Edm.String"},{"name":"url","type":"Edm.String"},{"fields":[{"name":"name","type":"Edm.String"},{"name":"score","type":"Edm.Double"},{"fields":[{"fields":[{"name":"name","type":"Edm.String"},{"fields":[{"name":"left","type":"Edm.Int32"},{"name":"top","type":"Edm.Int32"},{"name":"width","type":"Edm.Int32"},{"name":"height","type":"Edm.Int32"}],"name":"faceRectangle","type":"Edm.ComplexType"},{"name":"confidence","type":"Edm.Double"}],"name":"celebrities","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"name","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"landmarks","type":"Collection(Edm.ComplexType)"}],"name":"detail","type":"Edm.ComplexType"}],"name":"categories","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"isAdultContent","type":"Edm.Boolean"},{"name":"isRacyContent","type":"Edm.Boolean"},{"name":"adultScore","type":"Edm.Double"},{"name":"racyScore","type":"Edm.Double"}],"name":"adult","type":"Edm.ComplexType"},{"fields":[{"name":"name","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"tags","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"tags","type":"Collection(Edm.String)"},{"fields":[{"name":"text","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"captions","type":"Collection(Edm.ComplexType)"}],"name":"description","type":"Edm.ComplexType"},{"name":"requestId","type":"Edm.String"},{"fields":[{"name":"width","type":"Edm.Int32"},{"name":"height","type":"Edm.Int32"},{"name":"format","type":"Edm.String"}],"name":"metadata","type":"Edm.ComplexType"},{"fields":[{"name":"age","type":"Edm.Int32"},{"name":"gender","type":"Edm.String"},{"fields":[{"name":"left","type":"Edm.Int32"},{"name":"top","type":"Edm.Int32"},{"name":"width","type":"Edm.Int32"},{"name":"height","type":"Edm.Int32"}],"name":"faceRectangle","type":"Edm.ComplexType"}],"name":"faces","type":"Collection(Edm.ComplexType)"},{"fields":[{"name":"dominantColorForeground","type":"Edm.String"},{"name":"dominantColorBackground","type":"Edm.String"},{"name":"dominantColors","type":"Collection(Edm.String)"},{"name":"accentColor","type":"Edm.String"},{"name":"isBwImg","type":"Edm.Boolean"}],"name":"color","type":"Edm.ComplexType"},{"fields":[{"name":"clipArtType","type":"Edm.Int32"},{"name":"lineDrawingType","type":"Edm.Int32"}],"name":"imageType","type":"Edm.ComplexType"},{"fields":[{"name":"name","type":"Edm.String"},{"fields":[{"name":"x","type":"Edm.Int32"},{"name":"y","type":"Edm.Int32"},{"name":"w","type":"Edm.Int32"},{"name":"h","type":"Edm.Int32"}],"name":"rectangle","type":"Edm.ComplexType"}],"name":"brands","type":"Collection(Edm.ComplexType)"},{"fields":[{"fields":[{"name":"x","type":"Edm.Int32"},{"name":"y","type":"Edm.Int32"},{"name":"w","type":"Edm.Int32"},{"name":"h","type":"Edm.Int32"}],"name":"rectangle","type":"Edm.ComplexType"},{"name":"object","type":"Edm.String"},{"name":"confidence","type":"Edm.Double"}],"name":"objects","type":"Collection(Edm.ComplexType)"}],"name":"test--1909886883-20250110010942023"}
	 responseBody: {"error":{"code":"","message":"An index with the name 'test--1909886883-20250110010942023' in service 'mmlspark-azure-search' could not be created. Index quota has been exceeded for this service. You must either delete unused indexes fi
View more details on Azure Pipelines