flaky test: Aspire.Hosting.Tests.WaitForTests.DependencyWithGreaterThan1ReplicaAnnotationWaitsForAllToComplete

[davidfowl]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=937233
Build error leg or test failing: Aspire.Hosting.Tests.WaitForTests.DependencyWithGreaterThan1ReplicaAnnotationWaitsForAllToComplete
Pull request: #7363

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

[davidfowl]

Unfortunately these non helix tests don't capture DCP logs at the moment. We need to fix that, but it seems like we are hitting #7215:

| [2025-02-01T19:21:45] Aspire.Hosting.DistributedApplication Information: Aspire version: 9.1.0-ci
| [2025-02-01T19:21:45] Aspire.Hosting.DistributedApplication Information: Distributed application starting.
| [2025-02-01T19:21:45] Aspire.Hosting.DistributedApplication Information: Application host directory is: /mnt/vss/_work/1/s/tests/Aspire.Hosting.Tests
| [2025-02-01T19:21:45] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Waiting for resource 'nginx' to enter one of the target state: Waiting
| [2025-02-01T19:21:46] Aspire.Hosting.Dcp.DcpHost Information: Starting DCP with arguments: start-apiserver --monitor 32214 --detach --kubeconfig "/tmp/aspire.s9sti4/kubeconfig"
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
|                                                                                          Resource test/test update published:
|                                                                                          ResourceType = CustomResource,
|                                                                                          CreationTimeStamp = (null),
|                                                                                          State = { Text = (null), Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 1
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = ContainerResource,
|                                                                                          CreationTimeStamp = (null),
|                                                                                          State = { Text = (null), Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Resource nginx/nginx-apvcnedt-ceb0511 changed state: Starting
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 2
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = (null),
|                                                                                          State = { Text = Starting, Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:46] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Endpoint resources.
| [2025-02-01T19:21:46] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Service resources.
| [2025-02-01T19:21:46] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Container resources.
| [2025-02-01T19:21:46] Aspire.Hosting.Dcp.DcpExecutor Debug: Watching over DCP Executable resources.
| [2025-02-01T19:21:46] Aspire.Hosting.Tests.Resources.nginx Information: 1: 2025-02-01T19:21:46.5844201Z Waiting for resource 'test' to complete.
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Finished waiting for resource 'nginx'. Resource state is 'Waiting'.
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Resource nginx/nginx-apvcnedt-ceb0511 changed state: Starting -> Waiting
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 3
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = (null),
|                                                                                          State = { Text = Waiting, Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Resource test/test changed state: Finished
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 2
|                                                                                          Resource test/test update published:
|                                                                                          ResourceType = CustomResource,
|                                                                                          CreationTimeStamp = (null),
|                                                                                          State = { Text = Finished, Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:46] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Waiting for resource 'nginx' to enter one of the target state: Running
| [2025-02-01T19:21:46] Aspire.Hosting.Tests.Resources.nginx Information: 2: 2025-02-01T19:21:46.6699651Z Finished waiting for resource 'test'.
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server Information: Starting API server...
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.KubernetesService Debug: Successfully read Kubernetes configuration from '/tmp/aspire.s9sti4/kubeconfig' after 2021 milliseconds.
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server Information: API server started	{"Address": "127.0.0.1", "Port": 33095}
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcp.start-apiserver.dcp-host Information: Starting DCP controller host
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcp.start-apiserver.dcp-host Information: Started all services	{"count": 1}
| [2025-02-01T19:21:48] Aspire.Hosting.Devcontainers.Codespaces.CodespacesResourceUrlRewriterService Trace: Not running in Codespaces, skipping URL rewriting.
| [2025-02-01T19:21:48] Aspire.Hosting.DistributedApplication Information: Distributed application started. Press Ctrl+C to shut down.
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.DcpExecutor Trace: Updating application model resource nginx with Container resource nginx-apvcnedt-ceb0511
| [2025-02-01T19:21:48] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 4
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = 2025-02-01T19:21:48,
|                                                                                          State = { Text = (null), Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          ConnectionStrings__test = foo
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          container.id = (null)
|                                                                                          container.command = (null)
|                                                                                          container.args = 
|                                                                                          container.ports = 
|                                                                                          container.lifetime = Session
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcpctrl.ContainerOrchestrator Information: runtime status	{"ContainerRuntime": "", "runtime": "podman", "status": {"Installed":false,"Running":false,"Error":"exec: \"podman\": executable file not found in $PATH\nfailed to start podman command 'Info'"}}
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcpctrl.ContainerOrchestrator Information: runtime status	{"ContainerRuntime": "", "runtime": "docker", "status": {"Installed":true,"Running":true,"Error":""}}
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcpctrl.IdeExecutableRunner Information: Executables cannot be started via IDE: missing required environment variable 'DEBUG_SESSION_PORT'
| [2025-02-01T19:21:48] Aspire.Hosting.Dcp.dcpctrl Information: starting controller manager
| [2025-02-01T19:21:49] Aspire.Hosting.Dcp.DcpExecutor Trace: Updating application model resource nginx with Container resource nginx-apvcnedt-ceb0511
| [2025-02-01T19:21:49] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 5
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = 2025-02-01T19:21:48,
|                                                                                          State = { Text = (null), Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          ConnectionStrings__test = foo
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          container.id = (null)
|                                                                                          container.command = (null)
|                                                                                          container.args = 
|                                                                                          container.ports = 
|                                                                                          container.lifetime = Session
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:49] Aspire.Hosting.Dcp.DcpExecutor Trace: Updating application model resource nginx with Container resource nginx-apvcnedt-ceb0511
| [2025-02-01T19:21:49] Aspire.Hosting.ApplicationModel.ResourceNotificationService Debug: Resource nginx/nginx-apvcnedt-ceb0511 changed state: Starting
| [2025-02-01T19:21:49] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 6
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = 2025-02-01T19:21:48,
|                                                                                          State = { Text = Starting, Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          ConnectionStrings__test = foo
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          container.id = (null)
|                                                                                          container.command = (null)
|                                                                                          container.args = 
|                                                                                          container.ports = 
|                                                                                          container.lifetime = Session
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:49] Aspire.Hosting.Dcp.DcpExecutor Debug: Starting log streaming for nginx-apvcnedt-ceb0511.
| [2025-02-01T19:21:49] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server.container-logstreamer.ContainerOrchestrator Information: runtime status	{"ContainerRuntime": "", "runtime": "podman", "status": {"Installed":false,"Running":false,"Error":"exec: \"podman\": executable file not found in $PATH\nfailed to start podman command 'Info'"}}
| [2025-02-01T19:21:49] Aspire.Hosting.Dcp.DcpExecutor Trace: Updating application model resource nginx with Container resource nginx-apvcnedt-ceb0511
| [2025-02-01T19:21:49] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 7
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = 2025-02-01T19:21:48,
|                                                                                          State = { Text = Starting, Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          ConnectionStrings__test = foo
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          container.id = (null)
|                                                                                          container.command = (null)
|                                                                                          container.args = 
|                                                                                          container.ports = 
|                                                                                          container.lifetime = Session
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:49] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server.container-logstreamer.ContainerOrchestrator Information: runtime status	{"ContainerRuntime": "", "runtime": "docker", "status": {"Installed":true,"Running":true,"Error":""}}
| [2025-02-01T19:21:49] Aspire.Hosting.Tests.Resources.nginx Information: 3: 2025-02-01T19:21:49.2410000Z 332e6f2944e378af2271fab302368f20a1f3a0e0ca09811c091cb4430cd631a9
| [2025-02-01T19:21:50] Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler Information: Added new ContainerNetworkConnection	{"Container": {"name":"nginx-apvcnedt-ceb0511"}, "Reconciliation": 5, "Container": "332e6f2944e378af2271fab302368f20a1f3a0e0ca09811c091cb4430cd631a9", "ContainerNetworkConnection": "/nginx-apvcnedt-ceb0511-default-aspire-network-3va2esikqs"}
| [2025-02-01T19:21:50] Aspire.Hosting.Dcp.DcpExecutor Trace: Updating application model resource nginx with Container resource nginx-apvcnedt-ceb0511
| [2025-02-01T19:21:50] Aspire.Hosting.ApplicationModel.ResourceNotificationService Trace: Version: 8
|                                                                                          Resource nginx/nginx-apvcnedt-ceb0511 update published:
|                                                                                          ResourceType = Container,
|                                                                                          CreationTimeStamp = 2025-02-01T19:21:48,
|                                                                                          State = { Text = Starting, Style = (null) },
|                                                                                          HeathStatus = (null),
|                                                                                          ResourceReady = False,
|                                                                                          ExitCode = (null),
|                                                                                          Urls = {  },
|                                                                                          EnvironmentVariables = {
|                                                                                          ConnectionStrings__test = foo
|                                                                                          PATH = /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
|                                                                                          },
|                                                                                          Properties = {
|                                                                                          container.image = mcr.microsoft.com/cbl-mariner/base/nginx:1.22
|                                                                                          container.id = 332e6f2944e378af2271fab302368f20a1f3a0e0ca09811c091cb4430cd631a9
|                                                                                          container.command = (null)
|                                                                                          container.args = nginx, -g, daemon off;
|                                                                                          container.ports = 
|                                                                                          container.lifetime = Session
|                                                                                          },
|                                                                                          HealthReports = {
|                                                                                          }
| [2025-02-01T19:21:52] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 2, "Network": "default-aspire-network-j8qulht93k", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-j8qulht93k\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:21:56] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 3, "Network": "default-aspire-network-8fjg7hmkb8", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-8fjg7hmkb8\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:21:59] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 4, "Network": "default-aspire-network-1s67ah3qd8", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-1s67ah3qd8\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:03] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 5, "Network": "default-aspire-network-gdukopfg24", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-gdukopfg24\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:06] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 6, "Network": "default-aspire-network-liplaikqfc", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-liplaikqfc\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:12] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 7, "Network": "default-aspire-network-eilss4da04", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-eilss4da04\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:16] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 8, "Network": "default-aspire-network-5sgehf156o", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-5sgehf156o\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:19] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 9, "Network": "default-aspire-network-v3tir29i4o", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-v3tir29i4o\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:23] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 10, "Network": "default-aspire-network-isujm7m94c", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-isujm7m94c\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:26] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 11, "Network": "default-aspire-network-3nfe31atlk", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-3nfe31atlk\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:29] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 12, "Network": "default-aspire-network-sualjb5m14", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-sualjb5m14\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:33] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 13, "Network": "default-aspire-network-6vn09gv4vg", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-6vn09gv4vg\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:36] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 14, "Network": "default-aspire-network-jc5jfgsmvc", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-jc5jfgsmvc\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:39] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 15, "Network": "default-aspire-network-vis2fpif9k", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-vis2fpif9k\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:43] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 16, "Network": "default-aspire-network-mjq5jk8jm4", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-mjq5jk8jm4\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:46] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 17, "Network": "default-aspire-network-1926938dc4", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-1926938dc4\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:50] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 18, "Network": "default-aspire-network-t9hij9psg0", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-t9hij9psg0\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:53] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 19, "Network": "default-aspire-network-n7evb4m69g", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-n7evb4m69g\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:22:56] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 20, "Network": "default-aspire-network-0hvjv8o6so", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-0hvjv8o6so\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:00] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 21, "Network": "default-aspire-network-ulo0c4b6eo", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-ulo0c4b6eo\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:03] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 22, "Network": "default-aspire-network-mre4ib4fek", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-mre4ib4fek\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:07] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 23, "Network": "default-aspire-network-m39pmn997o", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-m39pmn997o\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:13] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 24, "Network": "default-aspire-network-3vg2ma28s0", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-3vg2ma28s0\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:16] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 25, "Network": "default-aspire-network-2r2aq857dk", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-2r2aq857dk\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:20] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 26, "Network": "default-aspire-network-cag37olkss", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-cag37olkss\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:23] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 27, "Network": "default-aspire-network-k3omd9hctk", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-k3omd9hctk\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:26] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 28, "Network": "default-aspire-network-ed47hqm398", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-ed47hqm398\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:30] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 29, "Network": "default-aspire-network-5tkm9nvtck", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-5tkm9nvtck\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:33] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 30, "Network": "default-aspire-network-v89b6nsm90", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-v89b6nsm90\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:36] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 31, "Network": "default-aspire-network-ptetm14vkc", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-ptetm14vkc\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:40] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 32, "Network": "default-aspire-network-ji04c65vh4", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-ji04c65vh4\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:43] Aspire.Hosting.Dcp.dcpctrl.NetworkReconciler Error: could not create the network as all available subnet ranges from the default pool are allocated, retrying...	{"NetworkName": {"name":"default-aspire-network"}, "Reconciliation": 33, "Network": "default-aspire-network-letmtbggf8", "error": "docker command 'InspectNetworks' returned with non-zero exit code 1: command output: Stdout: '\n' Stderr: 'Error: No such network: default-aspire-network-letmtbggf8\n'\nobject could not allocate required resources\nnetwork subnet pool full"}
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Executable resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Executable resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Container resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Container resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Service resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Service resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Cancellation received while watching Endpoint resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Stopped watching Endpoint resources.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.DcpExecutor Debug: Log streaming for nginx-apvcnedt-ceb0511 was cancelled.
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.dcp.start-apiserver.api-server.adminHttpHandler Information: API server shutdown initiated
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.dcp.start-apiserver Information: Shutting down...
| [2025-02-01T19:23:45] Aspire.Hosting.Dcp.dcp.start-apiserver Information: Stopping the application...