Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
876270 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45007
876391 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44540
876387 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44963
2586915 dotnet-sdk dotnet-watch.Tests.dll.3.WorkItemExecution #45249
876242 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
876138 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
875084 dotnet/sdk Microsoft.NET.Clean.Tests.dll.WorkItemExecution #44958
876040 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44417
875914 dotnet/sdk dotnet.Tests.dll.27.WorkItemExecution #44786
875908 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45021
875878 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #44974
875785 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
875754 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #45009
875651 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #44417
875513 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44828
875499 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44805
875495 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #44417
874185 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44805
875354 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44786
874245 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution #44899
875288 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
875211 dotnet/sdk dotnet.Tests.dll.14.WorkItemExecution #44967
875019 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44417
875023 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution #44828
874749 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #44974
874772 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44986
874824 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44988
874653 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44980
874402 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44962
874562 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.19.WorkItemExecution #44974
874542 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
874471 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44953
874254 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44967
874428 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
874416 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44801
874413 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44972
874255 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44966
874364 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #44786
874350 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #44866
874270 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #44786
874130 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44570
874047 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
873732 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44540
872715 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44899
873728 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.13.WorkItemExecution #44907
873500 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution #44952
873400 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44805
873686 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44570
873645 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44958
873544 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #44956
873521 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44953
873504 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44942
873461 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44953
873301 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44947
873295 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44945
873186 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44924
873070 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44924
871941 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution #44812
872983 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
872916 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44934
872904 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44939
872895 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.13.WorkItemExecution #44805
872885 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
872868 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44802
872760 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44938
872812 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44924
872692 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44934
872634 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44810
872547 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44829
872435 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44928
872434 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44927
872392 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44801
872357 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44691
872286 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44805
872222 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44924
872207 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44801
872042 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44810
872031 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44861
871967 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44918
871957 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44866
871938 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44916
871873 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44810
871858 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44786
871782 dotnet/sdk Microsoft.NET.ToolPack.Tests.dll.3.WorkItemExecution #44810
871563 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44786
871531 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44802
871345 dotnet/sdk Microsoft.NET.Build.Tests.dll.5.WorkItemExecution #44691
871339 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44899
871296 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44691
871002 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44808
871083 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44802
871054 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution #44765
871038 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution #44834
871017 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44849
871013 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44815
871010 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44813
870971 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution #44810
870893 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44890
870741 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44816
870714 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44802
Displaying 100 of 350 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
14 98 350
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants