Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
910610 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45788
910468 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45786
910583 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45772
910459 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #44523
910011 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #45709
909926 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45771
909298 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45754
909500 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45725
909693 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #45767
909509 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #44523
909249 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45442
908912 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45598
908876 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #45745
909020 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45748
908710 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45732
907939 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #45729
907800 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45704
907750 dotnet/sdk dotnet.Tests.dll.1.WorkItemExecution #45724
907726 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45726
907628 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #45725
907619 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45418
907391 dotnet/sdk Microsoft.NET.Build.Tests.dll.11.WorkItemExecution #45354
907365 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.21.WorkItemExecution #45720
907489 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45138
907352 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #45418
907324 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45722
907233 dotnet/sdk Microsoft.NET.Build.Tests.dll.15.WorkItemExecution #45718
906666 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #45712
907001 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45705
906969 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45702
906836 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45703
906825 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45710
906731 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45705
906665 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45713
906653 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45702
906556 dotnet/sdk Microsoft.NET.Publish.Tests.dll.2.WorkItemExecution #45705
906526 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #45707
906534 dotnet/sdk dotnet-sln.Tests.dll.1.WorkItemExecution #45708
906436 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45705
906422 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45419
906341 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45704
906222 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45703
906140 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45702
905874 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45700
905858 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45699
905840 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45698
905820 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45696
905783 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45692
905722 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45688
905724 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45689
905716 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45680
905674 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45680
905462 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45487
905342 dotnet/sdk Microsoft.NET.Publish.Tests.dll.9.WorkItemExecution #45614
905392 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #45419
905313 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45683
905244 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #45681
905186 dotnet/sdk dotnet.Tests.dll.14.WorkItemExecution #45680
905110 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45679
904985 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45677
905053 dotnet/sdk dotnet-sln.Tests.dll.1.WorkItemExecution #42416
904996 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45678
904981 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #42416
904963 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45665
904831 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45676
904727 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45665
904735 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45019
904710 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45664
904684 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution #42416
904641 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #45618
904411 dotnet/sdk Microsoft.NET.Publish.Tests.dll.8.WorkItemExecution #42416
904167 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45636
904201 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45620
903860 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45650
904177 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45657
903341 dotnet/sdk Microsoft.NET.Build.Tests.dll.3.WorkItemExecution #45614
904140 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45625
904084 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution #45653
903944 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #42416
903935 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45019
903896 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #42416
903781 dotnet/sdk dotnet-sln.Tests.dll.2.WorkItemExecution #45647
903749 dotnet/sdk Microsoft.NET.Build.Tests.dll.12.WorkItemExecution #45629
903748 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45630
903619 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45644
903621 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45589
903407 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45642
903382 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45637
903360 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #45625
903294 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45639
903240 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45637
903207 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45635
902850 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45160
901349 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45589
902880 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45630
902686 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45630
902648 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #42416
902506 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45622
902436 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45623
902478 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution #45567
Displaying 100 of 455 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
12 64 455
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
@marcpopMSFT marcpopMSFT added this to the 10.0.1xx milestone Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants