Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Repository	Step Name	Console log	Pull Request
1466775	dotnet/sdk	🟣 Build	Log	#54801
1466849	dotnet/sdk	🟣 Build	Log	#54621
1466783	dotnet/sdk	🟣 Build	Log	#54729
1466784	dotnet/sdk	🟣 Build	Log	#54730
1466744	dotnet/sdk	🟣 Run NativeAOT CLI Tests	Log	#54719
3001691	dotnet-sdk	🟣 Build	Log
3001223	dotnet-sdk	🛡 Guardian: BinSkim 4.4.9	Log
1465623	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54776
3001057	dotnet-sdk	Build	Log	#61867
1464104	dotnet/sdk	Monitor Helix Jobs	Log	#54766
1462794	dotnet/sdk	Monitor Helix Jobs	Log	#54725
1461453	dotnet/sdk	🟣 Build	Log	#54724
1461340	dotnet/sdk	🟣 Build	Log	#54724
1460906	dotnet/sdk	🟣 Queue Tests	Log	#54734
1459066	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54657
1457893	dotnet/sdk	🟣 Build	Log	#54681
1456872	dotnet/sdk	Run FullFramework Tests	Log	#54592
2996353	dotnet-sdk	Run Tests in Helix	Log	#61981
2995034	dotnet-sdk	🟣 Build	Log
1453929	dotnet/sdk	🟣 Build	Log	#54633
1453590	dotnet/sdk	Run TestBuild Tests	Log	#54570
1453492	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54524
1447373	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54513
1451961	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54625
1451777	dotnet/sdk	🟣 Run TestBuild Tests	Log
1451558	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54617
1451351	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54615
1450996	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54602
1450659	dotnet/sdk	Run TestBuild Tests	Log	#54054
1450693	dotnet/sdk	🟣 Build	Log	#54584
2992527	dotnet-sdk	NuGetAuthenticate@1	Log	#61852
1449901	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54591
2991969	dotnet-sdk	Download secrets: HelixProdKV	Log
2991803	dotnet-sdk	Build (alpine322)	Log	#61742
1448656	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54544
1448556	dotnet/sdk	🟣 Build	Log	#54578
1447667	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54529
2990849	dotnet-sdk	Run FullFramework Tests	Log	#61742
2990850	dotnet-sdk	Download secrets: EngKeyVault	Log	#61743
2990751	dotnet-sdk	Download Release Configs	Log
2990454	dotnet-sdk	🟣 Build	Log
2990250	dotnet-sdk	Download secrets: HelixProdKV	Log
1444468	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54501
2989324	dotnet-sdk	🟣 Build	Log
2989344	dotnet-sdk	🟣 Build	Log
2989188	dotnet-sdk	🟣 Build	Log
2989143	dotnet-sdk	🟣 Build	Log
1443472	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54528
2987335	dotnet-sdk	🟣 Build	Log
1440896	dotnet/sdk	🟣 Build	Log	#53950
2986709	dotnet-sdk	🟣 Build	Log
2986661	dotnet-sdk	🟣 Build	Log
1440031	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54459
1439368	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54391
2986241	dotnet-sdk	🟣 Build	Log
1438925	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54487
2985858	dotnet-sdk	NuGetAuthenticate@1	Log
1437695	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53867
2985513	dotnet-sdk	Download secrets: HelixProdKV	Log
1436899	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53950
2985288	dotnet-sdk	🟣 Build	Log
1422752	dotnet/sdk	🟣 Build	Log	#54330
1436463	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54410
2984828	dotnet-sdk	🟣 Build	Log
1436072	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54346
1436051	dotnet/sdk	🟣 Build	Log	#54336
2984531	dotnet-sdk	🟣 Build	Log
2984227	dotnet-sdk	🟣 Build	Log
1432685	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54419
2982249	dotnet-sdk	NuGetAuthenticate@1	Log
2981928	dotnet-sdk	NuGetAuthenticate@1	Log
1431541	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54337
2981352	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#61441
1430487	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54231
2979940	dotnet-sdk	🟣 Build	Log
2979560	dotnet-sdk	NuGetAuthenticate@1	Log
1427508	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54336
2979240	dotnet-sdk	🟣 Build	Log
1421610	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54313
2978171	dotnet-sdk	🟣 Build	Log
2977949	dotnet-sdk	🟣 Build	Log
1424970	dotnet/sdk	Build	Log	#54328
2977617	dotnet-sdk	NuGetAuthenticate@1	Log
1424363	dotnet/sdk	🟣 Build	Log	#54093

Build	Repository	Test	Pull Request
1463218	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.AspireLauncherIntegrationTests.ServerAndResources	#54725
1463037	dotnet/sdk	Microsoft.DotNet.Cli.New.IntegrationTests.McpServerTemplateTests.AllMcpServerProjectsRestoreAndBuild	#54726
1450240	dotnet/sdk	dotnet-new.IntegrationTests.dll.2.WorkItemExecution	#54596
1449238	dotnet/sdk	dotnet.Tests.dll.13.WorkItemExecution	#53943
1430490	dotnet/sdk	dotnet-new.IntegrationTests.dll.3.WorkItemExecution	#54384
1430254	dotnet/sdk	dotnet.Tests.dll.21.WorkItemExecution	#54390

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
9	20	90

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.

[tmat]

@baronfel @jaredpar should this issue be closed?

[baronfel]

I don't think so - the tracker is still making recent edits, which impliies it's still being hit.

[tmat]

So the fix above didn't fix it?