Flaky Test Explorer test in CI

[award999]

Seen this fail in CI and locally

  1 failing
  1) Test Explorer Suite
       Standard
         Run Tests (Parallel)
           XCTests (Run Tests (Parallel))
             Runs failing test:

      AssertionError [ERR_ASSERTION]: Expected values to be loosely deep-equal:

{
  errored: [],
  failed: [
    {
      issues: [
        'Failed'
      ],
      test: 'PackageTests.FailingXCTestSuite/testFailing'
    },
    {
      issues: [],
      test: 'PackageTests.FailingXCTestSuite'
    }
  ],
  passed: [],
  skipped: [],
  unknown: 0
}

should loosely deep-equal

{
  errored: [],
  failed: [
    {
      issues: [
        'failed - oh no'
      ],
      test: 'PackageTests.FailingXCTestSuite/testFailing'
    },
    {
      issues: [],
      test: 'PackageTests.FailingXCTestSuite'
    }
  ],
  passed: [],
  skipped: [],
  unknown: 0
}
      + expected - actual

         "errored": []
         "failed": [
           {
             "issues": [
      -        "Failed"
      +        "failed - oh no"
             ]
             "test": "PackageTests.FailingXCTestSuite/testFailing"
           }
           {
      
      at assertTestResults (test/integration-tests/testexplorer/utilities.ts:137:12)
      at Context.<anonymous> (test/integration-tests/testexplorer/TestExplorerIntegration.test.ts:702:42)

1 test failed.

[plemarquand]

@award999 can you reproduce this consistently locally? I've never been able to, but I have seen it in CI. If you can, what toolchain are you using?

[award999]

Definitely not consistent :/