`xcodebuild` re-runs the same tests over and over on encountering a crash in unit tests

Originator:jmartin
Number:rdar://30681383 Date Originated:23-Feb-2017
Status:Open Resolved:
Product:Developer Tools Product Version:8.2.1
Classification:Serious Bug Reproducible:Always
 
Summary:
When kicking off tests from the command line, we are seeing issues with Xcode 8.0.0 and 8.2.1. It appears to be localized to scenarios where we are crashing within a GCD block and we're specifying the `--only-testing` flag.

This is particularly bad for us, as it breaks our reporting of failures for our continuous integration system. This makes it difficult for engineers to understand what the cause of the failure reason is, because it shows up as a timeout rather than as a crash.

Steps to Reproduce:
Clone sample project: https://github.com/justinseanmartin/XcodebuildCrashLoopRadar
Run: ./build.sh

Expected Results:
Should crash once

Actual Results:
Crashes in a loop forever until CTRL+C aborted

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!