XCTest: Ability to retry failed/flaky tests

Originator:ripun008
Number:rdar://47537410 Date Originated:1/24/2019
Status:Open Resolved:
Product:Developer Tools Product Version:10.1
Classification:Feature Request Reproducible:Yes
 
The XCTest Framework in its current capacity does not provide us Developers/QA  with the ability to rerun failed/flaky tests. It would be nice to have a feature like this implemented wherein you could specify how many times you would like to run flaky tests and they would be run that many times. What i am looking for is something similar to a @Retry annotation which TestNG (http://static.javadoc.io/org.testng/testng/6.13/org/testng/IRetryAnalyzer.html) & JUnit test frameworks have. 
I don't think the current XCTest framework has anything like this, so it would be nice to have it implemented as it would benefit everyone. If such a thing already exists, then please point me in the right direction.

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!