NEW: Subscribe to Hacking with Swift+ and accelerate your learning! >>

Not very clear how to read XCTest Performance Result

Forums > Swift

Hello!

I have read the chapter in the book "Testing Swift" on how to unit test code performance and everything seems to be clear. However when started practicing it became very unclear 🤨

I have run a performance test and have set a baseline, To see this unit test failing, I have manually edited the baseline value, saved and ran the test again. The displayed result is: Result 36427% worse but the test is still passing 🤨... The STDDEV is set to 1%.

My understanding was that if the test result is worse, then the test should fail. Why does the rest still pass if the result is that much worse?

   

Hacking with Swift is sponsored by Paw

SPONSORED Use Paw to build, test and describe web APIs. Paw has a lightning fast native macOS interface to compose requests, collaborate in real-time on API specs, and generate client code for your applications. You can import and export API definitions.

Discover Paw for Mac

Sponsor Hacking with Swift and reach the world's largest Swift community!

Reply to this topic…

You need to create an account or log in to reply.

All interactions here are governed by our code of conduct.

 
Unknown user

Not logged in

Log in
 

Link copied to your pasteboard.