How to assure there is complete coverage

Posted July 8, 2024


I had the interview with the Athela’s engineer and he proposed a test case that I didn’t add in the initial test suite and it was failing in the original implementation.

So, then how come I said that the code was fully tested and there was a case that was not considered. And not only that, but what other scenarios I might be missing. And please note that code coverage said that with test cases added for the revised suite there was 100% coverage and I was certifying the release. Not a good thing for the release! An escape to the field.

How is it possible to say that I tested the code completely? That is a good question! Should I test all possible 5-letter words that appear in the dictionary? Is that too much, or are we forced to do that? Notice that I thought I had everything covered and the interviewer was able to break my test plan with the word “Hello”!. How can we add all the test scenarios? I am not sure!

For more details on what happened on the interview see implementation, test and test coverage on this repository.