Hi, I am using the Pitest Intellij plugin along wi...
# kotestn
Natasha
08/04/2023, 3:14 PMHi, I am using the Pitest Intellij plugin along with some property based tests I have that uses kotest. The mutation testing report indicates mutant killed by the test. Is it possible to get the seed used by kotest to reproduce the test failure for a mutant that is killed? Because running kotest by manually adding the same mutant does not indicate a test failure.
e
Emil Kantis
08/04/2023, 3:18 PMSee https://kotest.io/docs/proptest/property-test-seeds.html#rerunning-failed-seeds, you should be able to find the seed
n
Natasha
08/04/2023, 3:20 PMRunning kotest independently does produce the seed used in the event of a failure. But when you use Pitest, this is not produced in the mutation testing output or the report.
e
Emil Kantis
08/04/2023, 3:21 PMSee the link
Emil Kantis
08/04/2023, 3:22 PMAre you saying there’s no file in the location specified?
n
Natasha
08/04/2023, 3:27 PMDidn’t find this file on my machine
~/.kotest/seeds/<spec>/<testname>e
Emil Kantis
08/04/2023, 3:29 PMIt could be that the file has been deleted if you’ve run the test again with another mutant afterwards?
n
Natasha
08/04/2023, 3:36 PMRan kotest on buggy code. The test failed but unable to find this file. The kotest failure output does say “Repeat this test by using seed -5558322341885203881”
j
Javier
08/04/2023, 6:11 PM@Emil Kantis unrelated to Pitest, but yesterday, in a normal plugin with kotest assertions + kotest property testing, the seed file was missing. I am using the latest versions
Javier
08/04/2023, 6:12 PMIndeed I have rechecked it now, it is not in the build dir, and it isn't on my home dir too
Javier
08/04/2023, 6:12 PMCan you check it is working for you, if not, I can open an issue
e
Emil Kantis
08/04/2023, 8:34 PMIt's working for me. What platform are you targeting?
j
Javier
08/04/2023, 9:18 PMall, KMP
e
Emil Kantis
08/05/2023, 9:10 AMLooks like
writeSeedj
Javier
08/05/2023, 9:17 AMI would expect that jvm tests would write the seed, which should be the same for the rest, and I have seen that seed in the past, not sure if in the file or in the logs now…
But anyway looks like a feature request
n
Natasha
08/07/2023, 1:15 PMA more general question, how do you reproduce test failures for “KILLED” mutants detected by pitest?
4 Views