Damn…
JB: can you please clarify if IntelliJ runs tests in Gradle project without invoking Gradle test tasks?
Afaik the problem is that Gradle runs tests with own test runner, while IntelliJ only compiles code with Gradle and then runs tests on its own