Turns out it is more complicated. You need to

npm run eject

then go to config directory and add it in the webpack config to pass to kotlin webpack plugin.

3rd party kotlin libs are not yet supported there out of the box