<@U8SBFSF2B> a few comments about the <https://git...

# datascience

[altavir]

@Maria Khalusova a few comments about the https://github.com/JetBrains/kotlin-spark-api/wiki/Quick-Start-Guide#building-the-application-with-gradle.

• Why do you need shadow? Is it required for basic build?
• As far as I can understand, kotlin stdlib dependency is not required anymore for kotlin 1.4+.
• What about kotlin-jupyter?

[Maria Khalusova]

1. You need shadow (or any other preferred way of controlling includes/excludes) to exclude Spark and Scala from a jar that you're building to use with spark-submit.
2. This may be my bad. The original example was with earlier version of Kotlin, and when I updated the version to 1.4 I didn't take this new feature into account. I'll double check and update the example, if stdlib is not needed.
3. For Jupyter (or any other interactive work) we'll need to release kotlin spark shell. We are working on it, but it's not available in this first preview. Right now self-contained applications are supported.

[Ilya Muradyan]

3) Actually, it works with jupyter, but you need to use specific magic, see https://github.com/JetBrains/kotlin-spark-api/issues/35#issuecomment-668144435
Descriptor is not yet made, though