https://kotlinlang.org logo
#kotlin-spark
Title
# kotlin-spark
e

Eric Rodriguez

03/20/2024, 6:22 AM
So I think the issue is my spark images have hadoop 3.3.2 but the kotlin-spark-api uses 3.3.6, just FYI
Copy code
+- org.jetbrains.kotlinx.spark:kotlin-spark-api_3.3.2_2.12:jar:1.2.4:compile
[INFO] |  +- org.jetbrains.kotlinx.spark:core_3.3.2_2.12:jar:1.2.4:compile
[INFO] |  +- org.jetbrains.kotlinx.spark:scala-tuples-in-kotlin_2.12:jar:1.2.4:compile
[INFO] |  +- org.jetbrains.kotlin:kotlin-stdlib-jdk8:jar:1.8.20:compile
[INFO] |  |  \- org.jetbrains.kotlin:kotlin-stdlib-jdk7:jar:1.8.20:compile
[INFO] |  +- org.apache.spark:spark-streaming_2.12:jar:3.3.2:runtime
[INFO] |  \- org.apache.hadoop:hadoop-client:jar:3.3.6:runtime
[INFO] |     +- org.apache.hadoop:hadoop-common:jar:3.3.6:runtime
[INFO] |     |  +- org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:jar:1.1.1:runtime
[INFO] |     |  +- org.apache.hadoop.thirdparty:hadoop-shaded-guava:jar:1.1.1:runtime
[INFO] |     |  +- commons-net:commons-net:jar:3.9.0:runtime