<@UBYRZL63C> I responded in a thread to your origi...
# datasciencek
kz
10/01/2018, 9:15 PM@Antero Duarte I responded in a thread to your original post in #general but for others here, you should consider using the Java API (so JavaRDD). It accepts Java interfaces for all the higher order functions which interop with Kotlin lambdas orders of magnitude better.
a
Antero Duarte
10/02/2018, 1:44 PMThat's good advice. Thing is I'm writing code for a project that uses scala and I don't know Spark that well, so I just went with it, knowing that I'd rather write kotlin than Java or Scala 😂
Antero Duarte
10/02/2018, 1:44 PMI'll probably refactor to use the Java API in the near future
Antero Duarte
10/02/2018, 1:50 PM5 minutes into work and switching to a JavaRDD has already fixed a bug 😂
k
kz
10/02/2018, 3:04 PM🙂
kz
10/02/2018, 3:06 PMIt's also good to note that you can arbitrarily jump from the scala API to the java one with no performance hit so if you're writing new code (and I assume you have to be to do it in Kotlin if most of the project is in Scala) you can easily have your code accept the scala rdd, convert it to java, work with that using kotlin, and then convert back to scala for the legacy code.
a
Antero Duarte
10/04/2018, 8:44 AMThat's exactly what I did :)
2 Views