Sparklin 0.2 is released! Fast new REPL engine, syntax highlight, customizable prompt and other feat...

# datascience

[Vitaly Khudobakhshov [JB]]

Sparklin 0.2 is released! Fast new REPL engine, syntax highlight, customizable prompt and other features. Tested in production on cluster with CentOS Linux / Spark 1.6.3 / Hadoop 2.7. Experimental Kotlin support for Zeppelin is also added (without Spark right now). https://github.com/khud/sparklin

[holgerbrandl]

Is there a way to declare custom dependencies when running kshell?

[Vitaly Khudobakhshov [JB]]

Of course, you can add jars to JARS variable in bin/kshell.sh. The same is for Spark runners.

[holgerbrandl]

I’ve just tried but it seems that the classloader of the kshell process and the repl are not the same:

JARS=${KOTLIN_COMPILER}:${KOTLIN_STDLIB}:${KOTLIN_REFLECT}:${KOTLIN_SCRIPT_RUNTIME}:${KSHELL_CONSOLE_JLINE3}:${KSHELL_REPL_API}:/Users/brandl/.m2/repository/de/mpicbg/scicomp/krangl/0.10-SNAPSHOT/krangl-0.10-SNAPSHOT.jar

[holgerbrandl]

sparklin]$ bin/kshell.sh 
[1] import krangl.*
error: unresolved reference: krangl
import krangl.*

[Vitaly Khudobakhshov [JB]]

Thanks, I will try. Give me a minute

[Vitaly Khudobakhshov [JB]]

Yes, the problem exists. But only in the case of kshell, spark shell works fine. I will try to fix it just now.

[Vitaly Khudobakhshov [JB]]

Fixed in master. You can try

[bkenn]

Love the name