https://kotlinlang.org logo
#kotlin-spark
Title
# kotlin-spark
e

Eric Rodriguez

03/13/2024, 11:31 AM
anyone knows of a spark 3.3.2 jdk11 image that u can recommend?
👀 1
t

Tyler Kinkade

04/02/2024, 9:04 AM
@Eric Rodriguez Did https://github.com/apache/spark-docker/tree/master/3.3.2 end up working for you? I'm trying to get a Docker container running with Spark that I can use to process data via kotlin-spark in a Ktor app, but I'm having trouble getting the Docker container to stay up. It exits immediately with code 1 after starting it with
docker compose up
.
e

Eric Rodriguez

04/02/2024, 9:15 AM
I began trying but didn't finished, need to try again, basically u need to add the necessary commands, i.e.:
Copy code
command: ["master"]
and
Copy code
command: ["worker", "<spark://master:7077>"]
etc.
thank you color 1
oh wait, actually ...
this image is designed for k8s, so it looks for pod name and other k8s psecific things
😲 1
I may switch to minikube instead of docker-compose ...
t

Tyler Kinkade

04/02/2024, 10:35 AM
Thanks! I'll give that a try too.
e

Eric Rodriguez

04/02/2024, 2:25 PM
e

Eric Rodriguez

04/03/2024, 11:08 AM
Thanks, I had practically donde the same as i this post but had an error in my `start-spark.sh`script, could solve it with this
👍 1