A modern programming language that makes developers happier.

kotlinlang

anyone knows of a spark 3.3.2 jdk11 image that u can recommend?

mayb this: <https://github.com/apache/spark-docker/tree/master/3.3.2>

<@U06PH387JV7> Did <https://github.com/apache/spark-docker/tree/master/3.3.2> end up working for you?
I'm trying to get a Docker container running with Spark that I can use to process data via kotlin-spark in a Ktor app, but I'm having trouble getting the Docker container to stay up. It exits immediately with code 1 after starting it with `docker compose up`.

I began trying but didn't finished, need to try again, basically u need to add the necessary commands, i.e.:
```command: ["master"]```
and
```command: ["worker", "<spark://master:7077>"]```
etc.

this image is designed for k8s, so it looks for pod name and other k8s psecific things

I may switch to minikube instead of docker-compose ...

this looks promising too: <https://github.com/cluster-apps-on-docker/spark-standalone-cluster-on-docker>

Here's another useful how-to: <https://dev.to/mvillarrealb/creating-a-spark-standalone-cluster-with-docker-and-docker-compose-2021-update-6l4>

Thanks, I had practically donde the same as i this post but had an error in my `start-spark.sh`script, could solve it with this