Hello, what would you guys recommend to use for im...

# ai

[Alexandre Brown]

Hello, what would you guys recommend to use for image pre-processing on Kotlin ? (Equivalent to what PIL offers)
I'm looking for something simple that can do what PIL did for me on Python when it came to loading raw images bytes into (m,C,H,W) matrix.

If possible I'd prefer a library that is lightweight, I just need to do preprocessing of raw bytes into rgb matrix and maybe basic normalization if possible. But if there is no library just for that then I'll take whatever works.

Should I try D4J or OpenCV Java or is there a better Kotlin alternative? Thanks

[zaleslaw]

Could you share please the list of required preprocessing ops or the whole Python code?

[zaleslaw]

At this moment opencv is the best option, but it's opencv

[Alexandre Brown]

@zaleslaw Sure, nothing crazy, Normalization (mean,std),ByteArray to RGB N-array, reshape.

PS: I can't wait for Kotlin to overtake the data science world.

[Alexandre Brown]

I can send you code snippets when I get home

[zaleslaw]

Yes, it will be great

[Alexandre Brown]

@zaleslaw Something like this but in Kotlin (one screenshot uses PyTorch, the other one does almost the same thing but in Numpy instead)

PS: The normalize values are just fillers for the purpose of the discussion, we might not always want grayscale.

[zaleslaw]

What torch transforms do you usually use? I see to tensor/normalize.

Do you use any resize method or methods for noise removing?

[zaleslaw]

Maybe something else?

[zaleslaw]

What np operations do you use? (I see reshape) what about transpose?

[Alexandre Brown]

Yes resizing transforms, horizontal flip are other transforms that we could use

[Alexandre Brown]

We are trying to see if we can do the preprocessing/postprocessing in kotlin and keep the model in python or if we must do the pre-processing in python as well. I will explore OpenCV Java, if you have a better alternative let me know.

[zaleslaw]

It's actual question for me too, of course I share if found something better or image preprocessing dsl in KotlinDL will cover more basic use cases

[Alexandre Brown]

@zaleslaw Does KotlinDL have those preprocessing mentioned above ? Load image into tensor, reshape tensor, resize, normalize ? If not what do you use ?

[zaleslaw]

@Alexandre Brown yes, we have a basic image preprocessing dsl https://blog.jetbrains.com/kotlin/2021/05/kotlin-dl-0-2/#ImagePreprocessing, look at this example https://github.com/JetBrains/KotlinDL/blob/master/examples/src/main/kotlin/examples/dataset/VGGCifar10OnFly.kt

[zaleslaw]

It will be extended in the 0.3, we are planned to add a few transformation from torchvision to support preprocessing (and postprocessing) for ONNX models for Image Recognition, Object Detection, Face Alignment and so on