Anyone know of a KMP library for loading and runni...
# multiplatforma
Adam Brown
05/07/2025, 5:54 AMAnyone know of a KMP library for loading and running local ML models?
m
Mikolaj
05/07/2025, 5:58 AMIf You find something please let me know, I was thinking about building one 😅
😄 1
Mikolaj
05/07/2025, 6:01 AMIdk if you know this one but here is an example app for running GGUF models on Android. The JNI bindings would work for plain java as well but for Native there should be another wrapper (.framework / .dll / .so ).
https://github.com/shubham0204/SmolChat-Android
Mikolaj
05/07/2025, 6:02 AMThe actual 'hard' part for this is setting up the build scripts 😄
s
saba
05/07/2025, 9:39 AMAlso in the same boat but I haven’t dug into it yet. I was looking at KInference for ONNX but haven’t tried yet
very nice 1