Extremely minimal Compose Multiplatform sample tha...
# feed
j
Extremely minimal Compose Multiplatform sample that demonstrates use of on-device AI (Foundation Model Framework on iOS and MLKit Prompt API on Android) https://github.com/joreilly/OnDeviceAI
馃啋 1
馃敟 15
s
Nice. How about a Desktop target? 馃檪
That's always where it gets difficult on Windows. 馃槃
j
I was mostly aiming at demonstrating the on-device AI capability that Android and iOS have (at least in later devices/OS versions)
s
Yeah, it's really a bummer Windows doesn't come with something on-board. With TensorFlow, PyTorch, etc. there are so many choices.
d
This is really cool, thanks for sharing!
馃憤 1
Also, Windows has an Windows ML to run local models. I haven't tried it yet, still there are multiple APIs popping @Stefan Oltmann.
s
u
they have a java lib https://onnxruntime.ai/
and it's work with android and ios
work with windows mac, linux and web
I asked chatgpt for an alternative for Linux and he found this 馃檪
d
ONNX is a complete runtime. It's different than the ones embedded in the operating system because the runtime itself must be packaged with the app. Also, it requires downloading or embedding models to be loaded in runtime. It's a valid approach, just different than the examples in the repository that started this thread.
鈽濓笍 1