:information_source: I see that Google's recommend...
# koog-agentic-framework
d
ℹ️ I see that Google's recommended solution for LLM inference 'on the Edge' has become LiteRT-LM (with MediaPipe now deprecated for LLM). This is surely an important integration for Koog.ai, as it supports multiple platforms (while not having a KMP wrapper yet). However, the project doesn't yet have support for structured output via its Kotlin bindings! ⚠️ This is a critical weakness - for the broadest range of use-cases require structured output; only toy projects or narrow language-only cases can get away without it. There's an issue here to request Kotlin structured output be exposed.
👍 3
s
Hi @darkmoon_uk! Thanks for the heads-up and the link to the ticket. I’ve up-voted the ticket in LiteLT-RM repo as well. @Maria Tigina, do you have any info about the LiteRT support in Koog?
kodee pleased 1
d
Thanks @Sergei Dubov @Maria Tigina 🙏 - Relevant YouTrack issue here
m
We are happy to announce that we've just added LiteRT-LM client support https://github.com/JetBrains/koog/pull/1980 It's already available in nightly builds, but next week it will appear in the major release Currently, it supports chat and tool-calling, but not structured output as you've noticed (maybe only the manual one)
🔥 2
kodee excited 1
K 1
🚀 1
blob ty sign 1