A modern programming language that makes developers happier.

kotlinlang

Good morning, I'm trying out Koog and, in the meantime, I'm exploring the world of LLMs and AI. My question is, is it possible to use a custom LLM or, if on mobile devices, a local LLM as an LLM?

Hi, Paolo
You may use custom LLM and the team is working on the on-device model support
<https://github.com/JetBrains/koog/issues/262>

e.g. you may connect to openai-api compatible model from spring <https://docs.koog.ai/spring-boot/>

or create your own llm configuration
<https://docs.koog.ai/model-capabilities/#creating-a-model-llmodel-configuration>

or, e.g. <https://github.com/kpavlov/koog-sauce/blob/main/koog-sauce-spring-ai/src/jvmMain/kotlin/me/kpavlov/koog/sauce/spring/ai/chat/SpringAiLLMClient.kt|wrap> spring-ai llm client