hey there :slightly_smiling_face: I wanted to ask ...
# koog-agentic-framework
a
hey there 🙂 I wanted to ask whether there is plans in future to support proxied llm calls within koog? I know I can implement the various interfaces, but I wonder if there are plans to support customization in future
v
Hey! Could you please elaborate what do you mean by proxied? Each LLM client has settings for custom base URL and endpoints (so that you can use any self-hosted or proxied model servers):
Copy code
val myOpenAI = OpenAILLMClient(
        apiKey = "MY_KEY",
        settings = OpenAIClientSettings(
            baseUrl = "https://my.custom.proxy.com",
            chatCompletionsPath = "v2/my/chat/completions/custom/endpoint",
            responsesAPIPath = "v2/my/chat/responses/custom-endpoint",
            moderationsPath = "v3/very-very-custom-moderations",
            modelsPath = "v4/something/truly/custom",
        )
    )
You can also customize base HTTP client (you can use Ktor, OkHTTP, or java.net.HTTP client). For example:
Copy code
val myAnthropic = AnthropicLLMClient(
        apiKey = "MY_ANTRHOPIC_KEY",
        baseClient = HttpClient {
            defaultRequest {
                url("https://my/proxy/url")
            }
            install(Auth) {
                basic {
                    credentials {
                        BasicAuthCredentials(username = "jetbrains", password = "foobar")
                    }
                    realm = "Access to the '/' path"
                }
            }
        }
    )
a
ah perfect, thanks so much. Somehow I missed the
OpenAIClientSettings
in the docs and while going around in the various apis 🙂 this will work brilliantly
kodee loving 1