Jai Goyal
04/24/2026, 12:44 PM@LLMEndpoint(url = "https://...", authHeaderName = "Authorization", authHeaderValue = "Bearer $KEY")
@Serializable
data class ChatRequest(
@MessagesField val messages: ListJsonObject = emptyList(),
@StreamField val stream: Boolean = false
)
val client = RetroLLMFit.createChatRequest, ChatResponse()
It would support simple APIs, OpenAI-style chat, tool calling, and streaming — all using annotations.
Does this idea make sense? Or is there a reason to keep the current per-provider approach?