Hey, folks. I came across the LLMClient API, and t...
# koog-agentic-framework
k
Hey, folks. I came across the LLMClient API, and the interface returning list of Message.Responses instead of wrapper object seems unusual. Would it make sense to have a wrapper object with a list of Message.Responses as a field? It might include some metadata/usage in the future…
d
Hey! Individual chat responses contain a metadata object. The token usage is already there. So you can find the token usage of the last LLM query inside the last
Message.Assistant
object, even when the individual responses have been ingested in the history
Prompt
object in the agent environment. (This is btw, what
Prompt.lastTokenUsage
does.) Are there any other metadata you think are missing in the
ResponseMetaInfo
?
k
Token usage seems to be enough as metadata. I expected slightly different api shape and thus my question
👍 1