Can you explain the token usage statistics? On my ...
# firebender
s
Can you explain the token usage statistics? On my second prompt it says "6% of 1M tokens used".
k
each LLM has a context window limit
so we want to make it clear to the user how much of the context they've used to help manage the agent better
does this make sense?
s
It looks like a debug or expert option. Wouldn’t recommend to show this detail per default. It confuses if you don’t know what it means.