Curious what local models folks are using? Followi...

# koog-agentic-framework

[John O'Reilly]

Curious what local models folks are using? Following is best one I've seen so far (at least for what I'm doing here) but haven't done exhaustive comparison https://x.com/joreilly/status/2053045561285066763?s=20

[El Anthony]

Likewise, I haven't done any exhaust comparisons, but Qwen models are great.

[Yogeshvu]

this tool seems like a nice way to understand what the current hardware can support which LLM models run comfortably well: llmfit https://github.com/AlexsJones/llmfit

[John O'Reilly]

I think what I'm seeing is pretty consistent with what's being shown with llmfit (at least for ollama models)

[John O'Reilly]

hmm, though not sure it's labeled correctly