Hello! I'm working on a pet project and this is my...

# kotlindl

[Colton Idle]

Hello! I'm working on a pet project and this is my first time touching ai/ml/llm at all

I think my first project is to create a local "RAG" using compose for desktop. I was planning on doing this with ollama with gemma, but would kotlindl help me in my situation? essentially all i want to do is build a compose desktop app that takes in a markdown file, and then have a chat bot where you can chat about the txt file that's passed in.

[ashmelev]

Hi. I could be mistaken, but as I recall KotlinDL does not yet support LLM models

[ashmelev]

That said, the folks working on DL are making significant progress every day.... so, like I said, I could be mistaken

[zaleslaw]

Running the modern LLM it's not the old-good ML/DL for that all general DL frameworks were designed (as a KotlinDL also)

[Colton Idle]

interesting. okay. i just need to figure out how to ship llama2 (from meta) in my compose for desktop app 😄
want to just make a sandbox chat bot using compose for desktop + kotlin + llama2

[zaleslaw]

https://github.com/stepango/llama2-kmp I found only this project

[ashmelev]

Also, take a look at Langchain4j

[ashmelev]

I've not used it, but have read that some folks have had success with it

[Colton Idle]

oh cool. thanks! ill let you know what i end up with!