londogard nlp toolkit 1 1 0 release partying face One of the

Question

londogard nlp toolkit 1 1 0 release partying face One of the if not the best NLP toolkit on the JVM <https github com londogard londogard nlp toolkit |GitHub londogard londogard nlp toolkit> Some of the updates includes optimizations classifiers vectorizers amp unsupervised keyword extraction See thread for more details

Hampus Londögård · Answer

Updates rocket Vectorizers BagOfWords CountVectorizer TF IDF BM 25 rocket Classifiers Binary Classifiers Logistic Regression Naïve Bayes Regression Linear Regression Sequence Classifier Hidden Markov Model rocket Keyword Extraction Co occurrence based rocket Sentence Splitting More Efficient Caching Using Caffeine which supplies State of the Art cache Also added for `LightWordEmbeddings` book Documentation by JavaDoc via Dokka white check mark Multiple Dependency updates Including my own addition to DJL which supplies Windows support for SentencePiece Tokenizer What it already contains Word Embeddings multiple variants Sentence Embeddings multiple variants Stemming WordFrequencies Stopwords Tokenizers including subword tokenization See the README for more information or open the Kotlin Jupyter Notebook with interactive docs

Hampus Londögård · Answer

Another fun fact moved from EJML to Multik as my main provider of matrices Only using EJML for one case doing a SVD

holgerbrandl · Answer

Cool project Do you know if NLP techniques have been applied to do log data modelling segmentation and classification E g to spot anomalous events in a series of log records

Hampus Londögård · Answer

Thanks blush There exists some projects that I ve heard about that attempted this But most in production ends up using simple rules For current unsupervised state of the art see LogBERT <https www researchgate net publication 349913512 LogBERT Log Anomaly Detection via BERT|https www researchgate net publication 349913512 LogBERT Log Anomaly Detection via BERT> I think the most successful NLP application for logs is a better search so called semantic search Another application I ve seen is to aggregate logs and dedupe to create a better overview Logs are a project I ve thought about going about personally moving from simpler to more advanced techniques

holgerbrandl · Answer

Thanks for this great and very useful answer

holgerbrandl · Answer

I love the release wording One of the if not the best Humble but also making a bold statement

Hampus Londögård · Answer

Gotta be a bit bold