can anyone give me initial direction for web scraping in Kot kotlinlang #getting-started

Channels

kotlin-foundation

compose-android

ohio-kotlin-users

kotlin-by-example

sofl-user-group

kotlin-multiplatform-contest

tricity-kotlin-user-group

kotlin-in-action

android-databinding

cincinnati-user-group

fluid-libraries

codemash-precompiler

kotlingforbeginners

jhipster-kotlin

prozis-android-backup

realworldkotlin

graviton-browser

spring-security

domain-driven-design

connect-audit-events

swiss-user-group

effectivekotlin

refactoring-to-kotlin

russian-kotlinasfirst

androidgithubprojects

introduce-yourself

pocketgitclient

effective-kotlin

algolialibraries

lambdaworld_cadiz

intellij-tricks

kotlin-pakistan

navigation-architecture-component

strife-discord-lib

machinelearningbawas

leedskotlinusergroup

stayhungrystayfoolish

kotest-contributors

practical-functional-programming

swagger-gradle-codegen

100daysofkotlin

kotlinultimatechallenge

pattern-matching

kotlinforbeginners

competitive-programming

compose-ui-showcase

competitivecoding

kotlin-data-storage

skia-wasm-interop-temp

java-to-kotlin-refactoring

event21-community-content

androidx-xprocessing

embedded-kotlin

fb-internal-demo

image-processing

myndocs-oauth2-server

kotlintest-devs

beepiz-libraries

kotlinprogrammers

cscenter-course-2016

k2-early-adopters

intellij-plugins

language-proposals

library-development

refreshversions

language-evolution

kotlinx-datetime

framework-elide

compose-desktop

jvm-ir-backend-feedback

android-architecture

100daysofkotlin-2021

github-workflows-kt

python-contributors

squarelibraries

arrow-contributors

codingconventions

getting-started

Title

m

Marko Novakovic

04/19/2022, 4:42 PM

can anyone give me initial direction for web scraping in Kotlin?

m

Matthew Gast

04/19/2022, 5:38 PM

There are a few options depending on which target you are aiming for. Off the top of my head, I know of Skrape{it} and jsoup for Kotlin/JVM. Skrape{it}: https://github.com/skrapeit/skrape.it jsoup: https://jsoup.org/

m

Marko Novakovic

04/19/2022, 8:12 PM

thank you

I will check them both out and try them for my usecase

@Matthew Gast I want to scrape

shtml

but those both seem to have problem with it. am getting malformed input errors

m

Matthew Gast

04/19/2022, 9:47 PM

I believe jsoup has an option to treat the document as XML, which has more lax rules about allowed input. You can try searching for information about that.

m

Marko Novakovic

04/20/2022, 8:48 AM

thank you

3 Views

#getting-started Join Slack