Hey! Wanted to share the story of how we created a...

# opensource

[Nathan Fallet]

Hey!
Wanted to share the story of how we created a scrapping library in Kotlin
https://www.reddit.com/r/Kotlin/comments/1lsnytm/from_python_to_kotlin_why_we_rewrote_our_scraping/

[Nathan Fallet]

Eventually if the framework gets bigger, it could have its own slack channel, the same way there are for koog, koin, … or any big library for Kotlin.
It’s a totally new field of Kotlin to explore!

[robstoll]

out of curiosity, did you still have to implement some stealth techniques or was using Windows just enough to be accepted by bot detection systems? I guess you still had to fake User-Agent, navigator.webdriver and the like, or not?

[Anonymike]

Nice work!

[Nathan Fallet]

@robstoll We don’t have anything else than Windows and a proxy (to have residential IPs instead of datacenter ones), since starting Chrome and controlling it with CDP is having the same User Agent and everything as if you were opening Chrome on a Windows computer and do things by hand. That’s why we are using CDP and not a driver based like selenium under the hood.