hello all i m trying to download a 512 mb file with ktor but

Question

hello all i m trying to download a 512 mb file with ktor but after 250mb the app throws OOM I m justing showing what I receive ```val bytes = this val byteBufferSize = 1024 100 val byteBuffer = ByteArray byteBufferSize do val currentRead = bytes readAvailable byteBuffer 0 byteBufferSize if currentRead gt 0 println received $currentRead while currentRead gt 0 ```

Aleksei Tirman [JB] · Answer

I cannot reproduce OOM with a following code ```val client = HttpClient CIO client get lt HttpStatement gt <https mirror linux ia64 org ubuntu releases 20 04 2 0 ubuntu 20 04 2 0 desktop amd64 iso> execute response gt val channel ByteReadChannel = response receive val byteBufferSize = 1024 100 val byteBuffer = ByteArray byteBufferSize do val currentRead = channel readAvailable byteBuffer 0 byteBufferSize if currentRead gt 0 println received $currentRead while currentRead gt 0 ``` Could you please share a complete code snippet

Andre Servidoni · Answer

did you tried on a mobile device I m using on android

Aleksei Tirman [JB] · Answer

On a real device or an emulator

Andre Servidoni · Answer

real device This is my client setup ```private val httpClient = HttpClient engineConfig expectSuccess = false install JsonFeature val json = kotlinx serialization json Json ignoreUnknownKeys = true encodeDefaults = true serializer = KotlinxSerializer json install Logging logger = Logger DEFAULT level = LogLevel ALL defaultRequest url protocol = URLProtocol HTTPS host = cloudHost ```

Aleksei Tirman [JB] · Answer

What engine do you use

Andre Servidoni · Answer

CIO since this part is on the shared code module

Aleksei Tirman [JB] · Answer

I cannot reproduce it on a real device too According to profiler data GC doesn t let that happen

Andre Servidoni · Answer

disappointed I run again and get the same issue Failed to allocate and OOM

Andre Servidoni · Answer

I don t know what I m doing wrong my call is ```suspend fun getFile fileId String objectPath String HttpStatement = httpClient get $START PATH $userId $fileId $objectPath onDownload received contentLength gt println Received $received bytes from $contentLength ```

Aleksei Tirman [JB] · Answer

Could you please share a sample project

Andre Servidoni · Answer

I can prepare one

Andre Servidoni · Answer

another question ```do val currentRead = channel readAvailable byteBuffer 0 byteBufferSize if currentRead gt 0 println received $currentRead while currentRead gt 0 ``` I m not using the offset maybe I need to use it

Aleksei Tirman [JB] · Answer

This works fine with zero offset

Aleksei Tirman [JB] · Answer

I ve checked on <https ars els cdn com content image 1 s2 0 S0960982203005347 mmc6 txt>

Andre Servidoni · Answer

I tried with the offset like offset += currentRead and it just stop after 4 5MB downloaded

Andre Servidoni · Answer

if I left it 0 it will download the same range infinitelly I save what I was downloading in a file and after oom it was 10GB but the file is 512mb

Aleksei Tirman [JB] · Answer

The following code works as expected ```val client = HttpClient CIO val output = File output txt client get lt HttpStatement gt <https ars els cdn com content image 1 s2 0 S0960982203005347 mmc6 txt> execute response gt val channel ByteReadChannel = response receive val byteBufferSize = 1024 5 val byteBuffer = ByteArray byteBufferSize do val currentRead = channel readAvailable byteBuffer 0 byteBufferSize output appendBytes byteBuffer if currentRead gt 0 println received $currentRead while currentRead gt 0 ```