how does one simultaneously iterate on multiple fl...
# coroutinesj
jimn
12/09/2019, 9:35 PMhow does one simultaneously iterate on multiple flows in the same loop to get the same index? without calling toList() first
e
elizarov
12/09/2019, 9:39 PMzipj
jimn
12/09/2019, 9:39 PMfor 1000 flows?
e
elizarov
12/09/2019, 9:40 PMWhy not. But what’s the use-case?
j
jimn
12/09/2019, 9:40 PMim doing group by key..n, list<value...>
e
elizarov
12/09/2019, 9:41 PMHow you ended up with 1000 identically indexed flows?
j
jimn
12/09/2019, 9:41 PMmmap
jimn
12/09/2019, 9:41 PMfixed width files with .. obviosly fixed columns
e
elizarov
12/09/2019, 9:41 PMWhy would you need flows here? It is totally synchronous
j
jimn
12/09/2019, 9:44 PMthe syncronous code works to n rows but im trying to switch out Array<Any?> with Flow<Any?> in a few places to remedy heap explosion in the intermediaries
e
elizarov
12/09/2019, 9:44 PMUse sequence
j
jimn
12/09/2019, 9:44 PMand GroupBy is actually converting Array<T> to Array<Array<T>>
jimn
12/09/2019, 10:06 PMdoes flow->sequence->iterator violate any principals or is it just waiting to gel ? my impression is that sqeuences are going to make multiprocessing slightly more mental accounting than calling flatMapMerge
jimn
12/09/2019, 10:09 PMwith the exception of zip i see no other multiple flow collector that acts like a latch syncronizer
jimn
12/09/2019, 10:12 PMthe idea started as having n cores spaced at 2GB intervals to cleanly divide source decoders at the bottom of the draw-thru driver layer.
5 Views