I am seeking some more thoughts on this technical requirement.
We are having our partners send us Feeds to our REST API.
for such data ingestion/pipeline requirements, I worked on a few approaches like
1. AWS API Gateway -> Lambda(Kotlin) -> Kinesis
2. (Azure|AWS) API Gateway -> K9s(Ktor) -> (EventHubs |Kinesis) ->
3. Azure API Gateway -> Ktor -> EventHubs
Of all the options, I got good results and some issues.
I am biased towards #2 for the out-of-box request to stream integration and Zero downtime on consumer systems.
Do you have any recommendations and established architecture patterns for this? Please advise (Esp in Azure World).