Hey all, With the Kafka Indexing Service now supporting incremental handoffs how are folks configuring the taskDuration of the kafka indexing service?
If the service was ingesting hourly data into hourly segments, would there be any downside to setting the taskDuration to one or more days? Or even just have the task run forever? The theorised advantage being when the task runs forever the service doesn't abruptly write smaller segments. Best regards, Dylan