hnakamor opened a new issue, #13230:
URL: https://github.com/apache/druid/issues/13230
Hi all,
The SQL-based ingest by MSQ is a great feature. I have tried it and in my
environment it has roughly doubled the data ingestion speed.
However, it seems that all segment granularity and specific intervals, which
are possible with Native Batch Ingestion, are not possible with MSQ.
Thus, it is not possible to generate daily segments that take time zones
into account.
The following is an example of specifying with Navite Batch Ingestion.
```
{
"spec": {
"dataSchema": {
"granularitySpec": {
"segmentGranularity": "all",
"intervals": [
"2000-01-01T15:00/2000-01-02T15:00"
]
}
}
}
}
```
Confirmed on 25.0.0-SNAPSHOT and 24.0.0。
It would be useful if MSQ could generate daily segments that take time zones
into account.
Considering the overwrite, in my timezone, the only partition option in MSQ
is HOUR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
