alamb commented on issue #21992:
URL: https://github.com/apache/datafusion/issues/21992#issuecomment-4450827153
We spoke about this topic the other day in person when we were at the NYC
meetup
I believe @gene-bordegaray 's usecase will be satisfied if we can represent
range partitioning that is represented like
* `[expr]`: `[[ranges]]`
For example, partitioning on `date` would be represented like
* `[date]`: [
[[2021-01-01, 2021-12-32]]
[[2022-01-01, 2022-12-32]],
...
]
partitioning on `date, city` would be represented like
* `[date, city]`: [
[[2021-01-01, 2021-12-32], [Allston, Boston]]
[[2021-01-01, 2021-12-32], [Boston, NYC]]
[2022-01-01, 2022-12-32], [Allston, Boston]]
[2022-01-01, 2022-12-32], [Boston, NYC]]
...
]
Some TBD details are:
1. How to ensure the entire range is covered (e.g. what range in the above
example handles 1970-01-01)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
