Hi
I was wondering if anyone has thought about the possibility of having
dynamic partitioning in Hive? Right now you typically use LOAD DATA or
ALTER TABLE to add new partitions. It would be great for applications
like Scribe that can load data into HDFS, could just place the data
into the correct folder structure for your partitions on HDFS. Has
anyone investigated this? What is everyone else doing in regards to
things like this? It seems a little error prone to have a cron job run
everyday adding new partitions. It might not even be possible to do
dynamic partitioning since its meta data read. But I'd love to hear
thoughts?
-Chris
- Dynamic Partitioning? Chris Goffinet
-