Hi all
not sure if this is discussed before, but does the merging for ORC works:
alter table ... partition() concatenate for ORC
, tried several times never been successful and some google search show
some failure encountered by others as well. is this best way to merge small
ORC files??
many
If you meant 'scheduled' first perhaps thats doable by following (almost)
what Gera says. The framework actually explicitly sorts your InputSplits
list by its reported lengths, which would serve as the hack point for
inducing a reordering. See