alter table ... partition() concatenate for ORC

2015-07-30 Thread Du Lam
Hi all not sure if this is discussed before, but does the merging for ORC works: alter table ... partition() concatenate for ORC , tried several times never been successful and some google search show some failure encountered by others as well. is this best way to merge small ORC files?? many

Re: Sorting the inputSplits

2015-07-30 Thread Harsh J
If you meant 'scheduled' first perhaps thats doable by following (almost) what Gera says. The framework actually explicitly sorts your InputSplits list by its reported lengths, which would serve as the hack point for inducing a reordering. See