Re: hive on Tez - merging orc files

2015-04-24 Thread Prasanth Jayachandran
You can download the branch-0.14 source code from https://github.com/apache/hive/tree/branch-0.14, apply HIVE-9529-branch-1.0.0.patch from https://issues.apache.org/jira/browse/HIVE-9529 and compile it using “mvn clean install -DskipTests -Phadoop-2,dist”. This will generate tar file under

hive on Tez - merging orc files

2015-04-24 Thread patcharee
Hi, Is there anyone using hortonworks sandbox 2.2? I am trying to use hive on Tez on the sandbox. I set the running engine in hive-site.xml to Tez. property namehive.execution.engine/name valuetez/value /property Then I ran the script that alters a table to merge small

Re: hive on Tez - merging orc files

2015-04-24 Thread Prasanth Jayachandran
Hi This has been fixed recently https://issues.apache.org/jira/browse/HIVE-9529. Merging is triggered in two different ways. INSERT/CTAS can trigger merging of small files and CONCATENATE can trigger merging of small files. The later had a bug which generated MR task instead of TEZ task which