See <https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/647/changes>
Changes:
[namit] HIVE-2050 Batch processing partition pruning process
(Ning Zhang via namit)
M conf/hive-default.xml
M metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java
M metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java
M
metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
M metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
M metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
M metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py
M metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore-remote
M metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
M metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.h
M metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore_server.skeleton.cpp
M metastore/src/gen/thrift/gen-rb/thrift_hive_metastore.rb
M
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
M metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php
M metastore/if/hive_metastore.thrift
M common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
M ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java
M ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
M ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionPruner.java
M ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartExprEvalUtils.java
------------------------------------------
[...truncated 29876 lines...]
[junit] OK
[junit] PREHOOK: query: select count(1) as cnt from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-32_211_3022985127871641081/-mr-10000
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks determined at compile time: 1
[junit] In order to change the average load for a reducer (in bytes):
[junit] set hive.exec.reducers.bytes.per.reducer=<number>
[junit] In order to limit the maximum number of reducers:
[junit] set hive.exec.reducers.max=<number>
[junit] In order to set a constant number of reducers:
[junit] set mapred.reduce.tasks=<number>
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of
reducers: 0
[junit] 2011-03-29 21:42:35,289 null map = 100%, reduce = 100%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select count(1) as cnt from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-32_211_3022985127871641081/-mr-10000
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_1721696315.txt>
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: load data local inpath
'<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'>
into table testhivedrivertable
[junit] PREHOOK: type: LOAD
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] Copying data from
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt>
[junit] Loading data to table default.testhivedrivertable
[junit] POSTHOOK: query: load data local inpath
'<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'>
into table testhivedrivertable
[junit] POSTHOOK: type: LOAD
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: select * from testhivedrivertable limit 10
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-36_767_2976047165719211939/-mr-10000
[junit] POSTHOOK: query: select * from testhivedrivertable limit 10
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-36_767_2976047165719211939/-mr-10000
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_1165143056.txt>
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_2093980746.txt>
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_1319281481.txt>
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (key int, value
string)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (key int, value
string)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: load data local inpath
'<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'>
into table testhivedrivertable
[junit] PREHOOK: type: LOAD
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] Copying data from
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt>
[junit] Loading data to table default.testhivedrivertable
[junit] POSTHOOK: query: load data local inpath
'<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'>
into table testhivedrivertable
[junit] POSTHOOK: type: LOAD
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: select key, value from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-37_868_525690517517668035/-mr-10000
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks is set to 0 since there's no reduce operator
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of
reducers: 0
[junit] 2011-03-29 21:42:40,450 null map = 100%, reduce = 0%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select key, value from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-37_868_525690517517668035/-mr-10000
[junit] OK
[junit] PREHOOK: query: select key, value from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-40_583_14291861900245823/-mr-10000
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks is set to 0 since there's no reduce operator
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of
reducers: 0
[junit] 2011-03-29 21:42:43,157 null map = 100%, reduce = 0%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select key, value from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-40_583_14291861900245823/-mr-10000
[junit] OK
[junit] PREHOOK: query: select key, value from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-43_289_3674933358486608796/-mr-10000
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks is set to 0 since there's no reduce operator
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of
reducers: 0
[junit] 2011-03-29 21:42:45,858 null map = 100%, reduce = 0%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select key, value from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-43_289_3674933358486608796/-mr-10000
[junit] OK
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_1694642894.txt>
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (key int, value
string)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (key int, value
string)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: load data local inpath
'<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'>
into table testhivedrivertable
[junit] PREHOOK: type: LOAD
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] Copying data from
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt>
[junit] Loading data to table default.testhivedrivertable
[junit] POSTHOOK: query: load data local inpath
'<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'>
into table testhivedrivertable
[junit] POSTHOOK: type: LOAD
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: select key, value from testhivedrivertable where
key > 10
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-46_543_8816351984131723030/-mr-10000
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks is set to 0 since there's no reduce operator
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of
reducers: 0
[junit] 2011-03-29 21:42:49,224 null map = 100%, reduce = 0%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select key, value from testhivedrivertable where
key > 10
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-46_543_8816351984131723030/-mr-10000
[junit] OK
[junit] PREHOOK: query: select count(1) as c from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-49_406_9200630690844419806/-mr-10000
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks determined at compile time: 1
[junit] In order to change the average load for a reducer (in bytes):
[junit] set hive.exec.reducers.bytes.per.reducer=<number>
[junit] In order to limit the maximum number of reducers:
[junit] set hive.exec.reducers.max=<number>
[junit] In order to set a constant number of reducers:
[junit] set mapred.reduce.tasks=<number>
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of
reducers: 0
[junit] 2011-03-29 21:42:52,129 null map = 100%, reduce = 100%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select count(1) as c from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output:
file:/tmp/hudson/hive_2011-03-29_21-42-49_406_9200630690844419806/-mr-10000
[junit] OK
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_1991608166.txt>
[junit]
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/service/../data/files/invalidpath/sample.jar>
does not exist
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_684797212.txt>
[junit]
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/service/../data/files/invalidpath/sample.txt>
does not exist
[junit] Hive history
file=<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201103292142_34952368.txt>
[junit]
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/service/../data/files/invalidpath/sample.zip>
does not exist
[junit] ------------- ---------------- ---------------
[junit]
[junit] Testcase: testExecute took 9.243 sec
[junit] Testcase: testNonHiveCommand took 0.796 sec
[junit] Testcase: testMetastore took 0.254 sec
[junit] Testcase: testGetClusterStatus took 0.089 sec
[junit] Testcase: testFetch took 8.644 sec
[junit] Testcase: testDynamicSerde took 6.301 sec
[junit] Testcase: testAddJarShouldFailIfJarNotExist took 0.065 sec
[junit] Testcase: testAddFileShouldFailIfFileNotExist took 0.073 sec
[junit] Testcase: testAddArchiveShouldFailIfFileNotExist took 0.063 sec
BUILD FAILED
<https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build.xml>:209:
Keepgoing execution: 1 of 10 iterations failed.
Total time: 198 minutes 56 seconds
Recording test results
Archiving artifacts
