See <https://builds.apache.org/job/Hcatalog-trunk-build/199/changes>
Changes:
[namit] HIVE-2863 Ambiguous table name or column reference message displays
when table and column
names are the same (Navis via namit)
[hashutosh] HIVE-2879 : Add rat target to build to look for missing license
headers (Owen Omalley via Ashutosh Chauhan)
[hashutosh] HIVE-2559 : Add target to install Hive JARs/POMs in the local Maven
cache (Alan Gates via Ashutosh Chauhan)
[hashutosh] HIVE-2822: Second part of it (ctdean via Ashutosh Chauhan)
[hashutosh] HIVE-2822 [jira] Add JSON output to the hive ddl commands
(Chris Dean via Ashutosh Chauhan)
Summary:
JSON output for DDL commands
By setting the variable hive.format=json then ddl commands will
produce json output suitable for client side parsing. For example, to
list all the databases one might get:
{
"databases": [
"default"
]
}
The goal is to have an option to produce JSON output of the DDL commands that is
easily machine parseable.
For example, "desc my_table" currently gives
id bigint
user string
and we want to allow a json output:
{
"columns": [
{"name": "id", "type": "bigint"},
{"name": "user", "type": "string"}
]
}
Test Plan: Run the provided unit tests
Reviewers: JIRA, ashutoshc
Reviewed By: ashutoshc
Differential Revision: https://reviews.facebook.net/D2475
[gates] HCATALOG-320 Remove filtering of table properties which are not prefix
with "hcat."
------------------------------------------
[...truncated 8507 lines...]
---------------------------------------------------------------------
| common | 8 | 0 | 0 | 0 || 8 | 0 |
---------------------------------------------------------------------
[ivy:retrieve] :: retrieving :: org.apache.hcatalog#hcatalog
[ivy:retrieve] confs: [common]
[ivy:retrieve] 0 artifacts copied, 8 already retrieved (0kB/1ms)
ivy-package:
[ivy:resolve] :: resolving dependencies ::
org.apache.hcatalog#hcatalog;0.4.0-SNAPSTHOT
[ivy:resolve] confs: [package]
[ivy:resolve] found org.vafer#jdeb;0.8 in maven2
[ivy:resolve] :: resolution report :: resolve 6ms :: artifacts dl 1ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| package | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
[ivy:retrieve] :: retrieving :: org.apache.hcatalog#hcatalog
[ivy:retrieve] confs: [package]
[ivy:retrieve] 0 artifacts copied, 1 already retrieved (0kB/1ms)
init:
compile-src:
[javac] Compiling 5 source files to
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/classes>
clientjar:
server-extensions:
jar-storage-handlers:
jar:
[echo] Generating all handlers
template:
[echo] Executing storage-handler "jar" for hbase
ivy-download:
[get] Getting:
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/ivy/ivy-2.2.0.jar>
[get] Not modified - so not downloaded
ivy-init-dirs:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file =
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/ivy/ivysettings.xml>
ivy-compile:
[ivy:resolve] :: resolving dependencies ::
org.apache.hcatalog#hbase-storage-handler;0.4.0-SNAPSTHOT
[ivy:resolve] confs: [common]
[ivy:resolve] found org.apache.hbase#hbase;0.92.0 in maven2
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.4.3 in maven2
[ivy:resolve] found com.github.stephenc.high-scale-lib#high-scale-lib;1.1.1
in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] :: resolution report :: resolve 25ms :: artifacts dl 2ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 5 | 0 | 0 | 0 || 7 | 0 |
---------------------------------------------------------------------
[ivy:retrieve] :: retrieving :: org.apache.hcatalog#hbase-storage-handler
[ivy:retrieve] confs: [common]
[ivy:retrieve] 0 artifacts copied, 7 already retrieved (0kB/1ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use
'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file =
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/ivy/ivysettings.xml>
init:
compile-src:
jar:
jar:
compile-test:
[javac] Compiling 62 source files to
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/test/classes>
[javac] Note:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/src/test/org/apache/hcatalog/mapreduce/TestHCatOutputFormat.java>
uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
test:
[delete] Deleting directory /tmp/hcat_junit_warehouse
[mkdir] Created dir:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build/test/logs>
[mkdir] Created dir: /tmp/hcat_junit_warehouse
[junit] WARNING: multiple versions of ant detected in path for junit
[junit]
jar:file:/home/jenkins/tools/ant/apache-ant-1.8.2/lib/ant.jar!/org/apache/tools/ant/Project.class
[junit] and
jar:<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/hive/external/build/ivy/lib/default/ant-1.6.5.jar!/org/apache/tools/ant/Project.class>
[junit] Running org.apache.hcatalog.cli.TestPermsGrp
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 44.052 sec
[junit] Running org.apache.hcatalog.cli.TestSemanticAnalysis
[junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 11.784 sec
[junit] Running org.apache.hcatalog.cli.TestUseDatabase
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.143 sec
[junit] Running org.apache.hcatalog.common.TestHCatUtil
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.153 sec
[junit] Running org.apache.hcatalog.data.TestDefaultHCatRecord
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.061 sec
[junit] Running org.apache.hcatalog.data.TestHCatRecordSerDe
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.268 sec
[junit] Running org.apache.hcatalog.data.TestJsonSerDe
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.28 sec
[junit] Running org.apache.hcatalog.data.TestLazyHCatRecord
[junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.196 sec
[junit] Running org.apache.hcatalog.data.TestReaderWriter
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.115 sec
[junit] Running org.apache.hcatalog.data.schema.TestHCatSchema
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.051 sec
[junit] Running org.apache.hcatalog.data.schema.TestHCatSchemaUtils
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.077 sec
[junit] Running org.apache.hcatalog.listener.TestMsgBusConnection
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 8.159 sec
[junit] Running org.apache.hcatalog.listener.TestNotificationListener
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 6.898 sec
[junit] Running org.apache.hcatalog.mapreduce.TestHCatDynamicPartitioned
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 46.755 sec
[junit] Running org.apache.hcatalog.mapreduce.TestHCatHiveCompatibility
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 32.63 sec
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 32.63 sec
[junit] Running org.apache.hcatalog.mapreduce.TestHCatNonPartitioned
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 13.896 sec
[junit] Running org.apache.hcatalog.mapreduce.TestHCatOutputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.293 sec
[junit] Running org.apache.hcatalog.mapreduce.TestHCatPartitioned
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 72.353 sec
[junit] Running org.apache.hcatalog.mapreduce.TestPassProperties
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 8.959 sec
[junit] Running org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 56.45 sec
[junit] Running org.apache.hcatalog.pig.TestHCatLoader
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 55.35 sec
[junit] Running org.apache.hcatalog.pig.TestHCatLoaderComplexSchema
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 137.867 sec
[junit] Running org.apache.hcatalog.pig.TestHCatStorer
[junit] Tests run: 14, Failures: 0, Errors: 0, Time elapsed: 117.733 sec
[junit] Running org.apache.hcatalog.pig.TestHCatStorerMulti
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 29.155 sec
[junit] Running org.apache.hcatalog.rcfile.TestRCFileMapReduceInputFormat
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.222 sec
[junit] Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider
[junit] Tests run: 34, Failures: 0, Errors: 0, Time elapsed: 16.566 sec
test-storage-handlers:
test:
[echo] Testing all handlers
template:
[echo] Executing storage-handler "test" for hbase
ivy-download:
[get] Getting:
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
[get] To:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/ivy/ivy-2.2.0.jar>
[get] Not modified - so not downloaded
ivy-init-dirs:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: loading settings :: file =
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/ivy/ivysettings.xml>
ivy-compile:
[ivy:resolve] :: resolving dependencies ::
org.apache.hcatalog#hbase-storage-handler;0.4.0-SNAPSTHOT
[ivy:resolve] confs: [common]
[ivy:resolve] found org.apache.hbase#hbase;0.92.0 in maven2
[ivy:resolve] found org.apache.zookeeper#zookeeper;3.4.3 in maven2
[ivy:resolve] found com.github.stephenc.high-scale-lib#high-scale-lib;1.1.1
in maven2
[ivy:resolve] found com.google.guava#guava;11.0 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2
[ivy:resolve] :: resolution report :: resolve 26ms :: artifacts dl 2ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 5 | 0 | 0 | 0 || 7 | 0 |
---------------------------------------------------------------------
[ivy:retrieve] :: retrieving :: org.apache.hcatalog#hbase-storage-handler
[ivy:retrieve] confs: [common]
[ivy:retrieve] 0 artifacts copied, 7 already retrieved (0kB/1ms)
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use
'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file =
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/ivy/ivysettings.xml>
init:
compile-src:
jar:
compile-test:
[javac] Compiling 15 source files to
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/test/classes>
[javac] Note:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/src/test/org/apache/hcatalog/hbase/TestHBaseDirectOutputFormat.java>
uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
test:
[mkdir] Created dir:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/test/logs>
[mkdir] Created dir:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/test/temp>
[mkdir] Created dir:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build/test/data>
[junit] WARNING: multiple versions of ant detected in path for junit
[junit]
jar:file:/home/jenkins/tools/ant/apache-ant-1.8.2/lib/ant.jar!/org/apache/tools/ant/Project.class
[junit] and
jar:<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/hive/external/build/ivy/lib/default/ant-1.6.5.jar!/org/apache/tools/ant/Project.class>
[junit] Running org.apache.hcatalog.hbase.TestHBaseBulkOutputFormat
[junit] Tests run: 5, Failures: 4, Errors: 1, Time elapsed: 281.731 sec
[junit] Test org.apache.hcatalog.hbase.TestHBaseBulkOutputFormat FAILED
[junit] Running org.apache.hcatalog.hbase.TestHBaseDirectOutputFormat
[junit] Tests run: 3, Failures: 2, Errors: 1, Time elapsed: 179.511 sec
[junit] Test org.apache.hcatalog.hbase.TestHBaseDirectOutputFormat FAILED
[junit] Running org.apache.hcatalog.hbase.TestHBaseHCatStorageHandler
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 41.022 sec
[junit] Running org.apache.hcatalog.hbase.TestHBaseInputFormat
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 80.098 sec
[junit] Running org.apache.hcatalog.hbase.TestSnapshots
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 34.96 sec
[junit] Running org.apache.hcatalog.hbase.snapshot.TestIDGenerator
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 71.105 sec
[junit] Running org.apache.hcatalog.hbase.snapshot.TestRevisionManager
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 22.959 sec
[junit] Running
org.apache.hcatalog.hbase.snapshot.TestRevisionManagerEndpoint
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 20.095 sec
[junit] Running org.apache.hcatalog.hbase.snapshot.TestThriftSerialization
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.177 sec
[junit] Running org.apache.hcatalog.hbase.snapshot.TestZNodeSetUp
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 29.093 sec
[junit] Running org.apache.hcatalog.hbase.snapshot.lock.WriteLockTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 20.585 sec
[junit] Running org.apache.hcatalog.hbase.snapshot.lock.ZNodeNameTest
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.136 sec
BUILD FAILED
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build.xml>:376:
The following error occurred while executing this line:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/build.xml>:332:
The following error occurred while executing this line:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/build.xml>:41:
The following error occurred while executing this line:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/build.xml>:28:
The following error occurred while executing this line:
<https://builds.apache.org/job/Hcatalog-trunk-build/ws/trunk/storage-handlers/hbase/build.xml>:276:
Tests failed!
Total time: 32 minutes 15 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
