[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[ https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297663#comment-17297663 ] Naveen Gangam commented on HIVE-21663: -- Adding ReviewBoard link >From the commentary on the ReviewBoard, pasting the usage of this enhancement. This proposed fix adds support for a new schematool task "mergeCatalog". This option, without any name conflicts in Database names will merge the databases between 2 catalog. For example "schematool -dbType mysql -mergeCatalog spark -toCatalog hive" will merge the databases in the catalog named "spark" into a catalog named "hive" (which is the default catalog for hiveserver. It does so by manipulating the HMS metadata directly by changing the 1) All tables in the source catalog to "EXTERNAL" tables in the destination catalog. These tables will become purgable when they are dropped (aka behave like non-ACID managed tables) 2) Changes the catalog name on the DB from source CTLG to destination CTLG. > Hive Metastore Translation Layer > > > Key: HIVE-21663 > URL: https://issues.apache.org/jira/browse/HIVE-21663 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21663.3.patch, HIVE-21663.4.patch, > HIVE-21663.5.patch, HIVE-21663.6.patch, HIVE-21663.7.patch, HIVE-21663.8.patch > > > This task is for the implementation of the default provider for translation, > that is extensible if needed for a custom translator. Please refer the spec > for additional details on the translation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840589#comment-16840589
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968804/HIVE-21663.8.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16052 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17226/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17226/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17226/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12968804 - PreCommit-HIVE-Build
> Hive Metastore Translation Layer
>
>
> Key: HIVE-21663
> URL: https://issues.apache.org/jira/browse/HIVE-21663
> Project: Hive
> Issue Type: New Feature
> Components: Standalone Metastore
>Reporter: Naveen Gangam
>Assignee: Naveen Gangam
>Priority: Major
> Attachments: HIVE-21663.3.patch, HIVE-21663.4.patch,
> HIVE-21663.5.patch, HIVE-21663.6.patch, HIVE-21663.7.patch,
> HIVE-21663.8.patch, HMS Translation Layer_v1.0.pdf
>
>
> This task is for the implementation of the default provider for translation,
> that is extensible if needed for a custom translator. Please refer the spec
> for additional details on the translation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840547#comment-16840547
]
Hive QA commented on HIVE-21663:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
44s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
43s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
58s{color} | {color:blue} standalone-metastore/metastore-common in master has
29 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
14s{color} | {color:blue} standalone-metastore/metastore-server in master has
181 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
26s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
17s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 29 new + 471 unchanged - 0 fixed = 500 total (was 471) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
34s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 406 new + 797 unchanged - 2 fixed = 1203 total (was 799) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch 1 line(s) with tabs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 3m
7s{color} | {color:red} standalone-metastore/metastore-common generated 2 new +
29 unchanged - 0 fixed = 31 total (was 29) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
19s{color} | {color:red} standalone-metastore/metastore-server generated 2 new
+ 181 unchanged - 0 fixed = 183 total (was 181) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 1m
1s{color} | {color:red} standalone-metastore_metastore-common generated 2 new +
45 unchanged - 0 fixed = 47 total (was 45) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
24s{color} | {color:red} standalone-metastore_metastore-server generated 1 new
+ 25 unchanged - 0 fixed = 26 total (was 25) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 12s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorCapabilities(String[])
may expose internal static state by storing a mutable object into a static
field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:state by storing a mutable object into a static field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:[line 725] |
| | new
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$TableCapabilityBuilder()
invokes inefficient new String() constructor At
HiveMetaStoreClient.java:String() constructor At
HiveMetaStoreClient.java:[line 3960] |
|
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840468#comment-16840468
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968781/HIVE-21663.7.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 61 failed/errored test(s), 16052 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testGetPartitionsByNames
(batchId=225)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testComplexTypeApi
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testConcurrentMetastores
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testCreateAndGetTableWithDriver
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testFunctionWithResources
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testGetPartitionsByNames
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testGetTableObjects
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testPartitionFilter
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testRenamePartition
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testSimpleFunction
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableDatabase
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testComplexTypeApi
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testConcurrentMetastores
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testCreateAndGetTableWithDriver
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testFunctionWithResources
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testGetPartitionsByNames
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testGetTableObjects
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testPartitionFilter
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testRenamePartition
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testSimpleFunction
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testTableDatabase
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testComplexTypeApi
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testConcurrentMetastores
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testCreateAndGetTableWithDriver
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testFunctionWithResources
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testGetPartitionsByNames
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testGetTableObjects
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testPartitionFilter
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testRenamePartition
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testSimpleFunction
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testTableDatabase
(batchId=232)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testComplexTypeApi
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testConcurrentMetastores
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testCreateAndGetTableWithDriver
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testFunctionWithResources
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testGetPartitionsByNames
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testGetTableObjects
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testPartitionFilter
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testRenamePartition
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testSimpleFunction
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableDatabase
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testComplexTypeApi
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testConcurrentMetastores
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testCreateAndGetTableWithDriver
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testFunctionWithResources
(batchId=221)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840411#comment-16840411
]
Hive QA commented on HIVE-21663:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
27s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
41s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
44s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
53s{color} | {color:blue} standalone-metastore/metastore-common in master has
29 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
22s{color} | {color:blue} standalone-metastore/metastore-server in master has
181 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
25s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
12s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
17s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 29 new + 471 unchanged - 0 fixed = 500 total (was 471) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
35s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 406 new + 797 unchanged - 2 fixed = 1203 total (was 799) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch 1 line(s) with tabs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 3m
3s{color} | {color:red} standalone-metastore/metastore-common generated 2 new +
29 unchanged - 0 fixed = 31 total (was 29) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
26s{color} | {color:red} standalone-metastore/metastore-server generated 3 new
+ 181 unchanged - 0 fixed = 184 total (was 181) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 1m
0s{color} | {color:red} standalone-metastore_metastore-common generated 2 new +
45 unchanged - 0 fixed = 47 total (was 45) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
24s{color} | {color:red} standalone-metastore_metastore-server generated 1 new
+ 25 unchanged - 0 fixed = 26 total (was 25) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 27m 58s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorCapabilities(String[])
may expose internal static state by storing a mutable object into a static
field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:state by storing a mutable object into a static field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:[line 725] |
| | new
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$TableCapabilityBuilder()
invokes inefficient new String() constructor At
HiveMetaStoreClient.java:String() constructor At
HiveMetaStoreClient.java:[line 3960] |
|
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840050#comment-16840050
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968730/HIVE-21663.6.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 60 failed/errored test(s), 16050 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testComplexTypeApi
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testConcurrentMetastores
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testCreateAndGetTableWithDriver
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testFunctionWithResources
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testGetPartitionsByNames
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testGetTableObjects
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testPartitionFilter
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testRenamePartition
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testSimpleFunction
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableDatabase
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testComplexTypeApi
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testConcurrentMetastores
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testCreateAndGetTableWithDriver
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testFunctionWithResources
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testGetPartitionsByNames
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testGetTableObjects
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testPartitionFilter
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testRenamePartition
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testSimpleFunction
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testTableDatabase
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testComplexTypeApi
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testConcurrentMetastores
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testCreateAndGetTableWithDriver
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testFunctionWithResources
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testGetPartitionsByNames
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testGetTableObjects
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testPartitionFilter
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testRenamePartition
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testSimpleFunction
(batchId=232)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testTableDatabase
(batchId=232)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testComplexTypeApi
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testConcurrentMetastores
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testCreateAndGetTableWithDriver
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testFunctionWithResources
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testGetPartitionsByNames
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testGetTableObjects
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testPartitionFilter
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testRenamePartition
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testSimpleFunction
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableDatabase
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testComplexTypeApi
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testConcurrentMetastores
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testCreateAndGetTableWithDriver
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testFunctionWithResources
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testGetPartitionsByNames
(batchId=221)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840013#comment-16840013
]
Hive QA commented on HIVE-21663:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
54s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
44s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
46s{color} | {color:blue} standalone-metastore/metastore-common in master has
29 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
12s{color} | {color:blue} standalone-metastore/metastore-server in master has
181 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
22s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
10s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
11s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
1s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
17s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 29 new + 471 unchanged - 0 fixed = 500 total (was 471) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
33s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 407 new + 797 unchanged - 2 fixed = 1204 total (was 799) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch 1 line(s) with tabs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
58s{color} | {color:red} standalone-metastore/metastore-common generated 2 new
+ 29 unchanged - 0 fixed = 31 total (was 29) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
27s{color} | {color:red} standalone-metastore/metastore-server generated 3 new
+ 181 unchanged - 0 fixed = 184 total (was 181) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
58s{color} | {color:red} standalone-metastore_metastore-common generated 2 new
+ 45 unchanged - 0 fixed = 47 total (was 45) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
22s{color} | {color:red} standalone-metastore_metastore-server generated 1 new
+ 25 unchanged - 0 fixed = 26 total (was 25) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 27m 31s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorCapabilities(String[])
may expose internal static state by storing a mutable object into a static
field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:state by storing a mutable object into a static field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:[line 725] |
| | new
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$TableCapabilityBuilder()
invokes inefficient new String() constructor At
HiveMetaStoreClient.java:String() constructor At
HiveMetaStoreClient.java:[line 3960] |
|
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839845#comment-16839845
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968702/HIVE-21663.5.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 16050 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testGetPartitionsByNames
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testGetPartitionsByNames
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testGetPartitionsByNames
(batchId=232)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testGetPartitionsByNames
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testGetPartitionsByNames
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testGetPartitionsByNames
(batchId=231)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17212/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17212/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17212/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12968702 - PreCommit-HIVE-Build
> Hive Metastore Translation Layer
>
>
> Key: HIVE-21663
> URL: https://issues.apache.org/jira/browse/HIVE-21663
> Project: Hive
> Issue Type: New Feature
> Components: Standalone Metastore
>Reporter: Naveen Gangam
>Assignee: Naveen Gangam
>Priority: Major
> Attachments: HIVE-21663.3.patch, HIVE-21663.4.patch,
> HIVE-21663.5.patch, HMS Translation Layer_v1.0.pdf
>
>
> This task is for the implementation of the default provider for translation,
> that is extensible if needed for a custom translator. Please refer the spec
> for additional details on the translation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839820#comment-16839820
]
Hive QA commented on HIVE-21663:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
34s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
16s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
46s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
3s{color} | {color:blue} standalone-metastore/metastore-common in master has 29
extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
20s{color} | {color:blue} standalone-metastore/metastore-server in master has
181 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
26s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
13s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
17s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 29 new + 471 unchanged - 0 fixed = 500 total (was 471) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
33s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 408 new + 797 unchanged - 2 fixed = 1205 total (was 799) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
1s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
1s{color} | {color:red} The patch 1 line(s) with tabs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 3m
14s{color} | {color:red} standalone-metastore/metastore-common generated 2 new
+ 29 unchanged - 0 fixed = 31 total (was 29) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
29s{color} | {color:red} standalone-metastore/metastore-server generated 3 new
+ 181 unchanged - 0 fixed = 184 total (was 181) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 1m
4s{color} | {color:red} standalone-metastore_metastore-common generated 2 new +
45 unchanged - 0 fixed = 47 total (was 45) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
25s{color} | {color:red} standalone-metastore_metastore-server generated 1 new
+ 25 unchanged - 0 fixed = 26 total (was 25) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
16s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 29m 22s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| |
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorCapabilities(String[])
may expose internal static state by storing a mutable object into a static
field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:state by storing a mutable object into a static field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities At
HiveMetaStoreClient.java:[line 725] |
| | new
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$TableCapabilityBuilder()
invokes inefficient new String() constructor At
HiveMetaStoreClient.java:String() constructor At
HiveMetaStoreClient.java:[line 3960] |
|
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[ https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839740#comment-16839740 ] Daniel Dai commented on HIVE-21663: --- +1ed on RB. > Hive Metastore Translation Layer > > > Key: HIVE-21663 > URL: https://issues.apache.org/jira/browse/HIVE-21663 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Attachments: HIVE-21663.3.patch, HIVE-21663.4.patch, > HIVE-21663.5.patch, HMS Translation Layer_v1.0.pdf > > > This task is for the implementation of the default provider for translation, > that is extensible if needed for a custom translator. Please refer the spec > for additional details on the translation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839696#comment-16839696
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968695/HIVE-21663.5.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17210/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17210/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17210/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2019-05-14 18:31:00.926
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-17210/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2019-05-14 18:31:00.930
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at de69a0f HIVE-21722 : REPL:: logs are missing in
hiveStatement.getQueryLog output during parallel execution mode. (Mahesh Kumar
Behera reviewed by Sankar Hariappan)
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at de69a0f HIVE-21722 : REPL:: logs are missing in
hiveStatement.getQueryLog output during parallel execution mode. (Mahesh Kumar
Behera reviewed by Sankar Hariappan)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2019-05-14 18:31:02.752
+ rm -rf ../yetus_PreCommit-HIVE-Build-17210
+ mkdir ../yetus_PreCommit-HIVE-Build-17210
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-17210
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-17210/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Going to apply patch with: git apply -p0
/data/hiveptest/working/scratch/build.patch:908: trailing whitespace.
tmpMap.put(_Fields.TBL_NAME, new
org.apache.thrift.meta_data.FieldMetaData("tblName",
org.apache.thrift.TFieldRequirementType.REQUIRED,
/data/hiveptest/working/scratch/build.patch:910: trailing whitespace.
tmpMap.put(_Fields.ACCESS_TYPE, new
org.apache.thrift.meta_data.FieldMetaData("accessType",
org.apache.thrift.TFieldRequirementType.OPTIONAL,
/data/hiveptest/working/scratch/build.patch:912: trailing whitespace.
tmpMap.put(_Fields.PROCESSOR_CAPABILITIES, new
org.apache.thrift.meta_data.FieldMetaData("processorCapabilities",
org.apache.thrift.TFieldRequirementType.OPTIONAL,
/data/hiveptest/working/scratch/build.patch:913: trailing whitespace.
new
org.apache.thrift.meta_data.ListMetaData(org.apache.thrift.protocol.TType.LIST,
/data/hiveptest/working/scratch/build.patch:1291: trailing whitespace.
if (schemeField.type == org.apache.thrift.protocol.TType.STOP) {
warning: squelched 73 whitespace errors
warning: 78 lines add whitespace errors.
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
protoc-jar: executing: [/tmp/protoc4062071187926459605.exe, --version]
libprotoc 2.5.0
protoc-jar: executing: [/tmp/protoc4062071187926459605.exe,
-I/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore,
--java_out=/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/target/generated-sources,
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837550#comment-16837550
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968406/HIVE-21663.4.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 16048 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testGetPartitionsByNames
(batchId=226)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZK.testGetPartitionsByNames
(batchId=228)
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStoreZKBindHost.testGetPartitionsByNames
(batchId=232)
org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testGetPartitionsByNames
(batchId=223)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testGetPartitionsByNames
(batchId=221)
org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testGetPartitionsByNames
(batchId=231)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17188/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17188/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17188/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12968406 - PreCommit-HIVE-Build
> Hive Metastore Translation Layer
>
>
> Key: HIVE-21663
> URL: https://issues.apache.org/jira/browse/HIVE-21663
> Project: Hive
> Issue Type: New Feature
> Components: Standalone Metastore
>Reporter: Naveen Gangam
>Assignee: Naveen Gangam
>Priority: Major
> Attachments: HIVE-21663.3.patch, HIVE-21663.4.patch, HMS Translation
> Layer_v1.0.pdf
>
>
> This task is for the implementation of the default provider for translation,
> that is extensible if needed for a custom translator. Please refer the spec
> for additional details on the translation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837521#comment-16837521
]
Hive QA commented on HIVE-21663:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
40s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
28s{color} | {color:blue} standalone-metastore/metastore-common in master has
29 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
8s{color} | {color:blue} standalone-metastore/metastore-server in master has
181 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
16s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
10s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
16s{color} | {color:red} standalone-metastore/metastore-common: The patch
generated 29 new + 471 unchanged - 0 fixed = 500 total (was 471) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
31s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 443 new + 797 unchanged - 2 fixed = 1240 total (was 799) {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch 1 line(s) with tabs. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
43s{color} | {color:red} standalone-metastore/metastore-common generated 3 new
+ 29 unchanged - 0 fixed = 32 total (was 29) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
18s{color} | {color:red} standalone-metastore/metastore-server generated 4 new
+ 181 unchanged - 0 fixed = 185 total (was 181) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
18s{color} | {color:red} standalone-metastore_metastore-server generated 1 new
+ 25 unchanged - 0 fixed = 26 total (was 25) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 25m 18s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:standalone-metastore/metastore-common |
| | Write to static field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorCapabilities from
instance method
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorCapabilities(String[])
At HiveMetaStoreClient.java:from instance method
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorCapabilities(String[])
At HiveMetaStoreClient.java:[line 725] |
| | Write to static field
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.processorIdentifier from
instance method
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorIdentifier(String)
At HiveMetaStoreClient.java:from instance method
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setProcessorIdentifier(String)
At HiveMetaStoreClient.java:[line 729] |
| | new
org.apache.hadoop.hive.metastore.HiveMetaStoreClient$TableCapabilityBuilder()
invokes inefficient
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[
https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835459#comment-16835459
]
Hive QA commented on HIVE-21663:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12968158/HIVE-21663.3.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17166/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17166/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17166/
Messages:
{noformat}
This message was trimmed, see log for full details
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsRequest.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsResponse.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsResponse.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CommitTxnRequest.java:698
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CommitTxnRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CompactionRequest.java:814
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CompactionRequest.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CreationMetadata.java:792
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CreationMetadata.java'
with conflicts.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Function.java:1079
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Function.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetOpenTxnsInfoResponse.java:447
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetOpenTxnsInfoResponse.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetOpenTxnsResponse.java:615
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetOpenTxnsResponse.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetPartitionsByNamesRequest.java:665
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetPartitionsByNamesRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetPartitionsByNamesResult.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetPartitionsByNamesResult.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsRequest.java:513
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsRequest.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsResponse.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsResponse.java'
cleanly.
error: patch failed:
standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/HeartbeatTxnRangeResponse.java:453
Falling back to three-way merge...
Applied patch to
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[ https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830383#comment-16830383 ] Naveen Gangam commented on HIVE-21663: -- [~thejas] [~daijy] Could you please start review on this? Thanks > Hive Metastore Translation Layer > > > Key: HIVE-21663 > URL: https://issues.apache.org/jira/browse/HIVE-21663 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Attachments: HMS Translation Layer_v1.0.pdf > > > This task is for the implementation of the default provider for translation, > that is extensible if needed for a custom translator. Please refer the spec > for additional details on the translation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21663) Hive Metastore Translation Layer
[ https://issues.apache.org/jira/browse/HIVE-21663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830375#comment-16830375 ] Naveen Gangam commented on HIVE-21663: -- Initial patch posted to review board at https://reviews.apache.org/r/70572/ > Hive Metastore Translation Layer > > > Key: HIVE-21663 > URL: https://issues.apache.org/jira/browse/HIVE-21663 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Attachments: HMS Translation Layer_v1.0.pdf > > > This task is for the implementation of the default provider for translation, > that is extensible if needed for a custom translator. Please refer the spec > for additional details on the translation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
