[jira] [Updated] (HIVE-21640) Do not create (HD)FS directory when creating a table stored and managed by other systems
[ https://issues.apache.org/jira/browse/HIVE-21640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Hao updated HIVE-21640: --- Description: When creating a table in HMS, a (HD)FS directory will be [created|https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L1983] even for the table even for table stored and managed by other systems specified by Hive Storage Handler. It is ideal to skip directory creation in such case (same for dropping a table). (was: When creating a table in HMS, a (HD)FS directory will be created even for the table even for table stored and managed by other systems specified by Hive Storage Handler. It is ideal to skip directory creation in such case (same for dropping a table).) > Do not create (HD)FS directory when creating a table stored and managed by > other systems > > > Key: HIVE-21640 > URL: https://issues.apache.org/jira/browse/HIVE-21640 > Project: Hive > Issue Type: Improvement >Affects Versions: 3.1.1, 2.3.4 >Reporter: Hao Hao >Priority: Major > > When creating a table in HMS, a (HD)FS directory will be > [created|https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L1983] > even for the table even for table stored and managed by other systems > specified by Hive Storage Handler. It is ideal to skip directory creation in > such case (same for dropping a table). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-13482) str_to_map function delimiters are regex
[
https://issues.apache.org/jira/browse/HIVE-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822860#comment-16822860
]
Hive QA commented on HIVE-13482:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12966594/HIVE.13482.01.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 19 failed/errored test(s), 15823 tests
executed
*Failed tests:*
{noformat}
TestCachedStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestCatalogCaching - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestDeadline - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestHiveMetaStoreGetMetaConf - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestHiveMetaStoreTimeout - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestHiveMetaStoreTxns - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestMarkPartition - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestMarkPartitionRemote - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestMetaStoreEventListenerOnlyOnCommit - did not produce a TEST-*.xml file
(likely timed out) (batchId=231)
TestMetaStoreEventListenerWithOldConf - did not produce a TEST-*.xml file
(likely timed out) (batchId=231)
TestMetaStoreInitListener - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestMetaStoreListenersError - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestMetaStoreSchemaInfo - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestObjectStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestObjectStoreSchemaMethods - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestRemoteHiveMetaStoreZKBindHost - did not produce a TEST-*.xml file (likely
timed out) (batchId=231)
TestTableIterable - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[str_to_map] (batchId=69)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17003/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17003/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17003/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 19 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12966594 - PreCommit-HIVE-Build
> str_to_map function delimiters are regex
>
>
> Key: HIVE-13482
> URL: https://issues.apache.org/jira/browse/HIVE-13482
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Affects Versions: 1.0.0
>Reporter: Janick Bernet
>Assignee: Michael Chirico
>Priority: Minor
> Labels: pull-request-available
> Attachments: HIVE-13482.patch, HIVE-13482.patch, HIVE.13482.01.patch
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The two delimiters passed to the 'str_to_map' function are both interpreted
> as regular expressions, which means that using the pipe ('|') as a delimiter
> will lead to very unexpected results.
> This behaviour is the same for the closely related 'split' function, however
> that is clearly documented in the function description (as per
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF).
> Either the documentation for 'str_to_map' should be updated to reflect that
> the delimiters are both regular expressions, too, or the implementation
> should be changed to not interpret them as regexes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-13482) str_to_map function delimiters are regex
[
https://issues.apache.org/jira/browse/HIVE-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822852#comment-16822852
]
Hive QA commented on HIVE-13482:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
44s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
39s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
4s{color} | {color:blue} ql in master has 2256 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
0s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
2s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 24m 31s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-17003/dev-support/hive-personality.sh
|
| git revision | master / b58d50c |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-17003/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> str_to_map function delimiters are regex
>
>
> Key: HIVE-13482
> URL: https://issues.apache.org/jira/browse/HIVE-13482
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Affects Versions: 1.0.0
>Reporter: Janick Bernet
>Assignee: Michael Chirico
>Priority: Minor
> Labels: pull-request-available
> Attachments: HIVE-13482.patch, HIVE-13482.patch, HIVE.13482.01.patch
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The two delimiters passed to the 'str_to_map' function are both interpreted
> as regular expressions, which means that using the pipe ('|') as a delimiter
> will lead to very unexpected results.
> This behaviour is the same for the closely related 'split' function, however
> that is clearly documented in the function description (as per
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF).
> Either the documentation for 'str_to_map' should be updated to reflect that
> the delimiters are both regular expressions, too, or the implementation
> should be changed to not interpret them as regexes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (HIVE-13482) str_to_map function delimiters are regex
[
https://issues.apache.org/jira/browse/HIVE-13482?focusedWorklogId=230570=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230570
]
ASF GitHub Bot logged work on HIVE-13482:
-
Author: ASF GitHub Bot
Created on: 22/Apr/19 02:59
Start Date: 22/Apr/19 02:59
Worklog Time Spent: 10m
Work Description: MichaelChirico commented on issue #553:
[HIVE-13482][UDF] Explicitly define str_to_map args as regex
URL: https://github.com/apache/hive/pull/553#issuecomment-485309998
@rmsmani @dlavati thanks, sorry for the delay. Diff is back to just the
docstring change & the `.01` patch on JIRA should reflect this. Hopefully good
to go now.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 230570)
Time Spent: 2h 10m (was: 2h)
> str_to_map function delimiters are regex
>
>
> Key: HIVE-13482
> URL: https://issues.apache.org/jira/browse/HIVE-13482
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Affects Versions: 1.0.0
>Reporter: Janick Bernet
>Assignee: Michael Chirico
>Priority: Minor
> Labels: pull-request-available
> Attachments: HIVE-13482.patch, HIVE-13482.patch, HIVE.13482.01.patch
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The two delimiters passed to the 'str_to_map' function are both interpreted
> as regular expressions, which means that using the pipe ('|') as a delimiter
> will lead to very unexpected results.
> This behaviour is the same for the closely related 'split' function, however
> that is clearly documented in the function description (as per
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF).
> Either the documentation for 'str_to_map' should be updated to reflect that
> the delimiters are both regular expressions, too, or the implementation
> should be changed to not interpret them as regexes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-13482) str_to_map function delimiters are regex
[
https://issues.apache.org/jira/browse/HIVE-13482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Chirico updated HIVE-13482:
---
Attachment: HIVE.13482.01.patch
> str_to_map function delimiters are regex
>
>
> Key: HIVE-13482
> URL: https://issues.apache.org/jira/browse/HIVE-13482
> Project: Hive
> Issue Type: Improvement
> Components: UDF
>Affects Versions: 1.0.0
>Reporter: Janick Bernet
>Assignee: Michael Chirico
>Priority: Minor
> Labels: pull-request-available
> Attachments: HIVE-13482.patch, HIVE-13482.patch, HIVE.13482.01.patch
>
> Time Spent: 2h
> Remaining Estimate: 0h
>
> The two delimiters passed to the 'str_to_map' function are both interpreted
> as regular expressions, which means that using the pipe ('|') as a delimiter
> will lead to very unexpected results.
> This behaviour is the same for the closely related 'split' function, however
> that is clearly documented in the function description (as per
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF).
> Either the documentation for 'str_to_map' should be updated to reflect that
> the delimiters are both regular expressions, too, or the implementation
> should be changed to not interpret them as regexes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21639) Spark test failed since HIVE-10632
[
https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822802#comment-16822802
]
Hyukjin Kwon commented on HIVE-21639:
-
Hi [~alangates] and [~owen.omalley].
To share the context, this is about HIVE-16391 and SPARK-20202. Previously, if
I didn't miss anything, it was decided to make another Hive release 1.2.x
before.
After that, I, [~yumwang], and Spark community had the discussion about it. In
particular, I and [~yumwang] are trying to push it forward in order to upgrade
Hive within Apache Spark (see this and [the mailing list
discussion|http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-Upgrade-built-in-Hive-to-2-3-4-td26153.html#a26300]),
rather than Hive side to publish 1.2.x with Spark side's fork. We are
currently putting a lot of efforts at SPARK-23710 to resolve all SPARK-23710,
HIVE-16391 and SPARK-20202.
To get to the point, this issue blocks Spark community to use Hive 2.3.4
officially. Spark targets to upgrade Hive within Spark 3.0. If this issue isn't
resolved, (I think) Apache Spark will end up with using Hive fork and having no
choice then asking Hive to release 1.2.x as of HIVE-16391, which in my humble
opinion isn't the best way for both Hive and Spark communities.
Would you guys mind merging this into branch-2.3 and releasing Hive 2.3.5 so
that Apache Spark side upgrade Hive and gets rid of its fork?
> Spark test failed since HIVE-10632
> --
>
> Key: HIVE-21639
> URL: https://issues.apache.org/jira/browse/HIVE-21639
> Project: Hive
> Issue Type: Bug
>Reporter: Yuming Wang
>Assignee: Yuming Wang
>Priority: Major
> Attachments: HIVE-21639.branch-2.patch
>
>
> We hint the following exception when [upgrading Spark‘s built-in Hive to
> 2.3.4|https://issues.apache.org/jira/browse/SPARK-23710]:
> {noformat}
> ..
> [info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
> with class loader
> org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see
> the next exception for details.
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
> Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
> [info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
> ...
> {noformat}
> This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
> backport part of HIVE-17561 to fix this issue for branch-2.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21639) Spark test failed since HIVE-10632
[
https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated HIVE-21639:
---
Description:
We hint the following exception when [upgrading Spark‘s built-in Hive to
2.3.4|https://issues.apache.org/jira/browse/SPARK-23710]:
{noformat}
..
[info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
with class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the
next exception for details.
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
[info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
...
{noformat}
This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
backport part of HIVE-17561 to fix this issue for branch-2.
was:
We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:
{noformat}
..
[info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
with class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the
next exception for details.
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
[info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
...
{noformat}
This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
backport part of HIVE-17561 to fix this issue for branch-2.
> Spark test failed since HIVE-10632
> --
>
> Key: HIVE-21639
> URL: https://issues.apache.org/jira/browse/HIVE-21639
> Project: Hive
> Issue Type: Bug
>Reporter: Yuming Wang
>Assignee: Yuming Wang
>Priority: Major
> Attachments: HIVE-21639.branch-2.patch
>
>
> We hint the following exception when [upgrading Spark‘s built-in Hive to
> 2.3.4|https://issues.apache.org/jira/browse/SPARK-23710]:
> {noformat}
> ..
> [info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
> with class loader
> org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see
> the next exception for details.
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
> Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
> [info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
> ...
> {noformat}
> This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
> backport part of HIVE-17561 to fix this issue for branch-2.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21639) Spark test failed since HIVE-10632
[
https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated HIVE-21639:
---
Description:
We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:
{noformat}
..
[info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
with class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the
next exception for details.
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
[info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
...
{noformat}
This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
backport part of HIVE-17561 to fix this issue for branch-2.
was:
We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:
{noformat}
..
[info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
with class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the
next exception for details.
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
[info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
...
{noformat}
This issue Introduced by
The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix
this issue for branch-2.
> Spark test failed since HIVE-10632
> --
>
> Key: HIVE-21639
> URL: https://issues.apache.org/jira/browse/HIVE-21639
> Project: Hive
> Issue Type: Bug
>Reporter: Yuming Wang
>Assignee: Yuming Wang
>Priority: Major
> Attachments: HIVE-21639.branch-2.patch
>
>
> We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:
> {noformat}
> ..
> [info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
> with class loader
> org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see
> the next exception for details.
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
> Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
> [info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
> ...
> {noformat}
> This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
> backport part of HIVE-17561 to fix this issue for branch-2.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21639) Spark test failed since HIVE-10632
[
https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated HIVE-21639:
---
Description:
We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:
{noformat}
..
[info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
with class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the
next exception for details.
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
[info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
...
{noformat}
This issue Introduced by
The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix
this issue for branch-2.
was:The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to
fix this issue for branch-2.
> Spark test failed since HIVE-10632
> --
>
> Key: HIVE-21639
> URL: https://issues.apache.org/jira/browse/HIVE-21639
> Project: Hive
> Issue Type: Bug
>Reporter: Yuming Wang
>Assignee: Yuming Wang
>Priority: Major
> Attachments: HIVE-21639.branch-2.patch
>
>
> We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:
> {noformat}
> ..
> [info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
> with class loader
> org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see
> the next exception for details.
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
> Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.(Unknown Source)
> [info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
> ...
> {noformat}
> This issue Introduced by
> The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix
> this issue for branch-2.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-21639) Spark test failed since HIVE-10632
[
https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822733#comment-16822733
]
Hive QA commented on HIVE-21639:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12966586/HIVE-21639.branch-2.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17002/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17002/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17002/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2019-04-21 17:10:58.362
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-17002/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z branch-2 ]]
+ [[ -d apache-github-branch-2-source ]]
+ [[ ! -d apache-github-branch-2-source/.git ]]
+ [[ ! -d apache-github-branch-2-source ]]
+ date '+%Y-%m-%d %T.%3N'
2019-04-21 17:10:58.448
+ cd apache-github-branch-2-source
+ git fetch origin
>From https://github.com/apache/hive
0b8cfa7..fd2f7c8 branch-2 -> origin/branch-2
3b1d4fd..dc40659 branch-2.3 -> origin/branch-2.3
c791b90..87570b9 branch-3 -> origin/branch-3
5909c6e..a354bed branch-3.0 -> origin/branch-3.0
008eda8..8290316 branch-3.1 -> origin/branch-3.1
fd2be8e..b58d50c master -> origin/master
* [new tag] rel/release-2.3.4 -> rel/release-2.3.4
+ git reset --hard HEAD
HEAD is now at 0b8cfa7 HIVE-21040 : msck does unnecessary file listing at last
level of directory tree (Vihang Karajgaonkar, reviewed by Prasanth Jayachandran)
+ git clean -f -d
+ git checkout branch-2
Already on 'branch-2'
Your branch is behind 'origin/branch-2' by 2 commits, and can be fast-forwarded.
(use "git pull" to update your local branch)
+ git reset --hard origin/branch-2
HEAD is now at fd2f7c8 HIVE-21484 : Metastore API getVersion() should return
real version (Vihang Karajgaonkar, reviewed by Naveen Gangam and Peter Vary)
+ git merge --ff-only origin/branch-2
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2019-04-21 17:11:21.030
+ rm -rf ../yetus_PreCommit-HIVE-Build-17002
+ mkdir ../yetus_PreCommit-HIVE-Build-17002
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-17002
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-17002/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Going to apply patch with: git apply -p0
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-branch-2-source/metastore/target/generated-sources/antlr3/org/apache/hadoop/hive/metastore/parser/FilterParser.java
does not exist: must build
/data/hiveptest/working/apache-github-branch-2-source/metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
DataNucleus Enhancer (version 4.1.17) for API "JDO"
DataNucleus Enhancer : Classpath
>> /usr/share/maven/boot/plexus-classworlds-2.x.jar
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MDatabase
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MFieldSchema
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MType
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MTable
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MConstraint
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MSerDeInfo
ENHANCED (Persistable) : org.apache.hadoop.hive.metastore.model.MOrder
ENHANCED (Persistable) :
org.apache.hadoop.hive.metastore.model.MColumnDescriptor
ENHANCED (Persistable) :
[jira] [Updated] (HIVE-21639) Spark test failed since HIVE-10632
[ https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-21639: --- Assignee: Yuming Wang Attachment: HIVE-21639.branch-2.patch Status: Patch Available (was: Open) > Spark test failed since HIVE-10632 > -- > > Key: HIVE-21639 > URL: https://issues.apache.org/jira/browse/HIVE-21639 > Project: Hive > Issue Type: Bug >Reporter: Yuming Wang >Assignee: Yuming Wang >Priority: Major > Attachments: HIVE-21639.branch-2.patch > > > The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix > this issue for branch-2. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21639) Spark test failed since HIVE-10632
[ https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-21639: --- Description: The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix this issue for branch-2. > Spark test failed since HIVE-10632 > -- > > Key: HIVE-21639 > URL: https://issues.apache.org/jira/browse/HIVE-21639 > Project: Hive > Issue Type: Bug >Reporter: Yuming Wang >Priority: Major > > The bug fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix > this issue for branch-2. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21584) Java 11 preparation: system class loader is not URLClassLoader
[
https://issues.apache.org/jira/browse/HIVE-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822729#comment-16822729
]
Hive QA commented on HIVE-21584:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12966581/HIVE-21584.07.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 19 failed/errored test(s), 15829 tests
executed
*Failed tests:*
{noformat}
TestCachedStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestCatalogCaching - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestDeadline - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestHiveMetaStoreGetMetaConf - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestHiveMetaStoreTimeout - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestHiveMetaStoreTxns - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestMarkPartition - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestMarkPartitionRemote - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestMetaStoreEventListenerOnlyOnCommit - did not produce a TEST-*.xml file
(likely timed out) (batchId=231)
TestMetaStoreEventListenerWithOldConf - did not produce a TEST-*.xml file
(likely timed out) (batchId=231)
TestMetaStoreInitListener - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestMetaStoreListenersError - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestMetaStoreSchemaInfo - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestObjectStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
TestObjectStoreSchemaMethods - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestRemoteHiveMetaStoreZKBindHost - did not produce a TEST-*.xml file (likely
timed out) (batchId=231)
TestTableIterable - did not produce a TEST-*.xml file (likely timed out)
(batchId=231)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[mapjoin_memcheck]
(batchId=46)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17001/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17001/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17001/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 19 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12966581 - PreCommit-HIVE-Build
> Java 11 preparation: system class loader is not URLClassLoader
> --
>
> Key: HIVE-21584
> URL: https://issues.apache.org/jira/browse/HIVE-21584
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0
>Reporter: Zoltan Matyus
>Assignee: Zoltan Matyus
>Priority: Major
> Attachments: HIVE-21584.01.patch, HIVE-21584.02.patch,
> HIVE-21584.03.patch, HIVE-21584.04.patch, HIVE-21584.05.patch,
> HIVE-21584.06.patch, HIVE-21584.07.patch
>
>
> Currently, Hive assumes that the system class loader is instance of
> {{URLClassLoader}}. In Java 11 this is not the case. There are a few
> (unresolved) JIRAs about specific occurrences of {{URLClassLoader}} (e.g.
> [HIVE-21237|https://issues.apache.org/jira/browse/HIVE-21237],
> [HIVE-17909|https://issues.apache.org/jira/browse/HIVE-17909]), but no
> _"remove all occurrences"_. Also I couldn't find umbrella "Java 11 upgrade"
> JIRA.
> This ticket is to remove all unconditional casts of any random class loader
> to {{URLClassLoader}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (HIVE-21638) Hive execute miss stage
[ https://issues.apache.org/jira/browse/HIVE-21638?focusedWorklogId=230523=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230523 ] ASF GitHub Bot logged work on HIVE-21638: - Author: ASF GitHub Bot Created on: 21/Apr/19 16:35 Start Date: 21/Apr/19 16:35 Worklog Time Spent: 10m Work Description: Xoln commented on pull request #600: HIVE-21638:Hive execute miss stage URL: https://github.com/apache/hive/pull/600 When execute query finished , there are some missed stage because of status check failed. It need to check after execute finshed , if not executed all stage and throw exception to avoid incorrect result in the end. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 230523) Time Spent: 10m Remaining Estimate: 0h > Hive execute miss stage > --- > > Key: HIVE-21638 > URL: https://issues.apache.org/jira/browse/HIVE-21638 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 2.3.2 >Reporter: ann >Priority: Major > Labels: pull-request-available > Fix For: 2.3.2 > > Attachments: stage-miss-bugfix.patch > > Time Spent: 10m > Remaining Estimate: 0h > > When execute query finished , there are some missed stage because of status > check failed. > It need to check after execute finshed , if not executed all stage and throw > exception to avoid incorrect result in the end. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21638) Hive execute miss stage
[ https://issues.apache.org/jira/browse/HIVE-21638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-21638: -- Labels: pull-request-available (was: ) > Hive execute miss stage > --- > > Key: HIVE-21638 > URL: https://issues.apache.org/jira/browse/HIVE-21638 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 2.3.2 >Reporter: ann >Priority: Major > Labels: pull-request-available > Fix For: 2.3.2 > > Attachments: stage-miss-bugfix.patch > > > When execute query finished , there are some missed stage because of status > check failed. > It need to check after execute finshed , if not executed all stage and throw > exception to avoid incorrect result in the end. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21638) Hive execute miss stage
[ https://issues.apache.org/jira/browse/HIVE-21638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ann updated HIVE-21638: --- Attachment: stage-miss-bugfix.patch > Hive execute miss stage > --- > > Key: HIVE-21638 > URL: https://issues.apache.org/jira/browse/HIVE-21638 > Project: Hive > Issue Type: Bug > Components: Hive >Affects Versions: 2.3.2 >Reporter: ann >Priority: Major > Fix For: 2.3.2 > > Attachments: stage-miss-bugfix.patch > > > When execute query finished , there are some missed stage because of status > check failed. > It need to check after execute finshed , if not executed all stage and throw > exception to avoid incorrect result in the end. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21584) Java 11 preparation: system class loader is not URLClassLoader
[
https://issues.apache.org/jira/browse/HIVE-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822727#comment-16822727
]
Hive QA commented on HIVE-21584:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
38s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 7m
15s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
51s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
38s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
30s{color} | {color:blue} standalone-metastore/metastore-common in master has
29 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
35s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
26s{color} | {color:blue} spark-client in master has 10 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
4s{color} | {color:blue} ql in master has 2256 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
46s{color} | {color:blue} llap-server in master has 81 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
31s{color} | {color:blue} beeline in master has 44 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
51s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} standalone-metastore/metastore-common: The patch
generated 0 new + 22 unchanged - 2 fixed = 22 total (was 24) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
12s{color} | {color:green} common: The patch generated 0 new + 1 unchanged - 1
fixed = 1 total (was 2) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} The patch spark-client passed checkstyle {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} ql: The patch generated 0 new + 194 unchanged - 3
fixed = 194 total (was 197) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} llap-server: The patch generated 0 new + 8 unchanged
- 1 fixed = 8 total (was 9) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
11s{color} | {color:green} The patch beeline passed checkstyle {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
45s{color} | {color:green} metastore-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
42s{color} | {color:green} common generated 0 new + 62 unchanged - 1 fixed = 62
total (was 63) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
31s{color} | {color:green} spark-client in the patch passed. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
22s{color} | {color:green} ql generated 0 new + 2252 unchanged - 4 fixed = 2252
total (was 2256) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
50s{color} | {color:green} llap-server in the patch passed. {color} |
|
[jira] [Updated] (HIVE-21584) Java 11 preparation: system class loader is not URLClassLoader
[
https://issues.apache.org/jira/browse/HIVE-21584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltan Matyus updated HIVE-21584:
-
Attachment: HIVE-21584.07.patch
> Java 11 preparation: system class loader is not URLClassLoader
> --
>
> Key: HIVE-21584
> URL: https://issues.apache.org/jira/browse/HIVE-21584
> Project: Hive
> Issue Type: Task
> Components: Hive
>Affects Versions: 4.0.0
>Reporter: Zoltan Matyus
>Assignee: Zoltan Matyus
>Priority: Major
> Attachments: HIVE-21584.01.patch, HIVE-21584.02.patch,
> HIVE-21584.03.patch, HIVE-21584.04.patch, HIVE-21584.05.patch,
> HIVE-21584.06.patch, HIVE-21584.07.patch
>
>
> Currently, Hive assumes that the system class loader is instance of
> {{URLClassLoader}}. In Java 11 this is not the case. There are a few
> (unresolved) JIRAs about specific occurrences of {{URLClassLoader}} (e.g.
> [HIVE-21237|https://issues.apache.org/jira/browse/HIVE-21237],
> [HIVE-17909|https://issues.apache.org/jira/browse/HIVE-17909]), but no
> _"remove all occurrences"_. Also I couldn't find umbrella "Java 11 upgrade"
> JIRA.
> This ticket is to remove all unconditional casts of any random class loader
> to {{URLClassLoader}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (HIVE-21637) Synchronized metastore cache
[ https://issues.apache.org/jira/browse/HIVE-21637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-21637: -- Attachment: (was: HIVE-21637-1.patch) > Synchronized metastore cache > > > Key: HIVE-21637 > URL: https://issues.apache.org/jira/browse/HIVE-21637 > Project: Hive > Issue Type: New Feature >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-21637-1.patch > > > Currently, HMS has a cache implemented by CachedStore. The cache is > asynchronized and in HMS HA setting, we can only get eventual consistency. In > this Jira, we try to make it synchronized. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21637) Synchronized metastore cache
[ https://issues.apache.org/jira/browse/HIVE-21637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-21637: -- Attachment: HIVE-21637-1.patch > Synchronized metastore cache > > > Key: HIVE-21637 > URL: https://issues.apache.org/jira/browse/HIVE-21637 > Project: Hive > Issue Type: New Feature >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-21637-1.patch > > > Currently, HMS has a cache implemented by CachedStore. The cache is > asynchronized and in HMS HA setting, we can only get eventual consistency. In > this Jira, we try to make it synchronized. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21637) Synchronized metastore cache
[ https://issues.apache.org/jira/browse/HIVE-21637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-21637: -- Attachment: HIVE-21637-1.patch > Synchronized metastore cache > > > Key: HIVE-21637 > URL: https://issues.apache.org/jira/browse/HIVE-21637 > Project: Hive > Issue Type: New Feature >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-21637-1.patch > > > Currently, HMS has a cache implemented by CachedStore. The cache is > asynchronized and in HMS HA setting, we can only get eventual consistency. In > this Jira, we try to make it synchronized. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21637) Synchronized metastore cache
[ https://issues.apache.org/jira/browse/HIVE-21637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-21637: -- Status: Patch Available (was: Open) > Synchronized metastore cache > > > Key: HIVE-21637 > URL: https://issues.apache.org/jira/browse/HIVE-21637 > Project: Hive > Issue Type: New Feature >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > Attachments: HIVE-21637-1.patch > > > Currently, HMS has a cache implemented by CachedStore. The cache is > asynchronized and in HMS HA setting, we can only get eventual consistency. In > this Jira, we try to make it synchronized. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-21637) Synchronized metastore cache
[ https://issues.apache.org/jira/browse/HIVE-21637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822643#comment-16822643 ] Daniel Dai commented on HIVE-21637: --- HIVE-21637-1.patch is not the full patch. It only implemented several flow: 1. create table 2. get table 3. commit transaction 4. prewarm 5. event based cache update > Synchronized metastore cache > > > Key: HIVE-21637 > URL: https://issues.apache.org/jira/browse/HIVE-21637 > Project: Hive > Issue Type: New Feature >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > > Currently, HMS has a cache implemented by CachedStore. The cache is > asynchronized and in HMS HA setting, we can only get eventual consistency. In > this Jira, we try to make it synchronized. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-21637) Synchronized metastore cache
[ https://issues.apache.org/jira/browse/HIVE-21637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned HIVE-21637: - > Synchronized metastore cache > > > Key: HIVE-21637 > URL: https://issues.apache.org/jira/browse/HIVE-21637 > Project: Hive > Issue Type: New Feature >Reporter: Daniel Dai >Assignee: Daniel Dai >Priority: Major > > Currently, HMS has a cache implemented by CachedStore. The cache is > asynchronized and in HMS HA setting, we can only get eventual consistency. In > this Jira, we try to make it synchronized. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
