[jira] [Commented] (HIVE-23250) Scheduled query related qtests may not finish before it's expected
[
https://issues.apache.org/jira/browse/HIVE-23250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088318#comment-17088318
]
Hive QA commented on HIVE-23250:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 12m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
3s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
55s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
18s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 28m 0s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21815/dev-support/hive-personality.sh
|
| git revision | master / 00423c1 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21815/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21815/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Scheduled query related qtests may not finish before it's expected
> --
>
> Key: HIVE-23250
> URL: https://issues.apache.org/jira/browse/HIVE-23250
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23250.01.patch, HIVE-23250.02.patch
>
>
> schq_ingest fails intermittently...showing that the query is still executing
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23220) PostExecOrcFileDump listing order may depend on the underlying filesystem
[
https://issues.apache.org/jira/browse/HIVE-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088307#comment-17088307
]
Hive QA commented on HIVE-23220:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
11s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
37s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
55s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m
3s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 8m
24s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
28s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 8m
19s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 5m
14s{color} | {color:red} patch/ql cannot run setBugDatabaseInfo from findbugs
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 16m
52s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
17s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 79m 19s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21814/dev-support/hive-personality.sh
|
| git revision | master / 00423c1 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| findbugs |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21814/yetus/patch-findbugs-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21814/yetus/patch-asflicense-problems.txt
|
| modules | C: ql . U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21814/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> PostExecOrcFileDump listing order may depend on the underlying filesystem
> -
>
> Key: HIVE-23220
> URL: https://issues.apache.org/jira/browse/HIVE-23220
> Project: Hive
> Issue Type: Sub-task
> Components: Testing Infrastructure
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23220.01.patch, HIVE-23220.02.patch
>
>
> in case there are multiple files; the order might not be stable - and may
> cause unstable q.outs
> https://github.com/apache/hive/blob/83f917c787d60543f171b23d28ceda44d69c235d/ql/src/java/org/apache/hadoop/hive/ql/hooks/PostExecOrcFileDump.java#L104
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-23235) Checkpointing in repl dump failing for orc format
[
https://issues.apache.org/jira/browse/HIVE-23235?focusedWorklogId=425558=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-425558
]
ASF GitHub Bot logged work on HIVE-23235:
-
Author: ASF GitHub Bot
Created on: 21/Apr/20 05:28
Start Date: 21/Apr/20 05:28
Worklog Time Spent: 10m
Work Description: pkumarsinha commented on a change in pull request #987:
URL: https://github.com/apache/hive/pull/987#discussion_r411869774
##
File path: ql/src/java/org/apache/hadoop/hive/ql/parse/repl/CopyUtils.java
##
@@ -383,10 +385,17 @@ private void doRegularCopyOnce(FileSystem sourceFs,
List srcList,
throw new IOException(e);
}
} else {
+ deleteSubDirs(destinationFs, destination);
FileUtil.copy(sourceFs, paths, destinationFs, destination, false, true,
hiveConf);
}
}
+ private void deleteSubDirs(FileSystem destinationFs, Path destination)
throws IOException {
+for (FileStatus status : destinationFs.listStatus(destination)) {
Review comment:
Why can't we delete the destination and recreate the dest folder if
required?
##
File path:
itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/TestReplicationScenariosAcidTables.java
##
@@ -761,6 +761,104 @@ public void testCheckPointingDataDumpFailureRegularCopy()
throws Throwable {
.verifyResults(new String[]{"11", "21"});
}
+ @Test
+ public void testCheckPointingDataDumpFailureORCTableRegularCopy() throws
Throwable {
+WarehouseInstance.Tuple bootstrapDump = primary.run("use " + primaryDbName)
+.run("CREATE TABLE t1(a int) clustered by (a) into 2 buckets" +
+" stored as orc TBLPROPERTIES ('transactional'='true')")
+.run("CREATE TABLE t2(a string) STORED AS TEXTFILE")
Review comment:
Add one empty table too.
##
File path:
itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/TestReplicationScenariosAcidTables.java
##
@@ -761,6 +761,104 @@ public void testCheckPointingDataDumpFailureRegularCopy()
throws Throwable {
.verifyResults(new String[]{"11", "21"});
}
+ @Test
+ public void testCheckPointingDataDumpFailureORCTableRegularCopy() throws
Throwable {
+WarehouseInstance.Tuple bootstrapDump = primary.run("use " + primaryDbName)
+.run("CREATE TABLE t1(a int) clustered by (a) into 2 buckets" +
+" stored as orc TBLPROPERTIES ('transactional'='true')")
+.run("CREATE TABLE t2(a string) STORED AS TEXTFILE")
+.run("insert into t1 values (1)")
+.run("insert into t1 values (2)")
+.run("insert into t1 values (3)")
+.run("insert into t2 values (11)")
+.run("insert into t2 values (21)")
+.dump(primaryDbName);
+FileSystem fs = new Path(bootstrapDump.dumpLocation).getFileSystem(conf);
+Path dumpPath = new Path(bootstrapDump.dumpLocation,
ReplUtils.REPL_HIVE_BASE_DIR);
+assertTrue(fs.exists(new Path(dumpPath, DUMP_ACKNOWLEDGEMENT.toString(;
+Path metadataPath = new Path(dumpPath, EximUtil.METADATA_PATH_NAME);
+long modifiedTimeMetadata =
fs.getFileStatus(metadataPath).getModificationTime();
+Path dataPath = new Path(dumpPath, EximUtil.DATA_PATH_NAME);
+Path dbPath = new Path(dataPath, primaryDbName.toLowerCase());
+Path tablet1Path = new Path(dbPath, "t1");
+Path tablet2Path = new Path(dbPath, "t2");
+//Delete dump ack and t2 data, metadata should be rewritten, data should
be same for t1 but rewritten for t2
+fs.delete(new Path(dumpPath, DUMP_ACKNOWLEDGEMENT.toString()), true);
+assertFalse(fs.exists(new Path(dumpPath,
DUMP_ACKNOWLEDGEMENT.toString(;
+FileStatus[] statuses = fs.listStatus(tablet2Path);
+//Delete t2 data
+fs.delete(statuses[0].getPath(), true);
+long modifiedTimeTable1 =
fs.getFileStatus(tablet1Path).getModificationTime();
+long modifiedTimeTable1CopyFile =
fs.listStatus(tablet1Path)[0].getModificationTime();
+long modifiedTimeTable2 =
fs.getFileStatus(tablet2Path).getModificationTime();
+//Do another dump. It should only dump table t2. Modification time of
table t1 should be same while t2 is greater
+WarehouseInstance.Tuple nextDump = primary.dump(primaryDbName);
+assertEquals(nextDump.dumpLocation, bootstrapDump.dumpLocation);
+assertTrue(fs.exists(new Path(dumpPath, DUMP_ACKNOWLEDGEMENT.toString(;
+//File is copied again as we are using regular copy
+assertTrue(modifiedTimeTable1 <
fs.getFileStatus(tablet1Path).getModificationTime());
+assertTrue(modifiedTimeTable1CopyFile <
fs.listStatus(tablet1Path)[0].getModificationTime());
+assertTrue(modifiedTimeTable2 <
fs.getFileStatus(tablet2Path).getModificationTime());
+assertTrue(modifiedTimeMetadata <
[jira] [Commented] (HIVE-23220) PostExecOrcFileDump listing order may depend on the underlying filesystem
[
https://issues.apache.org/jira/browse/HIVE-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088301#comment-17088301
]
Hive QA commented on HIVE-23220:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000590/HIVE-23220.02.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17130 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.exec.tez.TestDynamicPartitionPruner.testSingleSourceMultipleFiltersOrdering1
(batchId=290)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21814/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21814/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21814/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000590 - PreCommit-HIVE-Build
> PostExecOrcFileDump listing order may depend on the underlying filesystem
> -
>
> Key: HIVE-23220
> URL: https://issues.apache.org/jira/browse/HIVE-23220
> Project: Hive
> Issue Type: Sub-task
> Components: Testing Infrastructure
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23220.01.patch, HIVE-23220.02.patch
>
>
> in case there are multiple files; the order might not be stable - and may
> cause unstable q.outs
> https://github.com/apache/hive/blob/83f917c787d60543f171b23d28ceda44d69c235d/ql/src/java/org/apache/hadoop/hive/ql/hooks/PostExecOrcFileDump.java#L104
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23262) Remove dependency on activemq
[ https://issues.apache.org/jira/browse/HIVE-23262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23262: Status: Patch Available (was: Open) > Remove dependency on activemq > - > > Key: HIVE-23262 > URL: https://issues.apache.org/jira/browse/HIVE-23262 > Project: Hive > Issue Type: Improvement > Components: HCatalog >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-23262.patch > > > Activemq is a test dependency introduced to test message bus feature in > hcatalog. Even when it was introduced very first, there were concerns of > taking activemq as a dependency. > https://issues.apache.org/jira/browse/HCATALOG-3?focusedCommentId=13035113=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-13035113 > AFAIK no one uses message bus feature of HCatalog. We can remove it > altogether. > As a first step removing tests for it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23262) Remove dependency on activemq
[ https://issues.apache.org/jira/browse/HIVE-23262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-23262: Attachment: HIVE-23262.patch > Remove dependency on activemq > - > > Key: HIVE-23262 > URL: https://issues.apache.org/jira/browse/HIVE-23262 > Project: Hive > Issue Type: Improvement > Components: HCatalog >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-23262.patch > > > Activemq is a test dependency introduced to test message bus feature in > hcatalog. Even when it was introduced very first, there were concerns of > taking activemq as a dependency. > https://issues.apache.org/jira/browse/HCATALOG-3?focusedCommentId=13035113=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-13035113 > AFAIK no one uses message bus feature of HCatalog. We can remove it > altogether. > As a first step removing tests for it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-23262) Remove dependency on activemq
[ https://issues.apache.org/jira/browse/HIVE-23262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan reassigned HIVE-23262: --- > Remove dependency on activemq > - > > Key: HIVE-23262 > URL: https://issues.apache.org/jira/browse/HIVE-23262 > Project: Hive > Issue Type: Improvement > Components: HCatalog >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > > Activemq is a test dependency introduced to test message bus feature in > hcatalog. Even when it was introduced very first, there were concerns of > taking activemq as a dependency. > https://issues.apache.org/jira/browse/HCATALOG-3?focusedCommentId=13035113=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-13035113 > AFAIK no one uses message bus feature of HCatalog. We can remove it > altogether. > As a first step removing tests for it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23261) Check whether encryption is enabled in the cluster before moving files
[ https://issues.apache.org/jira/browse/HIVE-23261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088285#comment-17088285 ] Rajesh Balamohan commented on HIVE-23261: - +1 pending tests. > Check whether encryption is enabled in the cluster before moving files > -- > > Key: HIVE-23261 > URL: https://issues.apache.org/jira/browse/HIVE-23261 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Ramesh Kumar Thangarajan >Priority: Minor > Attachments: HIVE-23261.1.patch > > > Similar to HIVE-23212, there is an unwanted check of encryption paths during > file move operation. > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L4546] > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23261) Check whether encryption is enabled in the cluster before moving files
[ https://issues.apache.org/jira/browse/HIVE-23261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HIVE-23261: Attachment: HIVE-23261.1.patch Status: Patch Available (was: Open) > Check whether encryption is enabled in the cluster before moving files > -- > > Key: HIVE-23261 > URL: https://issues.apache.org/jira/browse/HIVE-23261 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Ramesh Kumar Thangarajan >Priority: Minor > Attachments: HIVE-23261.1.patch > > > Similar to HIVE-23212, there is an unwanted check of encryption paths during > file move operation. > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L4546] > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23215) Make FilterContext and MutableFilterContext interfaces
[
https://issues.apache.org/jira/browse/HIVE-23215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088272#comment-17088272
]
Hive QA commented on HIVE-23215:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000575/HIVE-23215.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21813/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21813/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21813/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2020-04-21 04:02:23.821
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-21813/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2020-04-21 04:02:23.824
+ cd apache-github-source-source
+ git fetch origin
>From https://github.com/apache/hive
57b2024..00423c1 master -> origin/master
+ git reset --hard HEAD
HEAD is now at 57b2024 HIVE-23241 : Reduce transitive dependencies
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded.
(use "git pull" to update your local branch)
+ git reset --hard origin/master
HEAD is now at 00423c1 HIVE-23258 : Remove BoneCP Connection Pool (David
Mollitor via Ashutosh Chauhan)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2020-04-21 04:02:25.063
+ rm -rf ../yetus_PreCommit-HIVE-Build-21813
+ mkdir ../yetus_PreCommit-HIVE-Build-21813
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-21813
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-21813/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Trying to apply the patch with -p0
error: a/pom.xml: does not exist in index
error:
a/ql/src/test/org/apache/hadoop/hive/ql/io/filter/TestFilterContext.java: does
not exist in index
error:
a/storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java:
does not exist in index
error:
a/storage-api/src/java/org/apache/hadoop/hive/ql/io/filter/FilterContext.java:
does not exist in index
error:
a/storage-api/src/java/org/apache/hadoop/hive/ql/io/filter/MutableFilterContext.java:
does not exist in index
error:
a/storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java:
does not exist in index
Trying to apply the patch with -p1
error: patch failed: pom.xml:196
Falling back to three-way merge...
Applied patch to 'pom.xml' with conflicts.
error: patch failed:
storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java:359
Falling back to three-way merge...
Applied patch to
'storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java'
cleanly.
error: patch failed:
storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java:360
Falling back to three-way merge...
Applied patch to
'storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java'
cleanly.
Going to apply patch with: git apply -p1
error: patch failed: pom.xml:196
Falling back to three-way merge...
Applied patch to 'pom.xml' with conflicts.
error: patch failed:
storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java:359
Falling back to three-way merge...
Applied patch to
'storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java'
cleanly.
error: patch failed:
storage-api/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch.java:360
Falling back to three-way
[jira] [Commented] (HIVE-23258) Remove BoneCP Connection Pool
[
https://issues.apache.org/jira/browse/HIVE-23258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088270#comment-17088270
]
Hive QA commented on HIVE-23258:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 11m
21s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 17m
59s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 6m
46s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
34s{color} | {color:blue} standalone-metastore/metastore-common in master has
35 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
37s{color} | {color:blue} common in master has 63 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
17s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
53s{color} | {color:red} branch/hcatalog no findbugs output file
(hcatalog/target/findbugsXml.xml) {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
44s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 13m
32s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
44s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 22m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 15m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 15m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
30s{color} | {color:green} standalone-metastore: The patch generated 0 new +
613 unchanged - 13 fixed = 613 total (was 626) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
13s{color} | {color:green} The patch metastore-common passed checkstyle {color}
|
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} The patch common passed checkstyle {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
10s{color} | {color:green} The patch metastore passed checkstyle {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
24s{color} | {color:green} standalone-metastore/metastore-server: The patch
generated 0 new + 524 unchanged - 13 fixed = 524 total (was 537) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
23s{color} | {color:green} The patch hcatalog passed checkstyle {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
22s{color} | {color:green} root: The patch generated 0 new + 993 unchanged - 13
fixed = 993 total (was 1006) {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
19s{color} | {color:green} The patch hive-unit passed checkstyle {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
5s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
42s{color} | {color:red} patch/standalone-metastore/metastore-common cannot run
setBugDatabaseInfo from findbugs {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
35s{color} | {color:red} patch/common cannot run setBugDatabaseInfo from
findbugs {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
24s{color} | {color:red} patch/metastore cannot run setBugDatabaseInfo
[jira] [Assigned] (HIVE-23261) Check whether encryption is enabled in the cluster before moving files
[ https://issues.apache.org/jira/browse/HIVE-23261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan reassigned HIVE-23261: --- Assignee: Ramesh Kumar Thangarajan > Check whether encryption is enabled in the cluster before moving files > -- > > Key: HIVE-23261 > URL: https://issues.apache.org/jira/browse/HIVE-23261 > Project: Hive > Issue Type: Improvement >Reporter: Rajesh Balamohan >Assignee: Ramesh Kumar Thangarajan >Priority: Minor > > Similar to HIVE-23212, there is an unwanted check of encryption paths during > file move operation. > [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L4546] > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23103) Oracle statement batching
[
https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088269#comment-17088269
]
Hive QA commented on HIVE-23103:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000574/HIVE-23103.11.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17134 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_llap_counters1]
(batchId=57)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21812/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21812/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21812/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000574 - PreCommit-HIVE-Build
> Oracle statement batching
> -
>
> Key: HIVE-23103
> URL: https://issues.apache.org/jira/browse/HIVE-23103
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Attachments: HIVE-23103.02.patch, HIVE-23103.03.patch,
> HIVE-23103.04.patch, HIVE-23103.05.patch, HIVE-23103.06.patch,
> HIVE-23103.07.patch, HIVE-23103.08.patch, HIVE-23103.09.patch,
> HIVE-23103.10.patch, HIVE-23103.11.patch, HIVE-23103.patch
>
>
> Examine how to really get better performance for oracle statement batches.
> [Oracle JDBC
> doc|https://docs.oracle.com/cd/E11882_01/java.112/e16548/oraperf.htm#JJDBC28752]
> describes:
> {quote}The Oracle implementation of standard update batching does not
> implement true batching for generic statements and callable statements. Even
> though Oracle JDBC supports the use of standard batching for {{Statement}}
> and {{CallableStatement}} objects, you are unlikely to see performance
> improvement.
> {quote}
> I would look for connection properties to set, so it is handled anyway, or if
> not, then use:
> {code}
> begin
> query1;
> query2;
> query3;
> end;
> {code}
> to we will have only a single roundtrip for the db.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23235) Checkpointing in repl dump failing for orc format
[ https://issues.apache.org/jira/browse/HIVE-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aasha Medhi updated HIVE-23235: --- Status: In Progress (was: Patch Available) > Checkpointing in repl dump failing for orc format > - > > Key: HIVE-23235 > URL: https://issues.apache.org/jira/browse/HIVE-23235 > Project: Hive > Issue Type: Bug >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Attachments: HIVE-23235.01.patch, HIVE-23235.02.patch, > HIVE-23235.03.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23235) Checkpointing in repl dump failing for orc format
[ https://issues.apache.org/jira/browse/HIVE-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aasha Medhi updated HIVE-23235: --- Attachment: HIVE-23235.03.patch Status: Patch Available (was: In Progress) > Checkpointing in repl dump failing for orc format > - > > Key: HIVE-23235 > URL: https://issues.apache.org/jira/browse/HIVE-23235 > Project: Hive > Issue Type: Bug >Reporter: Aasha Medhi >Assignee: Aasha Medhi >Priority: Major > Attachments: HIVE-23235.01.patch, HIVE-23235.02.patch, > HIVE-23235.03.patch > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23103) Oracle statement batching
[
https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088256#comment-17088256
]
Hive QA commented on HIVE-23103:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
37s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 2m
20s{color} | {color:blue} standalone-metastore/metastore-server in master has
190 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
38s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
39s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 1 new + 516 unchanged - 0 fixed = 517 total (was 516) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
28s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
25s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 24m 39s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21812/dev-support/hive-personality.sh
|
| git revision | master / 00423c1 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21812/yetus/diff-checkstyle-standalone-metastore_metastore-server.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21812/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore/metastore-server U:
standalone-metastore/metastore-server |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21812/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Oracle statement batching
> -
>
> Key: HIVE-23103
> URL: https://issues.apache.org/jira/browse/HIVE-23103
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
> Attachments: HIVE-23103.02.patch, HIVE-23103.03.patch,
> HIVE-23103.04.patch, HIVE-23103.05.patch, HIVE-23103.06.patch,
> HIVE-23103.07.patch, HIVE-23103.08.patch, HIVE-23103.09.patch,
> HIVE-23103.10.patch, HIVE-23103.11.patch, HIVE-23103.patch
>
>
> Examine how to really get better performance for oracle statement batches.
> [Oracle JDBC
> doc|https://docs.oracle.com/cd/E11882_01/java.112/e16548/oraperf.htm#JJDBC28752]
> describes:
> {quote}The Oracle implementation of standard update batching does not
> implement true batching for generic statements and callable statements. Even
> though Oracle JDBC supports the use of standard batching for {{Statement}}
> and {{CallableStatement}} objects, you are unlikely to see performance
> improvement.
> {quote}
> I would look for connection properties to set, so it is handled anyway, or if
> not, then use:
> {code}
> begin
> query1;
> query2;
> query3;
>
[jira] [Updated] (HIVE-23192) "default" database locationUri should be external warehouse root.
[ https://issues.apache.org/jira/browse/HIVE-23192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-23192: - Attachment: HIVE-23192.patch > "default" database locationUri should be external warehouse root. > - > > Key: HIVE-23192 > URL: https://issues.apache.org/jira/browse/HIVE-23192 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Attachments: HIVE-23192.patch, HIVE-23192.patch, HIVE-23192.patch > > > When creating the default database, the database locationUri should be set to > external warehouse. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23192) "default" database locationUri should be external warehouse root.
[ https://issues.apache.org/jira/browse/HIVE-23192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-23192: - Status: Patch Available (was: Open) > "default" database locationUri should be external warehouse root. > - > > Key: HIVE-23192 > URL: https://issues.apache.org/jira/browse/HIVE-23192 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Attachments: HIVE-23192.patch, HIVE-23192.patch, HIVE-23192.patch > > > When creating the default database, the database locationUri should be set to > external warehouse. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23192) "default" database locationUri should be external warehouse root.
[ https://issues.apache.org/jira/browse/HIVE-23192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-23192: - Status: Open (was: Patch Available) > "default" database locationUri should be external warehouse root. > - > > Key: HIVE-23192 > URL: https://issues.apache.org/jira/browse/HIVE-23192 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > Attachments: HIVE-23192.patch, HIVE-23192.patch, HIVE-23192.patch > > > When creating the default database, the database locationUri should be set to > external warehouse. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-23260) Add support for unmodified_metadata capability
[ https://issues.apache.org/jira/browse/HIVE-23260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam reassigned HIVE-23260: > Add support for unmodified_metadata capability > -- > > Key: HIVE-23260 > URL: https://issues.apache.org/jira/browse/HIVE-23260 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 4.0.0 >Reporter: Naveen Gangam >Assignee: Naveen Gangam >Priority: Major > > Currently, the translator removes bucketing info for tables for clients that > do not possess the HIVEBUCKET2 capability. While this is desirable, some > clients that have write access to these tables can turn around overwrite the > metadata thus corrupting original bucketing info. > So adding support for a capability for client that are capable of > interpreting the original metadata would prevent such corruption. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23258) Remove BoneCP Connection Pool
[
https://issues.apache.org/jira/browse/HIVE-23258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-23258:
Fix Version/s: 4.0.0
Resolution: Fixed
Status: Resolved (was: Patch Available)
Pushed to master. Thanks, David!
> Remove BoneCP Connection Pool
> -
>
> Key: HIVE-23258
> URL: https://issues.apache.org/jira/browse/HIVE-23258
> Project: Hive
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-23258.1.patch
>
>
> {quote}
> BoneCP is a Java JDBC connection pool implementation that is tuned for high
> performance by minimizing lock contention to give greater throughput for your
> application ... but SHOULD NOW BE CONSIDERED DEPRECATED in favour of HikariCP.
> {quote}
> https://github.com/wwadge/bonecp
> The default in Hive 3.x is already HikariCP, so just remove BoneCP in 4.x
> https://github.com/apache/hive/blob/branch-3.1/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java#L392
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23258) Remove BoneCP Connection Pool
[
https://issues.apache.org/jira/browse/HIVE-23258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088239#comment-17088239
]
Ashutosh Chauhan commented on HIVE-23258:
-
+1
> Remove BoneCP Connection Pool
> -
>
> Key: HIVE-23258
> URL: https://issues.apache.org/jira/browse/HIVE-23258
> Project: Hive
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Attachments: HIVE-23258.1.patch
>
>
> {quote}
> BoneCP is a Java JDBC connection pool implementation that is tuned for high
> performance by minimizing lock contention to give greater throughput for your
> application ... but SHOULD NOW BE CONSIDERED DEPRECATED in favour of HikariCP.
> {quote}
> https://github.com/wwadge/bonecp
> The default in Hive 3.x is already HikariCP, so just remove BoneCP in 4.x
> https://github.com/apache/hive/blob/branch-3.1/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java#L392
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23258) Remove BoneCP Connection Pool
[
https://issues.apache.org/jira/browse/HIVE-23258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088235#comment-17088235
]
Hive QA commented on HIVE-23258:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000571/HIVE-23258.1.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17130 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21811/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21811/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21811/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000571 - PreCommit-HIVE-Build
> Remove BoneCP Connection Pool
> -
>
> Key: HIVE-23258
> URL: https://issues.apache.org/jira/browse/HIVE-23258
> Project: Hive
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Attachments: HIVE-23258.1.patch
>
>
> {quote}
> BoneCP is a Java JDBC connection pool implementation that is tuned for high
> performance by minimizing lock contention to give greater throughput for your
> application ... but SHOULD NOW BE CONSIDERED DEPRECATED in favour of HikariCP.
> {quote}
> https://github.com/wwadge/bonecp
> The default in Hive 3.x is already HikariCP, so just remove BoneCP in 4.x
> https://github.com/apache/hive/blob/branch-3.1/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java#L392
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23207) Create integration tests for TxnManager for different rdbms metastores
[
https://issues.apache.org/jira/browse/HIVE-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088231#comment-17088231
]
Hive QA commented on HIVE-23207:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
9s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
46s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 11m
3s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 4m
35s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
23s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
51s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
22s{color} | {color:blue} itests/qtest-druid in master has 7 extant Findbugs
warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
52s{color} | {color:blue} itests/util in master has 53 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 10m
27s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
29s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 15m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 19m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 19m
33s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
29s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 1 new + 514 unchanged - 12 fixed = 515 total (was 526) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
53s{color} | {color:red} ql: The patch generated 1 new + 139 unchanged - 80
fixed = 140 total (was 219) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 3m
2s{color} | {color:red} root: The patch generated 2 new + 671 unchanged - 92
fixed = 673 total (was 763) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
13s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
9s{color} | {color:red} patch/standalone-metastore/metastore-server cannot run
setBugDatabaseInfo from findbugs {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 6m
0s{color} | {color:red} patch/ql cannot run setBugDatabaseInfo from findbugs
{color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
26s{color} | {color:red} patch/itests/qtest-druid cannot run setBugDatabaseInfo
from findbugs {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
12s{color} | {color:red} patch/itests/util cannot run setBugDatabaseInfo from
findbugs {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 14m
21s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
23s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}110m 50s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc xml compile findbugs
checkstyle |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21810/dev-support/hive-personality.sh
|
| git revision |
[jira] [Updated] (HIVE-23216) Add new api as replacement of get_partitions_by_expr to return PartitionSpec instead of Partitions
[ https://issues.apache.org/jira/browse/HIVE-23216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-23216: --- Status: Patch Available (was: Open) > Add new api as replacement of get_partitions_by_expr to return PartitionSpec > instead of Partitions > -- > > Key: HIVE-23216 > URL: https://issues.apache.org/jira/browse/HIVE-23216 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-23216.1.patch, HIVE-23216.2.patch, > HIVE-23216.3.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23216) Add new api as replacement of get_partitions_by_expr to return PartitionSpec instead of Partitions
[ https://issues.apache.org/jira/browse/HIVE-23216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-23216: --- Attachment: HIVE-23216.3.patch > Add new api as replacement of get_partitions_by_expr to return PartitionSpec > instead of Partitions > -- > > Key: HIVE-23216 > URL: https://issues.apache.org/jira/browse/HIVE-23216 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-23216.1.patch, HIVE-23216.2.patch, > HIVE-23216.3.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23216) Add new api as replacement of get_partitions_by_expr to return PartitionSpec instead of Partitions
[ https://issues.apache.org/jira/browse/HIVE-23216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-23216: --- Status: Open (was: Patch Available) > Add new api as replacement of get_partitions_by_expr to return PartitionSpec > instead of Partitions > -- > > Key: HIVE-23216 > URL: https://issues.apache.org/jira/browse/HIVE-23216 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: 4.0.0 >Reporter: Vineet Garg >Assignee: Vineet Garg >Priority: Major > Attachments: HIVE-23216.1.patch, HIVE-23216.2.patch, > HIVE-23216.3.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23207) Create integration tests for TxnManager for different rdbms metastores
[
https://issues.apache.org/jira/browse/HIVE-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088202#comment-17088202
]
Hive QA commented on HIVE-23207:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000558/HIVE-23207.7.patch
{color:green}SUCCESS:{color} +1 due to 8 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 17115 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestBeeLineDriver.org.apache.hadoop.hive.cli.TestBeeLineDriver
(batchId=231)
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver[url_hook]
(batchId=227)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21810/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21810/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21810/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000558 - PreCommit-HIVE-Build
> Create integration tests for TxnManager for different rdbms metastores
> --
>
> Key: HIVE-23207
> URL: https://issues.apache.org/jira/browse/HIVE-23207
> Project: Hive
> Issue Type: Improvement
>Reporter: Peter Varga
>Assignee: Peter Varga
>Priority: Minor
> Attachments: HIVE-23207.1.patch, HIVE-23207.2.patch,
> HIVE-23207.3.patch, HIVE-23207.4.patch, HIVE-23207.5.patch,
> HIVE-23207.6.patch, HIVE-23207.7.patch
>
>
> Create an integration test suite that runs tests for TxnManager with the
> metastore configured to use different kind of RDBMS-s. Use the different
> DatabaseRule-s defined in the standalone-metastore for docker environments,
> and use the real init schema for every database type instead of the hardwired
> TxnDbUtil.prepDb.
> This test will be useful for easy manual validation of schema changes.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23235) Checkpointing in repl dump failing for orc format
[
https://issues.apache.org/jira/browse/HIVE-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088185#comment-17088185
]
Hive QA commented on HIVE-23235:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000555/HIVE-23235.02.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 51 failed/errored test(s), 17138 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[mm_conversions]
(batchId=110)
org.apache.hadoop.hive.ql.parse.TestMetaStoreEventListenerInRepl.testReplEvents
(batchId=181)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesBootstrapWithJsonMessage.testAcidTablesBootstrapDuringIncremental
(batchId=183)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesBootstrapWithJsonMessage.testBootstrapAcidTablesDuringIncrementalWithConcurrentWrites
(batchId=183)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesBootstrapWithJsonMessage.testRetryAcidTablesBootstrapFromDifferentDump
(batchId=183)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testAcidTablesBootstrap
(batchId=200)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testAcidTablesBootstrapWithConcurrentDropTable
(batchId=200)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testAcidTablesBootstrapWithConcurrentWrites
(batchId=200)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testAcidTablesMoveOptimizationIncremental
(batchId=200)
org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testOpenTxnEvent
(batchId=200)
org.apache.hadoop.hive.ql.parse.TestReplTableMigrationWithJsonFormat.testIncrementalLoadMigrationManagedToAcid
(batchId=198)
org.apache.hadoop.hive.ql.parse.TestReplTableMigrationWithJsonFormat.testIncrementalLoadMigrationManagedToAcidAllOp
(batchId=198)
org.apache.hadoop.hive.ql.parse.TestReplTableMigrationWithJsonFormat.testIncrementalLoadMigrationManagedToAcidFailure
(batchId=198)
org.apache.hadoop.hive.ql.parse.TestReplTableMigrationWithJsonFormat.testIncrementalLoadMigrationManagedToAcidFailurePart
(batchId=198)
org.apache.hadoop.hive.ql.parse.TestReplTableMigrationWithJsonFormat.testIncrementalLoadMigrationToAcidWithMoveOptimization
(batchId=198)
org.apache.hadoop.hive.ql.parse.TestReplTableMigrationWithJsonFormat.testMigrationWithUpgrade
(batchId=198)
org.apache.hadoop.hive.ql.parse.TestReplWithJsonMessageFormat.testExchangePartition
(batchId=184)
org.apache.hadoop.hive.ql.parse.TestReplWithJsonMessageFormat.testMoveOptimizationIncremental
(batchId=184)
org.apache.hadoop.hive.ql.parse.TestReplicationOfHiveStreaming.testHiveStreamingDynamicPartitionWithTxnBatchSizeAsOne
(batchId=179)
org.apache.hadoop.hive.ql.parse.TestReplicationOfHiveStreaming.testHiveStreamingStaticPartitionWithTxnBatchSizeAsOne
(batchId=179)
org.apache.hadoop.hive.ql.parse.TestReplicationOfHiveStreaming.testHiveStreamingUnpartitionedWithTxnBatchSizeAsOne
(batchId=179)
org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testExchangePartition
(batchId=193)
org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testMoveOptimizationIncremental
(batchId=193)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testAcidTablesBootstrap
(batchId=202)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testAcidTablesBootstrapWithConcurrentDropTable
(batchId=202)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testAcidTablesBootstrapWithConcurrentWrites
(batchId=202)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testAcidTablesMoveOptimizationIncremental
(batchId=202)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testOpenTxnEvent
(batchId=202)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTablesBootstrap.testAcidTablesBootstrapDuringIncremental
(batchId=180)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTablesBootstrap.testBootstrapAcidTablesDuringIncrementalWithConcurrentWrites
(batchId=180)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTablesBootstrap.testRetryAcidTablesBootstrapFromDifferentDump
(batchId=180)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosIncrementalLoadAcidTables.testAcidTableIncrementalReplication
(batchId=203)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosIncrementalLoadAcidTables.testReplCM
(batchId=203)
org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigration.testIncrementalLoadMigrationManagedToAcid
(batchId=187)
org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigration.testIncrementalLoadMigrationManagedToAcidAllOp
(batchId=187)
org.apache.hadoop.hive.ql.parse.TestReplicationWithTableMigration.testIncrementalLoadMigrationManagedToAcidFailure
(batchId=187)
[jira] [Commented] (HIVE-23235) Checkpointing in repl dump failing for orc format
[
https://issues.apache.org/jira/browse/HIVE-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088175#comment-17088175
]
Hive QA commented on HIVE-23235:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
18s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
53s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
58s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
59s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
28s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
36s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
56s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
26s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 33m 58s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21809/dev-support/hive-personality.sh
|
| git revision | master / 57b2024 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21809/yetus/patch-asflicense-problems.txt
|
| modules | C: ql itests/hive-unit U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21809/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Checkpointing in repl dump failing for orc format
> -
>
> Key: HIVE-23235
> URL: https://issues.apache.org/jira/browse/HIVE-23235
> Project: Hive
> Issue Type: Bug
>Reporter: Aasha Medhi
>Assignee: Aasha Medhi
>Priority: Major
> Attachments: HIVE-23235.01.patch, HIVE-23235.02.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23249) Prevent infinite loop in TestJdbcWithMiniLlapArrow
[
https://issues.apache.org/jira/browse/HIVE-23249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088161#comment-17088161
]
Hive QA commented on HIVE-23249:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000524/HIVE-23249.01.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 14 failed/errored test(s), 17134 tests
executed
*Failed tests:*
{noformat}
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testComplexQuery (batchId=215)
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testKillQuery (batchId=215)
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testKillQueryByTagNegative
(batchId=215)
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testLlapInputFormatEndToEnd
(batchId=215)
org.apache.hive.jdbc.TestJdbcWithMiniLlapArrow.testMultipleBatchesOfComplexTypes
(batchId=215)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testCancelRenewTokenFlow
(batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testConnection (batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testIsValid (batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testIsValidNeg (batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testNegativeProxyAuth
(batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testNegativeTokenAuth
(batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testProxyAuth (batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testRenewDelegationToken
(batchId=236)
org.apache.hive.minikdc.TestJdbcWithDBTokenStore.testTokenAuth (batchId=236)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21808/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21808/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21808/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 14 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000524 - PreCommit-HIVE-Build
> Prevent infinite loop in TestJdbcWithMiniLlapArrow
> --
>
> Key: HIVE-23249
> URL: https://issues.apache.org/jira/browse/HIVE-23249
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23249.01.patch
>
>
> if we always hit continue
> [here|https://github.com/apache/hive/blob/e65715c6ab12816ba6a79b21e8e9fcbfc6fe41cd/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcWithMiniLlapArrow.java#L372];
> the loop may never-ever end...
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088148#comment-17088148 ] Ismaël Mejía commented on HIVE-23259: - Ah I see, slow queue, thanks for the info [~pgaref] > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Metastore, Standalone Metastore >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23167) Extend compiler support for Probe static filters
[ https://issues.apache.org/jira/browse/HIVE-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23167: -- Description: Extend HIVE-23006 rules to support static filter expressions like: select * from sales where sold_state = 'PR'; was: Extend rule can be extended to support static filter expressions like: select * from sales where sold_state = 'PR'; > Extend compiler support for Probe static filters > > > Key: HIVE-23167 > URL: https://issues.apache.org/jira/browse/HIVE-23167 > Project: Hive > Issue Type: Sub-task >Reporter: Panagiotis Garefalakis >Assignee: Panagiotis Garefalakis >Priority: Major > > Extend HIVE-23006 rules to support static filter expressions like: > select * from sales where sold_state = 'PR'; -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23167) Extend compiler support for Probe static filters
[ https://issues.apache.org/jira/browse/HIVE-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23167: -- Description: Extend rule can be extended to support static filter expressions like: select * from sales where sold_state = 'PR'; > Extend compiler support for Probe static filters > > > Key: HIVE-23167 > URL: https://issues.apache.org/jira/browse/HIVE-23167 > Project: Hive > Issue Type: Sub-task >Reporter: Panagiotis Garefalakis >Assignee: Panagiotis Garefalakis >Priority: Major > > Extend rule can be extended to support static filter expressions like: > select * from sales where sold_state = 'PR'; -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23249) Prevent infinite loop in TestJdbcWithMiniLlapArrow
[
https://issues.apache.org/jira/browse/HIVE-23249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088147#comment-17088147
]
Hive QA commented on HIVE-23249:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
32s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
19s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
42s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
29s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
29s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 16m 39s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21808/dev-support/hive-personality.sh
|
| git revision | master / 57b2024 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21808/yetus/patch-asflicense-problems.txt
|
| modules | C: itests/hive-unit U: itests/hive-unit |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21808/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Prevent infinite loop in TestJdbcWithMiniLlapArrow
> --
>
> Key: HIVE-23249
> URL: https://issues.apache.org/jira/browse/HIVE-23249
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23249.01.patch
>
>
> if we always hit continue
> [here|https://github.com/apache/hive/blob/e65715c6ab12816ba6a79b21e8e9fcbfc6fe41cd/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcWithMiniLlapArrow.java#L372];
> the loop may never-ever end...
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088139#comment-17088139 ] Panagiotis Garefalakis commented on HIVE-23259: --- [~iemejia] it should be fine, precommit builds are listed here: https://builds.apache.org/job/PreCommit-HIVE-Build/ For this particular issue the pending build is: 21819 > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Metastore, Standalone Metastore >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23247) Increase timeout for some tez tests
[
https://issues.apache.org/jira/browse/HIVE-23247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088137#comment-17088137
]
Hive QA commented on HIVE-23247:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000525/HIVE-23247.01.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17134 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21807/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21807/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21807/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000525 - PreCommit-HIVE-Build
> Increase timeout for some tez tests
> ---
>
> Key: HIVE-23247
> URL: https://issues.apache.org/jira/browse/HIVE-23247
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23247.01.patch, HIVE-23247.01.patch
>
>
> we have a few tez tests which run for ~3.4 seconds with a 5sec timeout
> In case these tests run in a more saturated environment they became
> unrelyable...and fail regularily
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088136#comment-17088136 ] Ismaël Mejía commented on HIVE-23259: - Mmm tests did not start did I something wrong? > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Metastore, Standalone Metastore >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23247) Increase timeout for some tez tests
[
https://issues.apache.org/jira/browse/HIVE-23247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088116#comment-17088116
]
Hive QA commented on HIVE-23247:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 10m
31s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
43s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
57s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
33s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
45s{color} | {color:red} ql: The patch generated 1 new + 34 unchanged - 1 fixed
= 35 total (was 35) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 26m 37s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21807/dev-support/hive-personality.sh
|
| git revision | master / 57b2024 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21807/yetus/diff-checkstyle-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21807/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21807/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Increase timeout for some tez tests
> ---
>
> Key: HIVE-23247
> URL: https://issues.apache.org/jira/browse/HIVE-23247
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23247.01.patch, HIVE-23247.01.patch
>
>
> we have a few tez tests which run for ~3.4 seconds with a 5sec timeout
> In case these tests run in a more saturated environment they became
> unrelyable...and fail regularily
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23252) Change spark related tests to be optional
[
https://issues.apache.org/jira/browse/HIVE-23252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088095#comment-17088095
]
Hive QA commented on HIVE-23252:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000523/HIVE-23252.01.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21806/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21806/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21806/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2020-04-20 21:22:23.643
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-21806/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2020-04-20 21:22:23.647
+ cd apache-github-source-source
+ git fetch origin
>From https://github.com/apache/hive
5de00c7..57b2024 master -> origin/master
+ git reset --hard HEAD
HEAD is now at 5de00c7 HIVE-22821: Add necessary endpoints for proactive cache
eviction (Adam Szita, reviewed by Peter Vary, Slim Bouguerra)
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is behind 'origin/master' by 1 commit, and can be fast-forwarded.
(use "git pull" to update your local branch)
+ git reset --hard origin/master
HEAD is now at 57b2024 HIVE-23241 : Reduce transitive dependencies
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2020-04-20 21:22:24.781
+ rm -rf ../yetus_PreCommit-HIVE-Build-21806
+ mkdir ../yetus_PreCommit-HIVE-Build-21806
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-21806
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-21806/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
Trying to apply the patch with -p0
Going to apply patch with: git apply -p0
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
protoc-jar: executing: [/tmp/protoc1723580659395932067.exe, --version]
libprotoc 2.6.1
protoc-jar: executing: [/tmp/protoc1723580659395932067.exe,
-I/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore,
--java_out=/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/target/generated-sources,
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore/metastore.proto]
ANTLR Parser Generator Version 3.5.2
protoc-jar: executing: [/tmp/protoc6989735723061687126.exe, --version]
libprotoc 2.6.1
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-server/target/generated-sources/org/apache/hadoop/hive/metastore/parser/FilterParser.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/parser/Filter.g
org/apache/hadoop/hive/metastore/parser/Filter.g
ANTLR Parser Generator Version 3.5.2
Output file
/data/hiveptest/working/apache-github-source-source/parser/target/generated-sources/antlr3/org/apache/hadoop/hive/ql/parse/HiveLexer.java
does not exist: must build
/data/hiveptest/working/apache-github-source-source/parser/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g
org/apache/hadoop/hive/ql/parse/HiveLexer.g
Output file
[jira] [Commented] (HIVE-23251) Provide a way to have only a selection of datasets loaded
[
https://issues.apache.org/jira/browse/HIVE-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088092#comment-17088092
]
Hive QA commented on HIVE-23251:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000515/HIVE-23251.01.patch
{color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17134 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21805/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21805/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21805/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000515 - PreCommit-HIVE-Build
> Provide a way to have only a selection of datasets loaded
> -
>
> Key: HIVE-23251
> URL: https://issues.apache.org/jira/browse/HIVE-23251
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23251.01.patch
>
>
> for example sysdb.q is listing all the tables known; which can change
> depending on tests executed prior to this qtest
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-9452) Use HBase to store Hive metadata
[ https://issues.apache.org/jira/browse/HIVE-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned HIVE-9452: --- Assignee: Tim Armstrong (was: Alan Gates) > Use HBase to store Hive metadata > > > Key: HIVE-9452 > URL: https://issues.apache.org/jira/browse/HIVE-9452 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: hbase-metastore-branch >Reporter: Alan Gates >Assignee: Tim Armstrong >Priority: Major > Attachments: HBaseMetastoreApproach.pdf > > > qThis is an umbrella JIRA for a project to explore using HBase to store the > Hive data catalog (ie the metastore). This project has several goals: > # The current metastore implementation is slow when tables have thousands or > more partitions. With Tez and Spark engines we are pushing Hive to a point > where queries only take a few seconds to run. But planning the query can > take as long as running it. Much of this time is spent in metadata > operations. > # Due to scale limitations we have never allowed tasks to communicate > directly with the metastore. However, with the development of LLAP this > requirement will have to be relaxed. If we can relax this there are other > use cases that could benefit from this. > # Eating our own dogfood. Rather than using external systems to store our > metadata there are benefits to using other components in the Hadoop system. > The proposal is to create a new branch and work on the prototype there. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-9452) Use HBase to store Hive metadata
[ https://issues.apache.org/jira/browse/HIVE-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong reassigned HIVE-9452: --- Assignee: Alan Gates (was: Tim Armstrong) > Use HBase to store Hive metadata > > > Key: HIVE-9452 > URL: https://issues.apache.org/jira/browse/HIVE-9452 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: hbase-metastore-branch >Reporter: Alan Gates >Assignee: Alan Gates >Priority: Major > Attachments: HBaseMetastoreApproach.pdf > > > qThis is an umbrella JIRA for a project to explore using HBase to store the > Hive data catalog (ie the metastore). This project has several goals: > # The current metastore implementation is slow when tables have thousands or > more partitions. With Tez and Spark engines we are pushing Hive to a point > where queries only take a few seconds to run. But planning the query can > take as long as running it. Much of this time is spent in metadata > operations. > # Due to scale limitations we have never allowed tasks to communicate > directly with the metastore. However, with the development of LLAP this > requirement will have to be relaxed. If we can relax this there are other > use cases that could benefit from this. > # Eating our own dogfood. Rather than using external systems to store our > metadata there are benefits to using other components in the Hadoop system. > The proposal is to create a new branch and work on the prototype there. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23241) Reduce transitive dependencies
[ https://issues.apache.org/jira/browse/HIVE-23241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088083#comment-17088083 ] Ashutosh Chauhan commented on HIVE-23241: - Pushed to master. > Reduce transitive dependencies > -- > > Key: HIVE-23241 > URL: https://issues.apache.org/jira/browse/HIVE-23241 > Project: Hive > Issue Type: Improvement >Reporter: Ashutosh Chauhan >Assignee: Ashutosh Chauhan >Priority: Major > Attachments: HIVE-23241.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[ https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-19369: -- Attachment: (was: HIVE-19369.6.patch) > Locks: Add new lock implementations for always zero-wait readers > > > Key: HIVE-19369 > URL: https://issues.apache.org/jira/browse/HIVE-19369 > Project: Hive > Issue Type: Improvement > Components: Transactions >Reporter: Gopal Vijayaraghavan >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch, > HIVE-19369.3.patch, HIVE-19369.4.patch, HIVE-19369.5.patch, HIVE-19369.6.patch > > > Hive Locking with Micro-managed and full-ACID tables needs a better locking > implementation which allows for no-wait readers always. > EXCL_DROP > EXCL_WRITE > SHARED_WRITE > SHARED_READ > Short write-up > EXCL_DROP is a "drop partition" or "drop table" and waits for all others to > exit > EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to > exit. > SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an > EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different > threads). > SHARED_READ does not wait for any lock - it fails fast for a pending > EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending, > there's no semantic reason to wait for them to succeed before going ahead > with a SHARED_WRITE. > a select * => SHARED_READ > an insert into => SHARED_WRITE > an insert overwrite or MERGE => EXCL_WRITE > a drop table => EXCL_DROP > TODO: > The fate of the compactor needs to be added to this before it is a complete > description. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[ https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-19369: -- Attachment: HIVE-19369.6.patch > Locks: Add new lock implementations for always zero-wait readers > > > Key: HIVE-19369 > URL: https://issues.apache.org/jira/browse/HIVE-19369 > Project: Hive > Issue Type: Improvement > Components: Transactions >Reporter: Gopal Vijayaraghavan >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch, > HIVE-19369.3.patch, HIVE-19369.4.patch, HIVE-19369.5.patch, HIVE-19369.6.patch > > > Hive Locking with Micro-managed and full-ACID tables needs a better locking > implementation which allows for no-wait readers always. > EXCL_DROP > EXCL_WRITE > SHARED_WRITE > SHARED_READ > Short write-up > EXCL_DROP is a "drop partition" or "drop table" and waits for all others to > exit > EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to > exit. > SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an > EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different > threads). > SHARED_READ does not wait for any lock - it fails fast for a pending > EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending, > there's no semantic reason to wait for them to succeed before going ahead > with a SHARED_WRITE. > a select * => SHARED_READ > an insert into => SHARED_WRITE > an insert overwrite or MERGE => EXCL_WRITE > a drop table => EXCL_DROP > TODO: > The fate of the compactor needs to be added to this before it is a complete > description. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23251) Provide a way to have only a selection of datasets loaded
[
https://issues.apache.org/jira/browse/HIVE-23251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088081#comment-17088081
]
Hive QA commented on HIVE-23251:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
42s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
36s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
57s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
59s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
49s{color} | {color:blue} itests/util in master has 53 extant Findbugs
warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
21s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
57s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 5m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
21s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 32m 20s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21805/dev-support/hive-personality.sh
|
| git revision | master / 5de00c7 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21805/yetus/patch-asflicense-problems.txt
|
| modules | C: ql itests/util U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21805/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Provide a way to have only a selection of datasets loaded
> -
>
> Key: HIVE-23251
> URL: https://issues.apache.org/jira/browse/HIVE-23251
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23251.01.patch
>
>
> for example sysdb.q is listing all the tables known; which can change
> depending on tests executed prior to this qtest
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HIVE-13538) LLAPTaskScheduler should consider local tasks before non-local tasks at the same priority level
[ https://issues.apache.org/jira/browse/HIVE-13538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis reassigned HIVE-13538: - Assignee: Panagiotis Garefalakis (was: Siddharth Seth) > LLAPTaskScheduler should consider local tasks before non-local tasks at the > same priority level > --- > > Key: HIVE-13538 > URL: https://issues.apache.org/jira/browse/HIVE-13538 > Project: Hive > Issue Type: Improvement >Reporter: Siddharth Seth >Assignee: Panagiotis Garefalakis >Priority: Major > > To get better locality - try scheduling tasks with locality information, > before tasks without locality information if they are at the same priority > level. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23259: -- Component/s: (was: Build Infrastructure) Standalone Metastore > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Standalone Metastore >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated HIVE-23259: -- Component/s: Metastore > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Metastore, Standalone Metastore >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-19369) Locks: Add new lock implementations for always zero-wait readers
[ https://issues.apache.org/jira/browse/HIVE-19369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denys Kuzmenko updated HIVE-19369: -- Attachment: HIVE-19369.6.patch > Locks: Add new lock implementations for always zero-wait readers > > > Key: HIVE-19369 > URL: https://issues.apache.org/jira/browse/HIVE-19369 > Project: Hive > Issue Type: Improvement > Components: Transactions >Reporter: Gopal Vijayaraghavan >Assignee: Denys Kuzmenko >Priority: Major > Attachments: HIVE-19369.1.patch, HIVE-19369.2.patch, > HIVE-19369.3.patch, HIVE-19369.4.patch, HIVE-19369.5.patch, HIVE-19369.6.patch > > > Hive Locking with Micro-managed and full-ACID tables needs a better locking > implementation which allows for no-wait readers always. > EXCL_DROP > EXCL_WRITE > SHARED_WRITE > SHARED_READ > Short write-up > EXCL_DROP is a "drop partition" or "drop table" and waits for all others to > exit > EXCL_WRITE excludes all writes and will wait for all existing SHARED_WRITE to > exit. > SHARED_WRITE allows all SHARED_WRITES to go through, but will wait for an > EXCL_WRITE & EXCL_DROP (waiting so that you can do drop + insert in different > threads). > SHARED_READ does not wait for any lock - it fails fast for a pending > EXCL_DROP, because even if there is an EXCL_WRITE or SHARED_WRITE pending, > there's no semantic reason to wait for them to succeed before going ahead > with a SHARED_WRITE. > a select * => SHARED_READ > an insert into => SHARED_WRITE > an insert overwrite or MERGE => EXCL_WRITE > a drop table => EXCL_DROP > TODO: > The fate of the compactor needs to be added to this before it is a complete > description. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088074#comment-17088074 ] Ismaël Mejía commented on HIVE-23259: - Thanks [~pgaref] I had forgotten about the naming convention. Hope it works now. > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated HIVE-23259: Attachment: HIVE-23259.patch Status: Patch Available (was: Open) > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: HIVE-23259.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated HIVE-23259: Attachment: (was: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch) > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated HIVE-23259: Status: Open (was: Patch Available) > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088071#comment-17088071 ] Panagiotis Garefalakis edited comment on HIVE-23259 at 4/20/20, 8:43 PM: - [~iemejia] please follow the patch naming guidelines described here: https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch – with the current patch name precommit build will fail. Cheers was (Author: pgaref): [~iemejia] please follow the patch naming guidelines described [here|[https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch] – with the current patch name precommit build will fail. Cheers > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088071#comment-17088071 ] Panagiotis Garefalakis edited comment on HIVE-23259 at 4/20/20, 8:42 PM: - [~iemejia] please follow the patch naming guidelines described [here|[https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch]] – with the current patch name precommit build will fail. Cheers was (Author: pgaref): [~iemejia] please follow the patch naming guidelines described [here|[https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch]] – with the current patch name precommit build will fail. Cheers > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088071#comment-17088071 ] Panagiotis Garefalakis edited comment on HIVE-23259 at 4/20/20, 8:42 PM: - [~iemejia] please follow the patch naming guidelines described [here|[https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch] – with the current patch name precommit build will fail. Cheers was (Author: pgaref): [~iemejia] please follow the patch naming guidelines described [here|[https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch]] – with the current patch name precommit build will fail. Cheers > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088071#comment-17088071 ] Panagiotis Garefalakis commented on HIVE-23259: --- [~iemejia] please follow the patch naming guidelines described [here|[https://cwiki.apache.org/confluence/display/Hive/HowToContribute#HowToContribute-CreatingaPatch]] – with the current patch name precommit build will fail. Cheers > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated HIVE-23259: Attachment: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch Status: Patch Available (was: Open) > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated HIVE-23259: Attachment: (was: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch) > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated HIVE-23259: Attachment: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > Attachments: 0001-HIVE-23259-Add-missing-Apache-license-headers.patch > > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HIVE-23259) Fix Apache Rat validation
[ https://issues.apache.org/jira/browse/HIVE-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned HIVE-23259: --- > Fix Apache Rat validation > -- > > Key: HIVE-23259 > URL: https://issues.apache.org/jira/browse/HIVE-23259 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Reporter: Ismaël Mejía >Assignee: Ismaël Mejía >Priority: Trivial > > The headers for two files merged as part of HIVE-22750 did not include the > Apache headers, this issue is to add it and unlock the validation to pass. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23211) Fix metastore schema differences between init scripts, and upgrade scripts
[
https://issues.apache.org/jira/browse/HIVE-23211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088052#comment-17088052
]
Hive QA commented on HIVE-23211:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000505/HIVE-23211.3.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 17134 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21804/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21804/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21804/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000505 - PreCommit-HIVE-Build
> Fix metastore schema differences between init scripts, and upgrade scripts
> --
>
> Key: HIVE-23211
> URL: https://issues.apache.org/jira/browse/HIVE-23211
> Project: Hive
> Issue Type: Bug
> Components: Standalone Metastore
>Reporter: Barnabas Maidics
>Assignee: Barnabas Maidics
>Priority: Major
> Attachments: HIVE-23211.1.patch, HIVE-23211.2.patch,
> HIVE-23211.3.patch
>
>
> There are some differences (character encoding, defaults etc..) in metastore
> schema if we initialize using the init scripts, or upgrade using the upgrade
> scripts. The schema should be identical.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-21737) Upgrade Avro to version 1.9.2
[ https://issues.apache.org/jira/browse/HIVE-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088050#comment-17088050 ] Ismaël Mejía commented on HIVE-21737: - Thanks a lot for the historical info, now I understand the details. It seems that with 3y of no progress this is not going to be solved easily. What about building un updated version of Hive's assembly? I can help if needed if there are references on how to do so, but I would probably need your help or of someone with more Hive CI knowledge to get this pushed into the right places. > Upgrade Avro to version 1.9.2 > - > > Key: HIVE-21737 > URL: https://issues.apache.org/jira/browse/HIVE-21737 > Project: Hive > Issue Type: Improvement > Components: Hive >Reporter: Ismaël Mejía >Assignee: Fokko Driesprong >Priority: Major > Labels: pull-request-available > Attachments: 0001-HIVE-21737-Bump-Apache-Avro-to-1.9.2.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Avro 1.9.2 was released recently. It brings a lot of fixes including a leaner > version of Avro without Jackson in the public API. Worth the update. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23124) Review of SQLOperation Class
[
https://issues.apache.org/jira/browse/HIVE-23124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088040#comment-17088040
]
Peter Vary commented on HIVE-23124:
---
[~belugabehr]: You sold the optional :)
> Review of SQLOperation Class
>
>
> Key: HIVE-23124
> URL: https://issues.apache.org/jira/browse/HIVE-23124
> Project: Hive
> Issue Type: Improvement
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Major
> Attachments: HIVE-23124.1.patch
>
>
> * Use ConcurrentHashMap instead of synchronized methods to improve
> multi-threaded access
> * Use JDK 8 facilities where applicable
> * General cleanup
> * Better log messages and Exception messages
> * Use {{switch}} statement instead of if/else blocks
> * Checkstyle fixes
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23117) Review of HiveStatement Class
[
https://issues.apache.org/jira/browse/HIVE-23117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088038#comment-17088038
]
Peter Vary commented on HIVE-23117:
---
[~belugabehr]: Ok. Sold on the optional +1
> Review of HiveStatement Class
> -
>
> Key: HIVE-23117
> URL: https://issues.apache.org/jira/browse/HIVE-23117
> Project: Hive
> Issue Type: Improvement
> Components: JDBC
>Reporter: David Mollitor
>Assignee: David Mollitor
>Priority: Minor
> Attachments: HIVE-23117.1.patch
>
>
> * Remove unused instance variable(s)
> * Remove non-JavaDoc comments
> * Make inPlaceUpdateStream Optional (and remove NO-OP class) (inconsistent
> behavior with 'null' values)
> * {{getQueryTimeout()}} returns incorrect value
> * Unify and improve Exception messages
> * Checkstyle fixes
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[ https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088036#comment-17088036 ] David Mollitor commented on HIVE-23243: --- +1 on [^HIVE-23243.01.patch] pending tests Spoke with [~mgergely] directly. We will go with this option for now, but there should be another Jira created to improve this. This patch loses the benefit of the current setup in that the wildcard is not passed all the way down to the RDBMS (as it is now), but instead it requests an entire list of Databases and then filters at HS2 level. It would be nice if this filter could also be pushed all the way down to the RDBMS, however, the current HMS API only allows the simple use case of having a '*' in the lookup, probably to support this feature. There is currently no easy (or accurate) way to map the SQL wildcard syntax to this simplified wildcard setup. HMS needs a more robust, fully featured, capability to generate a list of databases based on SQL wild card semantics. > Accept SQL type like pattern for Show Databases > --- > > Key: HIVE-23243 > URL: https://issues.apache.org/jira/browse/HIVE-23243 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Minor > Attachments: HIVE-23243.01.patch > > > Show Databases pattern accepts java like pattern with * and ., use SQL like > instead with % and _. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23211) Fix metastore schema differences between init scripts, and upgrade scripts
[
https://issues.apache.org/jira/browse/HIVE-23211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088032#comment-17088032
]
Hive QA commented on HIVE-23211:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
33s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
30s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
34s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 14m 15s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21804/dev-support/hive-personality.sh
|
| git revision | master / 5de00c7 |
| Default Java | 1.8.0_111 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21804/yetus/patch-asflicense-problems.txt
|
| modules | C: metastore standalone-metastore/metastore-server U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21804/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Fix metastore schema differences between init scripts, and upgrade scripts
> --
>
> Key: HIVE-23211
> URL: https://issues.apache.org/jira/browse/HIVE-23211
> Project: Hive
> Issue Type: Bug
> Components: Standalone Metastore
>Reporter: Barnabas Maidics
>Assignee: Barnabas Maidics
>Priority: Major
> Attachments: HIVE-23211.1.patch, HIVE-23211.2.patch,
> HIVE-23211.3.patch
>
>
> There are some differences (character encoding, defaults etc..) in metastore
> schema if we initialize using the init scripts, or upgrade using the upgrade
> scripts. The schema should be identical.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[
https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088025#comment-17088025
]
Hive QA commented on HIVE-23243:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000504/HIVE-23243.01.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17134 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[timestamptz_2]
(batchId=37)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21803/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21803/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21803/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000504 - PreCommit-HIVE-Build
> Accept SQL type like pattern for Show Databases
> ---
>
> Key: HIVE-23243
> URL: https://issues.apache.org/jira/browse/HIVE-23243
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Minor
> Attachments: HIVE-23243.01.patch
>
>
> Show Databases pattern accepts java like pattern with * and ., use SQL like
> instead with % and _.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23243) Accept SQL type like pattern for Show Databases
[ https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23243: -- Attachment: HIVE-23243.01.patch > Accept SQL type like pattern for Show Databases > --- > > Key: HIVE-23243 > URL: https://issues.apache.org/jira/browse/HIVE-23243 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Minor > Attachments: HIVE-23243.01.patch > > > Show Databases pattern accepts java like pattern with * and ., use SQL like > instead with % and _. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23243) Accept SQL type like pattern for Show Databases
[ https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Gergely updated HIVE-23243: -- Attachment: (was: HIVE-23243.01.patch) > Accept SQL type like pattern for Show Databases > --- > > Key: HIVE-23243 > URL: https://issues.apache.org/jira/browse/HIVE-23243 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Minor > Attachments: HIVE-23243.01.patch > > > Show Databases pattern accepts java like pattern with * and ., use SQL like > instead with % and _. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[
https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088005#comment-17088005
]
Hive QA commented on HIVE-23243:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 9m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
53s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
41s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
16s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 25m 43s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21803/dev-support/hive-personality.sh
|
| git revision | master / 5de00c7 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.1 |
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21803/yetus/patch-asflicense-problems.txt
|
| modules | C: ql U: ql |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21803/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Accept SQL type like pattern for Show Databases
> ---
>
> Key: HIVE-23243
> URL: https://issues.apache.org/jira/browse/HIVE-23243
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Minor
> Attachments: HIVE-23243.01.patch
>
>
> Show Databases pattern accepts java like pattern with * and ., use SQL like
> instead with % and _.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-23215) Make FilterContext and MutableFilterContext interfaces
[ https://issues.apache.org/jira/browse/HIVE-23215?focusedWorklogId=425404=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-425404 ] ASF GitHub Bot logged work on HIVE-23215: - Author: ASF GitHub Bot Created on: 20/Apr/20 18:09 Start Date: 20/Apr/20 18:09 Worklog Time Spent: 10m Work Description: omalley commented on issue #983: URL: https://github.com/apache/hive/pull/983#issuecomment-616722525 This seems to work well when I was working with the filters for ORC-577. A couple of comments: * It feels a little worrisome letting the user pass in a selection array and they never know the right length without calling getSelectionSize first. * We probably don't need the separate setSelectedInUser and setSelectedSize. All of the filters would just call setFilterContext to set both in a single call. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 425404) Time Spent: 1h 20m (was: 1h 10m) > Make FilterContext and MutableFilterContext interfaces > -- > > Key: HIVE-23215 > URL: https://issues.apache.org/jira/browse/HIVE-23215 > Project: Hive > Issue Type: Bug > Components: storage-api >Reporter: Owen O'Malley >Assignee: Owen O'Malley >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23215.patch > > Time Spent: 1h 20m > Remaining Estimate: 0h > > HIVE-22959 introduced FilterContext to support ORC-577. The duplication of > fields between the FilterContext and VectorizedRowBatch seems likely to cause > user confusion. This patch makes them interfaces that VectorizedRowBatch > implements. > Thus, there is a single copy of the data and no need to copy them back and > forth. LLAP can make its own implementation of the interfaces if it doesn't > want to use VectorizedRowBatch. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23088) Using Strings from log4j breaks non-log4j users
[
https://issues.apache.org/jira/browse/HIVE-23088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087986#comment-17087986
]
Hive QA commented on HIVE-23088:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000502/HIVE-23088.01.branch-3.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 186 failed/errored test(s), 14421 tests
executed
*Failed tests:*
{noformat}
TestAddPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestAddPartitionsFromPartSpec - did not produce a TEST-*.xml file (likely timed
out) (batchId=230)
TestAdminUser - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestAggregateStatsCache - did not produce a TEST-*.xml file (likely timed out)
(batchId=232)
TestAlterPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestAlterTableMetadata - did not produce a TEST-*.xml file (likely timed out)
(batchId=254)
TestAppendPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestAutoPurgeTables - did not produce a TEST-*.xml file (likely timed out)
(batchId=254)
TestBeeLineDriver - did not produce a TEST-*.xml file (likely timed out)
(batchId=276)
TestCachedStore - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestCatalogCaching - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestCatalogNonDefaultClient - did not produce a TEST-*.xml file (likely timed
out) (batchId=228)
TestCatalogNonDefaultSvr - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestCatalogOldClient - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestCatalogs - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestChainFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=232)
TestCheckConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestCloseableThreadLocal - did not produce a TEST-*.xml file (likely timed out)
(batchId=335)
TestCustomQueryFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=232)
TestDataSourceProviderFactory - did not produce a TEST-*.xml file (likely timed
out) (batchId=239)
TestDatabases - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestDeadline - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestDefaultConstraint - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestDropPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=276)
TestEmbeddedHiveMetaStore - did not produce a TEST-*.xml file (likely timed
out) (batchId=231)
TestExchangePartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestFMSketchSerialization - did not produce a TEST-*.xml file (likely timed
out) (batchId=240)
TestFilterHooks - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestForeignKey - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestFunctions - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestGetPartitions - did not produce a TEST-*.xml file (likely timed out)
(batchId=230)
TestGetPartitionsUsingProjectionAndFilterSpecs - did not produce a TEST-*.xml
file (likely timed out) (batchId=232)
TestGetTableMeta - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestGroupFilter - did not produce a TEST-*.xml file (likely timed out)
(batchId=232)
TestHLLNoBias - did not produce a TEST-*.xml file (likely timed out)
(batchId=239)
TestHLLSerialization - did not produce a TEST-*.xml file (likely timed out)
(batchId=239)
TestHdfsUtils - did not produce a TEST-*.xml file (likely timed out)
(batchId=237)
TestHiveAlterHandler - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestHiveMetaStoreGetMetaConf - did not produce a TEST-*.xml file (likely timed
out) (batchId=239)
TestHiveMetaStorePartitionSpecs - did not produce a TEST-*.xml file (likely
timed out) (batchId=230)
TestHiveMetaStoreSchemaMethods - did not produce a TEST-*.xml file (likely
timed out) (batchId=237)
TestHiveMetaStoreTimeout - did not produce a TEST-*.xml file (likely timed out)
(batchId=239)
TestHiveMetaStoreTxns - did not produce a TEST-*.xml file (likely timed out)
(batchId=239)
TestHiveMetaStoreWithEnvironmentContext - did not produce a TEST-*.xml file
(likely timed out) (batchId=234)
TestHiveMetaToolCommandLine - did not produce a TEST-*.xml file (likely timed
out) (batchId=232)
TestHiveMetastoreCli - did not produce a TEST-*.xml file (likely timed out)
(batchId=228)
TestHmsServerAuthorization - did not produce a TEST-*.xml file (likely timed
out) (batchId=237)
TestHyperLogLog - did not produce a
[jira] [Updated] (HIVE-23230) "get_splits" udf ignores limit constraint while creating splits
[
https://issues.apache.org/jira/browse/HIVE-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adesh Kumar Rao updated HIVE-23230:
---
Description:
Issue: Running the query {noformat}select * from limit n{noformat} from
spark via hive warehouse connector may return more rows than "n".
This happens because "get_splits" udf creates splits ignoring the limit
constraint. These splits when submitted to multiple llap daemons will return
"n" rows each.
How to reproduce: Needs spark-shell, hive-warehouse-connector and hive on llap
with more that 1 llap daemons running.
run below commands via beeline to create and populate the table
{noformat}
create table test (id int);
insert into table test values (1);
insert into table test values (2);
insert into table test values (3);
insert into table test values (4);
insert into table test values (5);
insert into table test values (6);
insert into table test values (7);
delete from test where id = 7;{noformat}
now running below query via spark-shell
{noformat}
import com.hortonworks.hwc.HiveWarehouseSession
val hive = HiveWarehouseSession.session(spark).build()
hive.executeQuery("select * from test limit 1").show()
{noformat}
will return more than 1 rows.
was:
The issue is reproducible when number of llap daemons is greater than 1.
How to reproduce:
run below commands via beeline to create and populate the table
{noformat}
create table test (id int);
insert into table test values (1);
insert into table test values (2);
insert into table test values (3);
insert into table test values (4);
insert into table test values (5);
insert into table test values (6);
insert into table test values (7);
delete from test where id = 7;{noformat}
now running below query via spark-shell
{noformat}
import com.hortonworks.hwc.HiveWarehouseSession
val hive = HiveWarehouseSession.session(spark).build()
hive.executeQuery("select * from test limit 1").show(){noformat}
will return more than 1 rows.
> "get_splits" udf ignores limit constraint while creating splits
> ---
>
> Key: HIVE-23230
> URL: https://issues.apache.org/jira/browse/HIVE-23230
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.0
>Reporter: Adesh Kumar Rao
>Assignee: Adesh Kumar Rao
>Priority: Major
> Attachments: HIVE-23230.1.patch, HIVE-23230.patch
>
>
> Issue: Running the query {noformat}select * from limit n{noformat}
> from spark via hive warehouse connector may return more rows than "n".
> This happens because "get_splits" udf creates splits ignoring the limit
> constraint. These splits when submitted to multiple llap daemons will return
> "n" rows each.
> How to reproduce: Needs spark-shell, hive-warehouse-connector and hive on
> llap with more that 1 llap daemons running.
> run below commands via beeline to create and populate the table
>
> {noformat}
> create table test (id int);
> insert into table test values (1);
> insert into table test values (2);
> insert into table test values (3);
> insert into table test values (4);
> insert into table test values (5);
> insert into table test values (6);
> insert into table test values (7);
> delete from test where id = 7;{noformat}
> now running below query via spark-shell
> {noformat}
> import com.hortonworks.hwc.HiveWarehouseSession
> val hive = HiveWarehouseSession.session(spark).build()
> hive.executeQuery("select * from test limit 1").show()
> {noformat}
> will return more than 1 rows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23230) "get_splits" udf ignores limit constraint while creating splits
[
https://issues.apache.org/jira/browse/HIVE-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adesh Kumar Rao updated HIVE-23230:
---
Summary: "get_splits" udf ignores limit constraint while creating splits
(was: HiveWarehouseConnector executeQuery api with query having "LIMIT" clause
returns more rows)
> "get_splits" udf ignores limit constraint while creating splits
> ---
>
> Key: HIVE-23230
> URL: https://issues.apache.org/jira/browse/HIVE-23230
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.0
>Reporter: Adesh Kumar Rao
>Assignee: Adesh Kumar Rao
>Priority: Major
> Attachments: HIVE-23230.1.patch, HIVE-23230.patch
>
>
> The issue is reproducible when number of llap daemons is greater than 1.
>
> How to reproduce:
> run below commands via beeline to create and populate the table
>
> {noformat}
> create table test (id int);
> insert into table test values (1);
> insert into table test values (2);
> insert into table test values (3);
> insert into table test values (4);
> insert into table test values (5);
> insert into table test values (6);
> insert into table test values (7);
> delete from test where id = 7;{noformat}
> now running below query via spark-shell
> {noformat}
> import com.hortonworks.hwc.HiveWarehouseSession
> val hive = HiveWarehouseSession.session(spark).build()
> hive.executeQuery("select * from test limit 1").show(){noformat}
> will return more than 1 rows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23230) HiveWarehouseConnector executeQuery api with query having "LIMIT" clause returns more rows
[
https://issues.apache.org/jira/browse/HIVE-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adesh Kumar Rao updated HIVE-23230:
---
Status: In Progress (was: Patch Available)
> HiveWarehouseConnector executeQuery api with query having "LIMIT" clause
> returns more rows
> --
>
> Key: HIVE-23230
> URL: https://issues.apache.org/jira/browse/HIVE-23230
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.0
>Reporter: Adesh Kumar Rao
>Assignee: Adesh Kumar Rao
>Priority: Major
> Attachments: HIVE-23230.1.patch, HIVE-23230.patch
>
>
> The issue is reproducible when number of llap daemons is greater than 1.
>
> How to reproduce:
> run below commands via beeline to create and populate the table
>
> {noformat}
> create table test (id int);
> insert into table test values (1);
> insert into table test values (2);
> insert into table test values (3);
> insert into table test values (4);
> insert into table test values (5);
> insert into table test values (6);
> insert into table test values (7);
> delete from test where id = 7;{noformat}
> now running below query via spark-shell
> {noformat}
> import com.hortonworks.hwc.HiveWarehouseSession
> val hive = HiveWarehouseSession.session(spark).build()
> hive.executeQuery("select * from test limit 1").show(){noformat}
> will return more than 1 rows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23230) HiveWarehouseConnector executeQuery api with query having "LIMIT" clause returns more rows
[
https://issues.apache.org/jira/browse/HIVE-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adesh Kumar Rao updated HIVE-23230:
---
Status: Patch Available (was: In Progress)
> HiveWarehouseConnector executeQuery api with query having "LIMIT" clause
> returns more rows
> --
>
> Key: HIVE-23230
> URL: https://issues.apache.org/jira/browse/HIVE-23230
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.0
>Reporter: Adesh Kumar Rao
>Assignee: Adesh Kumar Rao
>Priority: Major
> Attachments: HIVE-23230.1.patch, HIVE-23230.patch
>
>
> The issue is reproducible when number of llap daemons is greater than 1.
>
> How to reproduce:
> run below commands via beeline to create and populate the table
>
> {noformat}
> create table test (id int);
> insert into table test values (1);
> insert into table test values (2);
> insert into table test values (3);
> insert into table test values (4);
> insert into table test values (5);
> insert into table test values (6);
> insert into table test values (7);
> delete from test where id = 7;{noformat}
> now running below query via spark-shell
> {noformat}
> import com.hortonworks.hwc.HiveWarehouseSession
> val hive = HiveWarehouseSession.session(spark).build()
> hive.executeQuery("select * from test limit 1").show(){noformat}
> will return more than 1 rows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23230) HiveWarehouseConnector executeQuery api with query having "LIMIT" clause returns more rows
[
https://issues.apache.org/jira/browse/HIVE-23230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adesh Kumar Rao updated HIVE-23230:
---
Attachment: HIVE-23230.1.patch
> HiveWarehouseConnector executeQuery api with query having "LIMIT" clause
> returns more rows
> --
>
> Key: HIVE-23230
> URL: https://issues.apache.org/jira/browse/HIVE-23230
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.0
>Reporter: Adesh Kumar Rao
>Assignee: Adesh Kumar Rao
>Priority: Major
> Attachments: HIVE-23230.1.patch, HIVE-23230.patch
>
>
> The issue is reproducible when number of llap daemons is greater than 1.
>
> How to reproduce:
> run below commands via beeline to create and populate the table
>
> {noformat}
> create table test (id int);
> insert into table test values (1);
> insert into table test values (2);
> insert into table test values (3);
> insert into table test values (4);
> insert into table test values (5);
> insert into table test values (6);
> insert into table test values (7);
> delete from test where id = 7;{noformat}
> now running below query via spark-shell
> {noformat}
> import com.hortonworks.hwc.HiveWarehouseSession
> val hive = HiveWarehouseSession.session(spark).build()
> hive.executeQuery("select * from test limit 1").show(){noformat}
> will return more than 1 rows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (HIVE-23040) Checkpointing for repl dump incremental phase
[
https://issues.apache.org/jira/browse/HIVE-23040?focusedWorklogId=425396=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-425396
]
ASF GitHub Bot logged work on HIVE-23040:
-
Author: ASF GitHub Bot
Created on: 20/Apr/20 17:40
Start Date: 20/Apr/20 17:40
Worklog Time Spent: 10m
Work Description: aasha commented on a change in pull request #977:
URL: https://github.com/apache/hive/pull/977#discussion_r411567286
##
File path:
itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/TestReplicationScenariosAcidTables.java
##
@@ -663,6 +669,322 @@ public void testMultiDBTxn() throws Throwable {
}
}
+ @Test
+ public void testIncrementalDumpCheckpointing() throws Throwable {
+WarehouseInstance.Tuple bootstrapDump = primary.run("use " + primaryDbName)
+.run("CREATE TABLE t1(a string) STORED AS TEXTFILE")
+.run("CREATE TABLE t2(a string) STORED AS TEXTFILE")
+.dump(primaryDbName);
+
+replica.load(replicatedDbName, primaryDbName)
+.run("select * from " + replicatedDbName + ".t1")
+.verifyResults(new String[] {})
+.run("select * from " + replicatedDbName + ".t2")
+.verifyResults(new String[] {});
+
+
+//Case 1: When the last dump finished all the events and
+//only _finished_dump file at the hiveDumpRoot was about to be written
when it failed.
+ReplDumpWork.testDeletePreviousDumpMetaPath(true);
+
+WarehouseInstance.Tuple incrementalDump1 = primary.run("use " +
primaryDbName)
+.run("insert into t1 values (1)")
+.run("insert into t2 values (2)")
+.dump(primaryDbName);
+
+Path hiveDumpDir = new Path(incrementalDump1.dumpLocation,
ReplUtils.REPL_HIVE_BASE_DIR);
+Path ackFile = new Path(hiveDumpDir,
ReplAck.DUMP_ACKNOWLEDGEMENT.toString());
+Path ackLastEventID = new Path(hiveDumpDir,
ReplAck.EVENTS_DUMP.toString());
+FileSystem fs = FileSystem.get(hiveDumpDir.toUri(), primary.hiveConf);
+assertTrue(fs.exists(ackFile));
+assertTrue(fs.exists(ackLastEventID));
+
+fs.delete(ackFile, false);
+
+Map eventModTimeMap = new HashMap<>();
+long firstIncEventID = Long.parseLong(bootstrapDump.lastReplicationId) + 1;
+long lastIncEventID = Long.parseLong(incrementalDump1.lastReplicationId);
+assertTrue(lastIncEventID > (firstIncEventID + 1));
+
+for (long eventId=firstIncEventID; eventId<=lastIncEventID; eventId++) {
+ Path eventRoot = new Path(hiveDumpDir, String.valueOf(eventId));
+ if (fs.exists(eventRoot)) {
+eventModTimeMap.put(String.valueOf(eventId),
fs.getFileStatus(eventRoot).getModificationTime());
Review comment:
Please cross check this. Also add tests where 5 events are dumped for
instance. Delete 2 events and keep 3. Only last 2 events should be rewritten
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 425396)
Time Spent: 1h (was: 50m)
> Checkpointing for repl dump incremental phase
> -
>
> Key: HIVE-23040
> URL: https://issues.apache.org/jira/browse/HIVE-23040
> Project: Hive
> Issue Type: Improvement
>Reporter: Aasha Medhi
>Assignee: PRAVIN KUMAR SINHA
>Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-23040.01.patch, HIVE-23040.02.patch
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[ https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087951#comment-17087951 ] Miklos Gergely commented on HIVE-23243: --- The problem is that I can't just send a java type regexp to the HMS, as it also adds some additional processing to it. It is not likely that someone would have millions, or even thousands of databases, so I don't think that performance is critical here. > Accept SQL type like pattern for Show Databases > --- > > Key: HIVE-23243 > URL: https://issues.apache.org/jira/browse/HIVE-23243 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Minor > Attachments: HIVE-23243.01.patch > > > Show Databases pattern accepts java like pattern with * and ., use SQL like > instead with % and _. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23211) Fix metastore schema differences between init scripts, and upgrade scripts
[ https://issues.apache.org/jira/browse/HIVE-23211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087948#comment-17087948 ] László Bodor commented on HIVE-23211: - [~b.maidics]: I think this a very good improvement for metastore integration tests! how did you check the result schemas? is it possible to include a test for validating the schemas somehow? I'm afraid that without such test, schemas will diverge over time anyway... > Fix metastore schema differences between init scripts, and upgrade scripts > -- > > Key: HIVE-23211 > URL: https://issues.apache.org/jira/browse/HIVE-23211 > Project: Hive > Issue Type: Bug > Components: Standalone Metastore >Reporter: Barnabas Maidics >Assignee: Barnabas Maidics >Priority: Major > Attachments: HIVE-23211.1.patch, HIVE-23211.2.patch, > HIVE-23211.3.patch > > > There are some differences (character encoding, defaults etc..) in metastore > schema if we initialize using the init scripts, or upgrade using the upgrade > scripts. The schema should be identical. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[
https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087945#comment-17087945
]
David Mollitor commented on HIVE-23243:
---
{code:java}
System.out.println("" + likePatternToRegExp("defaul%"));
// Output: \Qd\E\Qe\E\Qf\E\Qa\E\Qu\E\Ql\E.*?
{code}
> Accept SQL type like pattern for Show Databases
> ---
>
> Key: HIVE-23243
> URL: https://issues.apache.org/jira/browse/HIVE-23243
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Minor
> Attachments: HIVE-23243.01.patch
>
>
> Show Databases pattern accepts java like pattern with * and ., use SQL like
> instead with % and _.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[
https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087944#comment-17087944
]
David Mollitor commented on HIVE-23243:
---
Ya, I took a look at:
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFLike.java#L64
It generates a pretty complicated {{Pattern}} and I'm not sure why, but it
generates a Regex and that is not compatible with DataNucleaus.
{quote}
Only the following regular expression patterns are required to be supported and
are portable: global “(?i)” for case-insensitive matches; and “.” and “.*” for
wild card matches. The pattern passed to matches must be a literal or parameter.
{quote}
http://www.datanucleus.org/products/accessplatform/jdo/query.html
I would rather see you change this {{UDFLike}} method to generate something
that is DN-friendly or create a new method and continue to use the
{{getDatabasesByPattern}} instead of making a new code path.
> Accept SQL type like pattern for Show Databases
> ---
>
> Key: HIVE-23243
> URL: https://issues.apache.org/jira/browse/HIVE-23243
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Minor
> Attachments: HIVE-23243.01.patch
>
>
> Show Databases pattern accepts java like pattern with * and ., use SQL like
> instead with % and _.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (HIVE-23201) Improve logging in locking
[ https://issues.apache.org/jira/browse/HIVE-23201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Bod updated HIVE-23201: -- Attachment: HIVE-23201.5.patch > Improve logging in locking > -- > > Key: HIVE-23201 > URL: https://issues.apache.org/jira/browse/HIVE-23201 > Project: Hive > Issue Type: Improvement >Reporter: Marton Bod >Assignee: Marton Bod >Priority: Major > Attachments: HIVE-23201.1.patch, HIVE-23201.1.patch, > HIVE-23201.2.patch, HIVE-23201.2.patch, HIVE-23201.3.patch, > HIVE-23201.4.patch, HIVE-23201.5.patch, HIVE-23201.5.patch > > > Currently it can be quite difficult to troubleshoot issues related to > locking. To understand why a particular txn gave up after a while on > acquiring a lock, you have to connect directly to the backend DB, since we > are not logging right now which exact locks the txn is waiting for. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23088) Using Strings from log4j breaks non-log4j users
[
https://issues.apache.org/jira/browse/HIVE-23088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087925#comment-17087925
]
Hive QA commented on HIVE-23088:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 13s{color}
| {color:red}
/data/hiveptest/logs/PreCommit-HIVE-Build-21802/patches/PreCommit-HIVE-Build-21802.patch
does not apply to master. Rebase required? Wrong Branch? See
http://cwiki.apache.org/confluence/display/Hive/HowToContribute for help.
{color} |
\\
\\
|| Subsystem || Report/Notes ||
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21802/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Using Strings from log4j breaks non-log4j users
> ---
>
> Key: HIVE-23088
> URL: https://issues.apache.org/jira/browse/HIVE-23088
> Project: Hive
> Issue Type: Bug
>Affects Versions: 3.1.2
>Reporter: Vova Vysotskyi
>Assignee: David Lavati
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0, 3.2.0, 3.1.3
>
> Attachments: HIVE-23088.01.branch-3.patch,
> HIVE-23088.01.branch-3.patch, HIVE-23088.01.patch, HIVE-23088.01.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {{HookUtils}} uses explicitly {{org.apache.logging.log4j.util.Strings}} class
> from log4j, but it may break clients who use other loggers and should exclude
> log4j from the classpath.
> {{commons-lang}} has class {{StringUtils}} which may be used as a replacement
> for this one:
> {{Strings.isBlank}} -> {{StringUtils.isBlank}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23201) Improve logging in locking
[
https://issues.apache.org/jira/browse/HIVE-23201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087919#comment-17087919
]
Hive QA commented on HIVE-23201:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000498/HIVE-23201.5.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17134 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.TestTxnCommandsWithSplitUpdateAndVectorization.testParallelInsertAnalyzeStats
(batchId=275)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21801/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21801/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21801/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000498 - PreCommit-HIVE-Build
> Improve logging in locking
> --
>
> Key: HIVE-23201
> URL: https://issues.apache.org/jira/browse/HIVE-23201
> Project: Hive
> Issue Type: Improvement
>Reporter: Marton Bod
>Assignee: Marton Bod
>Priority: Major
> Attachments: HIVE-23201.1.patch, HIVE-23201.1.patch,
> HIVE-23201.2.patch, HIVE-23201.2.patch, HIVE-23201.3.patch,
> HIVE-23201.4.patch, HIVE-23201.5.patch
>
>
> Currently it can be quite difficult to troubleshoot issues related to
> locking. To understand why a particular txn gave up after a while on
> acquiring a lock, you have to connect directly to the backend DB, since we
> are not logging right now which exact locks the txn is waiting for.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[ https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087907#comment-17087907 ] Miklos Gergely commented on HIVE-23243: --- [~belugabehr] tried that during the development, didin't work. It seems that actually it is not the same thing. > Accept SQL type like pattern for Show Databases > --- > > Key: HIVE-23243 > URL: https://issues.apache.org/jira/browse/HIVE-23243 > Project: Hive > Issue Type: Bug > Components: Hive >Reporter: Miklos Gergely >Assignee: Miklos Gergely >Priority: Minor > Attachments: HIVE-23243.01.patch > > > Show Databases pattern accepts java like pattern with * and ., use SQL like > instead with % and _. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-23201) Improve logging in locking
[
https://issues.apache.org/jira/browse/HIVE-23201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087905#comment-17087905
]
Hive QA commented on HIVE-23201:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 2m
10s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
46s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
7s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m
22s{color} | {color:blue} standalone-metastore/metastore-server in master has
191 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 3m
51s{color} | {color:blue} ql in master has 1530 extant Findbugs warnings.
{color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
24s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
31s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
36s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
23s{color} | {color:red} standalone-metastore/metastore-server: The patch
generated 11 new + 511 unchanged - 14 fixed = 522 total (was 525) {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 0m
44s{color} | {color:red} ql: The patch generated 1 new + 15 unchanged - 0 fixed
= 16 total (was 15) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
25s{color} | {color:green} standalone-metastore/metastore-server generated 0
new + 190 unchanged - 1 fixed = 190 total (was 191) {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 4m
9s{color} | {color:green} ql in the patch passed. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
19s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
15s{color} | {color:red} The patch generated 2 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 33m 33s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian
3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/data/hiveptest/working/yetus_PreCommit-HIVE-Build-21801/dev-support/hive-personality.sh
|
| git revision | master / 5de00c7 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21801/yetus/diff-checkstyle-standalone-metastore_metastore-server.txt
|
| checkstyle |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21801/yetus/diff-checkstyle-ql.txt
|
| asflicense |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21801/yetus/patch-asflicense-problems.txt
|
| modules | C: standalone-metastore/metastore-server ql U: . |
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-21801/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Improve logging in locking
> --
>
> Key: HIVE-23201
> URL: https://issues.apache.org/jira/browse/HIVE-23201
> Project: Hive
> Issue Type: Improvement
>Reporter: Marton Bod
>Assignee: Marton Bod
>Priority: Major
> Attachments:
[jira] [Updated] (HIVE-23250) Scheduled query related qtests may not finish before it's expected
[ https://issues.apache.org/jira/browse/HIVE-23250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-23250: Attachment: HIVE-23250.02.patch > Scheduled query related qtests may not finish before it's expected > -- > > Key: HIVE-23250 > URL: https://issues.apache.org/jira/browse/HIVE-23250 > Project: Hive > Issue Type: Sub-task > Components: Test >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-23250.01.patch, HIVE-23250.02.patch > > > schq_ingest fails intermittently...showing that the query is still executing -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-23220) PostExecOrcFileDump listing order may depend on the underlying filesystem
[ https://issues.apache.org/jira/browse/HIVE-23220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-23220: Attachment: HIVE-23220.02.patch > PostExecOrcFileDump listing order may depend on the underlying filesystem > - > > Key: HIVE-23220 > URL: https://issues.apache.org/jira/browse/HIVE-23220 > Project: Hive > Issue Type: Sub-task > Components: Testing Infrastructure >Reporter: Zoltan Haindrich >Assignee: Zoltan Haindrich >Priority: Major > Attachments: HIVE-23220.01.patch, HIVE-23220.02.patch > > > in case there are multiple files; the order might not be stable - and may > cause unstable q.outs > https://github.com/apache/hive/blob/83f917c787d60543f171b23d28ceda44d69c235d/ql/src/java/org/apache/hadoop/hive/ql/hooks/PostExecOrcFileDump.java#L104 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HIVE-21737) Upgrade Avro to version 1.9.2
[ https://issues.apache.org/jira/browse/HIVE-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087891#comment-17087891 ] Zoltan Haindrich commented on HIVE-21737: - it was 3 -4years ago... * I wanted to build the artifact and push it under "org.apache.hive" - people sad: don't do that; it's spark in there... * then I went asking the spark community: https://issues.apache.org/jira/browse/HIVE-14735?focusedCommentId=15932639=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-15932639 ...the best solution seemed to wait for the "proper" way of using spark...but that is still in the wind... > Upgrade Avro to version 1.9.2 > - > > Key: HIVE-21737 > URL: https://issues.apache.org/jira/browse/HIVE-21737 > Project: Hive > Issue Type: Improvement > Components: Hive >Reporter: Ismaël Mejía >Assignee: Fokko Driesprong >Priority: Major > Labels: pull-request-available > Attachments: 0001-HIVE-21737-Bump-Apache-Avro-to-1.9.2.patch > > Time Spent: 1h > Remaining Estimate: 0h > > Avro 1.9.2 was released recently. It brings a lot of fixes including a leaner > version of Avro without Jackson in the public API. Worth the update. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-20890) ACID: Allow whole table ReadLocks to skip all partition locks
[
https://issues.apache.org/jira/browse/HIVE-20890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Denys Kuzmenko updated HIVE-20890:
--
Description:
HIVE-19369 proposes adding a EXCL_WRITE lock which does not wait for any
SHARED_READ locks for read operations - in the presence of that lock, the
insert overwrite no longer takes an exclusive lock.
The only exclusive operation will be a schema change or drop table, which
should take an exclusive lock on the entire table directly.
{code}
explain locks select * from tpcds_bin_partitioned_orc_1000.store_sales where
ss_sold_date_sk=2452626
++
| Explain |
++
| LOCK INFORMATION: |
| tpcds_bin_partitioned_orc_1000.store_sales -> SHARED_READ |
| tpcds_bin_partitioned_orc_1000.store_sales.ss_sold_date_sk=2452626 ->
SHARED_READ |
++
{code}
So the per-partition SHARED_READ locks are no longer necessary, if the lock
builder already includes the table-wide SHARED_READ locks.
The removal of entire partitions is the only part which needs to be taken care
of within this semantics as row-removal instead of directory removal (i.e "drop
partition" -> "truncate partition" and have the truncation trigger a whole
directory cleaner, so that the partition disappears when there are 0 rows left).
was:
HIVE-19369 proposes adding a EXCL_WRITE lock which does not wait for any
SHARED_READ locks for insert operations - in the presence of that lock, the
insert overwrite no longer takes an exclusive lock.
The only exclusive operation will be a schema change or drop table, which
should take an exclusive lock on the entire table directly.
{code}
explain locks select * from tpcds_bin_partitioned_orc_1000.store_sales where
ss_sold_date_sk=2452626
++
| Explain |
++
| LOCK INFORMATION: |
| tpcds_bin_partitioned_orc_1000.store_sales -> SHARED_READ |
| tpcds_bin_partitioned_orc_1000.store_sales.ss_sold_date_sk=2452626 ->
SHARED_READ |
++
{code}
So the per-partition SHARED_READ locks are no longer necessary, if the lock
builder already includes the table-wide SHARED_READ locks.
The removal of entire partitions is the only part which needs to be taken care
of within this semantics as row-removal instead of directory removal (i.e "drop
partition" -> "truncate partition" and have the truncation trigger a whole
directory cleaner, so that the partition disappears when there are 0 rows left).
> ACID: Allow whole table ReadLocks to skip all partition locks
> -
>
> Key: HIVE-20890
> URL: https://issues.apache.org/jira/browse/HIVE-20890
> Project: Hive
> Issue Type: Improvement
> Components: Transactions
>Reporter: Gopal Vijayaraghavan
>Assignee: Zoltan Chovan
>Priority: Major
>
> HIVE-19369 proposes adding a EXCL_WRITE lock which does not wait for any
> SHARED_READ locks for read operations - in the presence of that lock, the
> insert overwrite no longer takes an exclusive lock.
> The only exclusive operation will be a schema change or drop table, which
> should take an exclusive lock on the entire table directly.
> {code}
> explain locks select * from tpcds_bin_partitioned_orc_1000.store_sales where
> ss_sold_date_sk=2452626
> ++
> | Explain |
> ++
> | LOCK INFORMATION: |
> | tpcds_bin_partitioned_orc_1000.store_sales -> SHARED_READ |
> | tpcds_bin_partitioned_orc_1000.store_sales.ss_sold_date_sk=2452626 ->
> SHARED_READ |
> ++
> {code}
> So the per-partition SHARED_READ locks are no longer necessary, if the lock
> builder already includes the table-wide SHARED_READ locks.
> The removal of entire partitions is the only part which needs to be taken
> care of within this semantics as row-removal instead of directory removal
> (i.e "drop partition" -> "truncate partition" and have the truncation trigger
> a whole directory cleaner, so that the partition disappears when there are 0
> rows left).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HIVE-21242) Calcite Planner Logging Indicates UTF-16 Encoding
[
https://issues.apache.org/jira/browse/HIVE-21242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor resolved HIVE-21242.
---
Resolution: Not A Problem
> Calcite Planner Logging Indicates UTF-16 Encoding
> -
>
> Key: HIVE-21242
> URL: https://issues.apache.org/jira/browse/HIVE-21242
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Affects Versions: 4.0.0, 3.2.0
>Reporter: David Mollitor
>Priority: Major
>
> I noticed some debug logging from calcite and it is using UTF-16. I would
> expect UTF-8.
> {code}
> 2019-02-10T19:08:06,393 DEBUG [7db4d3c5-0f88-49db-88fa-ad6428c23784 main]
> parse.CalcitePlanner: Plan after decorrelation:
> HiveSortLimit(offset=[0], fetch=[2])
> HiveProject(_o__c0=[array(3, 2, 1)], _o__c1=[map(1, 2001-01-01, 2, null)],
> _o__c2=[named_struct(_UTF-16LE'c1', 123456, _UTF-16LE'c2', _UTF-16LE'hello',
> _UTF-16LE'c3', array(_UTF-16LE'aa', _UTF-16LE'bb', _UTF-16LE'cc'),
> _UTF-16LE'c4', map(_UTF-16LE'abc', 123, _UTF-16LE'xyz', 456), _UTF-16LE'c5',
> named_struct(_UTF-16LE'c5_1', _UTF-16LE'bye', _UTF-16LE'c5_2', 88))])
> HiveTableScan(table=[[default, src]], table:alias=[src])
> {code}
> I'm not sure if this is a calcite internal thing which can be configured or
> if this only an artifact of the way the logging works.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23250) Scheduled query related qtests may not finish before it's expected
[
https://issues.apache.org/jira/browse/HIVE-23250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087860#comment-17087860
]
Hive QA commented on HIVE-23250:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/13000488/HIVE-23250.01.patch
{color:green}SUCCESS:{color} +1 due to 3 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 17134 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.schq.TestScheduledQueryStatements.testExecuteImmediate
(batchId=296)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/21800/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21800/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21800/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 13000488 - PreCommit-HIVE-Build
> Scheduled query related qtests may not finish before it's expected
> --
>
> Key: HIVE-23250
> URL: https://issues.apache.org/jira/browse/HIVE-23250
> Project: Hive
> Issue Type: Sub-task
> Components: Test
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Attachments: HIVE-23250.01.patch
>
>
> schq_ingest fails intermittently...showing that the query is still executing
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23243) Accept SQL type like pattern for Show Databases
[
https://issues.apache.org/jira/browse/HIVE-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087852#comment-17087852
]
David Mollitor commented on HIVE-23243:
---
[~mgergely] OK, I looked into this.
The ORM library that HMS uses is DataNucleus and for this kind of use, it:
bq. follows the rules of java.lang.String.matches
So it actually accepts a Java Regex string. I think your code should call
{{.toString()}} on the {{Pattern}} being created and pass that to
{{getDatabasesByPattern}}
> Accept SQL type like pattern for Show Databases
> ---
>
> Key: HIVE-23243
> URL: https://issues.apache.org/jira/browse/HIVE-23243
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Miklos Gergely
>Assignee: Miklos Gergely
>Priority: Minor
> Attachments: HIVE-23243.01.patch
>
>
> Show Databases pattern accepts java like pattern with * and ., use SQL like
> instead with % and _.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HIVE-23215) Make FilterContext and MutableFilterContext interfaces
[ https://issues.apache.org/jira/browse/HIVE-23215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087822#comment-17087822 ] Panagiotis Garefalakis commented on HIVE-23215: --- Just submitted the patch to trigger precommit build. +1 from my side pending tests. > Make FilterContext and MutableFilterContext interfaces > -- > > Key: HIVE-23215 > URL: https://issues.apache.org/jira/browse/HIVE-23215 > Project: Hive > Issue Type: Bug > Components: storage-api >Reporter: Owen O'Malley >Assignee: Owen O'Malley >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23215.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > > HIVE-22959 introduced FilterContext to support ORC-577. The duplication of > fields between the FilterContext and VectorizedRowBatch seems likely to cause > user confusion. This patch makes them interfaces that VectorizedRowBatch > implements. > Thus, there is a single copy of the data and no need to copy them back and > forth. LLAP can make its own implementation of the interfaces if it doesn't > want to use VectorizedRowBatch. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work stopped] (HIVE-23215) Make FilterContext and MutableFilterContext interfaces
[ https://issues.apache.org/jira/browse/HIVE-23215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-23215 stopped by Panagiotis Garefalakis. - > Make FilterContext and MutableFilterContext interfaces > -- > > Key: HIVE-23215 > URL: https://issues.apache.org/jira/browse/HIVE-23215 > Project: Hive > Issue Type: Bug > Components: storage-api >Reporter: Owen O'Malley >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23215.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > > HIVE-22959 introduced FilterContext to support ORC-577. The duplication of > fields between the FilterContext and VectorizedRowBatch seems likely to cause > user confusion. This patch makes them interfaces that VectorizedRowBatch > implements. > Thus, there is a single copy of the data and no need to copy them back and > forth. LLAP can make its own implementation of the interfaces if it doesn't > want to use VectorizedRowBatch. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HIVE-23215) Make FilterContext and MutableFilterContext interfaces
[ https://issues.apache.org/jira/browse/HIVE-23215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-23215 started by Panagiotis Garefalakis. - > Make FilterContext and MutableFilterContext interfaces > -- > > Key: HIVE-23215 > URL: https://issues.apache.org/jira/browse/HIVE-23215 > Project: Hive > Issue Type: Bug > Components: storage-api >Reporter: Owen O'Malley >Assignee: Panagiotis Garefalakis >Priority: Major > Labels: pull-request-available > Attachments: HIVE-23215.patch > > Time Spent: 1h 10m > Remaining Estimate: 0h > > HIVE-22959 introduced FilterContext to support ORC-577. The duplication of > fields between the FilterContext and VectorizedRowBatch seems likely to cause > user confusion. This patch makes them interfaces that VectorizedRowBatch > implements. > Thus, there is a single copy of the data and no need to copy them back and > forth. LLAP can make its own implementation of the interfaces if it doesn't > want to use VectorizedRowBatch. -- This message was sent by Atlassian Jira (v8.3.4#803005)
