[jira] [Work logged] (HIVE-26509) Introduce dynamic leader election in HMS
[ https://issues.apache.org/jira/browse/HIVE-26509?focusedWorklogId=809928=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-809928 ] ASF GitHub Bot logged work on HIVE-26509: - Author: ASF GitHub Bot Created on: 19/Sep/22 05:03 Start Date: 19/Sep/22 05:03 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #3567: URL: https://github.com/apache/hive/pull/3567#issuecomment-1250572467 Kudos, SonarCloud Quality Gate passed! [![Quality Gate passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/passed-16px.png 'Quality Gate passed')](https://sonarcloud.io/dashboard?id=apache_hive=3567) [![Bug](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/bug-16px.png 'Bug')](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=BUG) [![C](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/C-16px.png 'C')](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=BUG) [12 Bugs](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=BUG) [![Vulnerability](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/vulnerability-16px.png 'Vulnerability')](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=VULNERABILITY) [![A](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/A-16px.png 'A')](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=VULNERABILITY) [![Security Hotspot](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/security_hotspot-16px.png 'Security Hotspot')](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3567=false=SECURITY_HOTSPOT) [![E](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/E-16px.png 'E')](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3567=false=SECURITY_HOTSPOT) [1 Security Hotspot](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3567=false=SECURITY_HOTSPOT) [![Code Smell](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/code_smell-16px.png 'Code Smell')](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=CODE_SMELL) [![A](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/A-16px.png 'A')](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=CODE_SMELL) [69 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive=3567=false=CODE_SMELL) [![No Coverage information](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/CoverageChart/NoCoverageInfo-16px.png 'No Coverage information')](https://sonarcloud.io/component_measures?id=apache_hive=3567=coverage=list) No Coverage information [![No Duplication information](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/Duplications/NoDuplicationInfo-16px.png 'No Duplication information')](https://sonarcloud.io/component_measures?id=apache_hive=3567=duplicated_lines_density=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 809928) Time Spent: 1h 10m (was: 1h) > Introduce dynamic leader election in HMS > > > Key: HIVE-26509 > URL: https://issues.apache.org/jira/browse/HIVE-26509 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Zhihua Deng >Priority: Major > Labels: pull-request-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > From HIVE-21841 we have a leader HMS selected by configuring > metastore.housekeeping.leader.hostname on startup. This approach saves us > from running duplicated HMS's housekeeping tasks cluster-wide. > In this jira, we introduce another dynamic leader election: adopt hive lock > to implement the leader election. Once a HMS owns the lock, then it becomes > the leader, carries out the housekeeping tasks, and sends heartbeats to renew > the lock before timeout. If the leader fails to reclaim the lock, then stops > the already started tasks if it has, the electing event is audited. We can > achieve a more dynamic leader when the original goes down or in the public > cloud without well configured property, and reduce the leader’s burdens by > running these tasks among different leaders. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-13353) SHOW COMPACTIONS should support filtering options
[ https://issues.apache.org/jira/browse/HIVE-13353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KIRTI RUGE reassigned HIVE-13353: - Assignee: KIRTI RUGE > SHOW COMPACTIONS should support filtering options > - > > Key: HIVE-13353 > URL: https://issues.apache.org/jira/browse/HIVE-13353 > Project: Hive > Issue Type: Improvement > Components: Transactions >Affects Versions: 1.3.0, 2.0.0 >Reporter: Eugene Koifman >Assignee: KIRTI RUGE >Priority: Major > Attachments: HIVE-13353.01.patch > > > Since we now have historical information in SHOW COMPACTIONS the output can > easily become unwieldy. (e.g. 1000 partitions with 3 lines of history each) > this is a significant usability issue > Need to add ability to filter by db/table/partition > Perhaps would also be useful to filter by status -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-26544) Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found
[ https://issues.apache.org/jira/browse/HIVE-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basapuram Kumar updated HIVE-26544: --- Attachment: HIVE-26544.1.patch > Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found > --- > > Key: HIVE-26544 > URL: https://issues.apache.org/jira/browse/HIVE-26544 > Project: Hive > Issue Type: Bug > Components: HCatalog >Affects Versions: 3.0.0 > Environment: Dev env - macOS > Apache Hive-3.0 > >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Minor > Attachments: HIVE-26544.1.patch, hive-diff-javax-jms.log > > > Hello Team, > When building hive-3.0.0 locally on macOS-M1, it failed with the below error. > {noformat} > $ mvn clean install -DskipTests > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:55 min > [INFO] Finished at: 2022-09-18T17:57:52+05:30 > [INFO] > > [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: > Could not resolve dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] -> [Help 1]{noformat} > > Short error: > {noformat} > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories > {noformat} > > From the existing pom.xml, > {noformat} > > datanucleus > datanucleus maven repository > http://www.datanucleus.org/downloads/maven2 > .. > .. > {noformat} > This URL cannot be reachable from the build(From my laptop, it is), throwing > this error in debug mode. > {noformat} > [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: > Could not resolve dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] -> [Help > 1]org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal on project hive-hcatalog-server-extensions: Could not resolve > dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] > at > org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies > (LifecycleDependencyResolver.java:269) > at > org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies > (LifecycleDependencyResolver.java:147) > at > org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved > (MojoExecutor.java:248) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:202) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:156) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:148) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:117) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:81) > at > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build > (SingleThreadedBuilder.java:56) > at org.apache.maven.lifecycle.internal.LifecycleStarter.execute > (LifecycleStarter.java:128) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) > at
[jira] [Work started] (HIVE-26544) Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found
[ https://issues.apache.org/jira/browse/HIVE-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-26544 started by Basapuram Kumar. -- > Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found > --- > > Key: HIVE-26544 > URL: https://issues.apache.org/jira/browse/HIVE-26544 > Project: Hive > Issue Type: Bug > Components: HCatalog >Affects Versions: 3.0.0 > Environment: Dev env - macOS > Apache Hive-3.0 > >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Minor > Attachments: hive-diff-javax-jms.log > > > Hello Team, > When building hive-3.0.0 locally on macOS-M1, it failed with the below error. > {noformat} > $ mvn clean install -DskipTests > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:55 min > [INFO] Finished at: 2022-09-18T17:57:52+05:30 > [INFO] > > [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: > Could not resolve dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] -> [Help 1]{noformat} > > Short error: > {noformat} > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories > {noformat} > > From the existing pom.xml, > {noformat} > > datanucleus > datanucleus maven repository > http://www.datanucleus.org/downloads/maven2 > .. > .. > {noformat} > This URL cannot be reachable from the build(From my laptop, it is), throwing > this error in debug mode. > {noformat} > [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: > Could not resolve dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] -> [Help > 1]org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal on project hive-hcatalog-server-extensions: Could not resolve > dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] > at > org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies > (LifecycleDependencyResolver.java:269) > at > org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies > (LifecycleDependencyResolver.java:147) > at > org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved > (MojoExecutor.java:248) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:202) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:156) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:148) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:117) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:81) > at > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build > (SingleThreadedBuilder.java:56) > at org.apache.maven.lifecycle.internal.LifecycleStarter.execute > (LifecycleStarter.java:128) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
[jira] [Work logged] (HIVE-26543) Improve TxnHandler logging
[ https://issues.apache.org/jira/browse/HIVE-26543?focusedWorklogId=809870=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-809870 ] ASF GitHub Bot logged work on HIVE-26543: - Author: ASF GitHub Bot Created on: 18/Sep/22 15:14 Start Date: 18/Sep/22 15:14 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #3603: URL: https://github.com/apache/hive/pull/3603#issuecomment-1250329179 Kudos, SonarCloud Quality Gate passed! [![Quality Gate passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/passed-16px.png 'Quality Gate passed')](https://sonarcloud.io/dashboard?id=apache_hive=3603) [![Bug](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/bug-16px.png 'Bug')](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=BUG) [![C](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/C-16px.png 'C')](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=BUG) [2 Bugs](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=BUG) [![Vulnerability](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/vulnerability-16px.png 'Vulnerability')](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=VULNERABILITY) [![A](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/A-16px.png 'A')](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=VULNERABILITY) [![Security Hotspot](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/security_hotspot-16px.png 'Security Hotspot')](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3603=false=SECURITY_HOTSPOT) [![A](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/A-16px.png 'A')](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3603=false=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3603=false=SECURITY_HOTSPOT) [![Code Smell](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/code_smell-16px.png 'Code Smell')](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=CODE_SMELL) [![A](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/RatingBadge/A-16px.png 'A')](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=CODE_SMELL) [31 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive=3603=false=CODE_SMELL) [![No Coverage information](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/CoverageChart/NoCoverageInfo-16px.png 'No Coverage information')](https://sonarcloud.io/component_measures?id=apache_hive=3603=coverage=list) No Coverage information [![No Duplication information](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/Duplications/NoDuplicationInfo-16px.png 'No Duplication information')](https://sonarcloud.io/component_measures?id=apache_hive=3603=duplicated_lines_density=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 809870) Time Spent: 20m (was: 10m) > Improve TxnHandler logging > -- > > Key: HIVE-26543 > URL: https://issues.apache.org/jira/browse/HIVE-26543 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > TxnHandler has some bad logging, like: > {code} > LOG.debug("Going to execute query<" + txnsQuery + ">"); > {code} > https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 > this will involve a pretty unnecessary string concatenation in production > when we're on INFO level usually, let's use string formats -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HIVE-26542) Beeline: allow navigate back to multiline queries
[ https://issues.apache.org/jira/browse/HIVE-26542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17606320#comment-17606320 ] László Bodor commented on HIVE-26542: - maybe something like this: https://github.com/jline/jline3/issues/36 > Beeline: allow navigate back to multiline queries > - > > Key: HIVE-26542 > URL: https://issues.apache.org/jira/browse/HIVE-26542 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Priority: Major > > In beeline, when you enter a multiline query and then navigate back by the up > arrow key, it iterates on the query line by line, so actually, you cannot > simply run it again. I think this is painful. Need to check if it's a jline > behavior, or something that can be enabled in beeline. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-25495) Upgrade to JLine3
[ https://issues.apache.org/jira/browse/HIVE-25495?focusedWorklogId=809869=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-809869 ] ASF GitHub Bot logged work on HIVE-25495: - Author: ASF GitHub Bot Created on: 18/Sep/22 15:07 Start Date: 18/Sep/22 15:07 Worklog Time Spent: 10m Work Description: abstractdog commented on PR #3069: URL: https://github.com/apache/hive/pull/3069#issuecomment-1250327850 I just found this one, is there a chance that we can reopen, rebase @LA-Toth? I was thinking about proper multiline support in [HIVE-26542](https://issues.apache.org/jira/browse/HIVE-26542) and I think we have a better chance with jline3 Issue Time Tracking --- Worklog Id: (was: 809869) Time Spent: 3.5h (was: 3h 20m) > Upgrade to JLine3 > - > > Key: HIVE-25495 > URL: https://issues.apache.org/jira/browse/HIVE-25495 > Project: Hive > Issue Type: Improvement >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Major > Labels: pull-request-available > Time Spent: 3.5h > Remaining Estimate: 0h > > Jline 2 has been discontinued a long while ago. Hadoop uses JLine3 so Hive > should match. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-26543) Improve TxnHandler logging
[ https://issues.apache.org/jira/browse/HIVE-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-26543: -- Labels: pull-request-available (was: ) > Improve TxnHandler logging > -- > > Key: HIVE-26543 > URL: https://issues.apache.org/jira/browse/HIVE-26543 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > TxnHandler has some bad logging, like: > {code} > LOG.debug("Going to execute query<" + txnsQuery + ">"); > {code} > https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 > this will involve a pretty unnecessary string concatenation in production > when we're on INFO level usually, let's use string formats -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-26543) Improve TxnHandler logging
[ https://issues.apache.org/jira/browse/HIVE-26543?focusedWorklogId=809868=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-809868 ] ASF GitHub Bot logged work on HIVE-26543: - Author: ASF GitHub Bot Created on: 18/Sep/22 14:23 Start Date: 18/Sep/22 14:23 Worklog Time Spent: 10m Work Description: abstractdog opened a new pull request, #3603: URL: https://github.com/apache/hive/pull/3603 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 809868) Remaining Estimate: 0h Time Spent: 10m > Improve TxnHandler logging > -- > > Key: HIVE-26543 > URL: https://issues.apache.org/jira/browse/HIVE-26543 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > TxnHandler has some bad logging, like: > {code} > LOG.debug("Going to execute query<" + txnsQuery + ">"); > {code} > https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 > this will involve a pretty unnecessary string concatenation in production > when we're on INFO level usually, let's use string formats -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-26544) Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found
[ https://issues.apache.org/jira/browse/HIVE-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basapuram Kumar updated HIVE-26544: --- Description: Hello Team, When building hive-3.0.0 locally on macOS-M1, it failed with the below error. {noformat} $ mvn clean install -DskipTests [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:55 min [INFO] Finished at: 2022-09-18T17:57:52+05:30 [INFO] [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: Could not resolve dependencies for project org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, default, disabled)] -> [Help 1]{noformat} Short error: {noformat} Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories {noformat} >From the existing pom.xml, {noformat} datanucleus datanucleus maven repository http://www.datanucleus.org/downloads/maven2 .. .. {noformat} This URL cannot be reachable from the build(From my laptop, it is), throwing this error in debug mode. {noformat} [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: Could not resolve dependencies for project org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, default, disabled)] -> [Help 1]org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project hive-hcatalog-server-extensions: Could not resolve dependencies for project org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, default, disabled)] at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:269) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147) at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:972) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293) at org.apache.maven.cli.MavenCli.main (MavenCli.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225) at
[jira] [Updated] (HIVE-26544) Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found
[ https://issues.apache.org/jira/browse/HIVE-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basapuram Kumar updated HIVE-26544: --- Description: Hello Team, When building hive-3.0.0 locally on macOS-M1, it failed with the below error. {noformat} $ mvn clean install -DskipTests [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:55 min [INFO] Finished at: 2022-09-18T17:57:52+05:30 [INFO] [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: Could not resolve dependencies for project org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, default, disabled)] -> [Help 1]{noformat} Short error: {noformat} Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories {noformat} >From the existing pom.xml, {noformat} datanucleus datanucleus maven repository http://www.datanucleus.org/downloads/maven2 .. .. {noformat} This URL cannot be reachable from the build(From my laptop, it is), throwing this error in debug mode. {noformat} [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: Could not resolve dependencies for project org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, default, disabled)] -> [Help 1]org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project hive-hcatalog-server-extensions: Could not resolve dependencies for project org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: Could not transfer artifact javax.jms:jms:jar:1.1 from/to maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, default, releases), glassfish-repository (http://maven.glassfish.org/content/groups/glassfish, default, disabled), glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, default, disabled)] at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies (LifecycleDependencyResolver.java:269) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies (LifecycleDependencyResolver.java:147) at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved (MojoExecutor.java:248) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:202) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:972) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:293) at org.apache.maven.cli.MavenCli.main (MavenCli.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225) at
[jira] [Assigned] (HIVE-26544) Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found
[ https://issues.apache.org/jira/browse/HIVE-26544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basapuram Kumar reassigned HIVE-26544: -- > Hive-3.0 build failed with artifact javax.jms:jms:jar:1.1 not found > --- > > Key: HIVE-26544 > URL: https://issues.apache.org/jira/browse/HIVE-26544 > Project: Hive > Issue Type: Bug > Components: HCatalog >Affects Versions: 3.0.0 > Environment: Dev env - macOS > Apache Hive-3.0 > >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Minor > Attachments: hive-diff-javax-jms.log > > > Hello Team, > > When building hive-3.0.0 locally on macOS-M1, it failed with the below error. > > > {noformat} > $ mvn clean install -DskipTests > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:55 min > [INFO] Finished at: 2022-09-18T17:57:52+05:30 > [INFO] > > [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: > Could not resolve dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] -> [Help 1]{noformat} > Short error: > > {noformat} > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories > {noformat} > > From the existing pom.xml, > > {noformat} > > datanucleus > datanucleus maven repository > http://www.datanucleus.org/downloads/maven2 > .. > .. > {noformat} > This URL cannot be reachable from the build, throwing this error in debug > mode. > > > {noformat} > [ERROR] Failed to execute goal on project hive-hcatalog-server-extensions: > Could not resolve dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] -> [Help > 1]org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute > goal on project hive-hcatalog-server-extensions: Could not resolve > dependencies for project > org.apache.hive.hcatalog:hive-hcatalog-server-extensions:jar:3.0.1-SNAPSHOT: > Could not transfer artifact javax.jms:jms:jar:1.1 from/to > maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for > repositories: [datanucleus (http://www.datanucleus.org/downloads/maven2, > default, releases), glassfish-repository > (http://maven.glassfish.org/content/groups/glassfish, default, disabled), > glassfish-repo-archive (http://maven.glassfish.org/content/groups/glassfish, > default, disabled)] > at > org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies > (LifecycleDependencyResolver.java:269) > at > org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies > (LifecycleDependencyResolver.java:147) > at > org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved > (MojoExecutor.java:248) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:202) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:156) > at org.apache.maven.lifecycle.internal.MojoExecutor.execute > (MojoExecutor.java:148) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:117) > at > org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > (LifecycleModuleBuilder.java:81) > at > org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build > (SingleThreadedBuilder.java:56) > at org.apache.maven.lifecycle.internal.LifecycleStarter.execute > (LifecycleStarter.java:128) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) > at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) > at
[jira] [Updated] (HIVE-26543) Improve TxnHandler logging
[ https://issues.apache.org/jira/browse/HIVE-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated HIVE-26543: Description: TxnHandler has some bad logging, like: {code} LOG.debug("Going to execute query<" + txnsQuery + ">"); {code} https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 this will involve a pretty unnecessary string concatenation in production when we're on INFO level usually, let's use string formats was: TxnHandler has some bad logging, like: {code} LOG.debug("Going to execute query<" + txnsQuery + ">"); {code} https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 this will generate a string in production when we're on INFO level, let's use string formats > Improve TxnHandler logging > -- > > Key: HIVE-26543 > URL: https://issues.apache.org/jira/browse/HIVE-26543 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > > TxnHandler has some bad logging, like: > {code} > LOG.debug("Going to execute query<" + txnsQuery + ">"); > {code} > https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 > this will involve a pretty unnecessary string concatenation in production > when we're on INFO level usually, let's use string formats -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-26543) Improve TxnHandler logging
[ https://issues.apache.org/jira/browse/HIVE-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor updated HIVE-26543: Description: TxnHandler has some bad logging, like: {code} LOG.debug("Going to execute query<" + txnsQuery + ">"); {code} https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 this will generate a string in production when we're on INFO level, let's use string formats > Improve TxnHandler logging > -- > > Key: HIVE-26543 > URL: https://issues.apache.org/jira/browse/HIVE-26543 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > > TxnHandler has some bad logging, like: > {code} > LOG.debug("Going to execute query<" + txnsQuery + ">"); > {code} > https://github.com/apache/hive/blob/8e39937bdb577bc135579d7d34b46ba2d788ca53/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L533 > this will generate a string in production when we're on INFO level, let's use > string formats -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-26543) Improve TxnHandler logging
[ https://issues.apache.org/jira/browse/HIVE-26543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bodor reassigned HIVE-26543: --- Assignee: László Bodor > Improve TxnHandler logging > -- > > Key: HIVE-26543 > URL: https://issues.apache.org/jira/browse/HIVE-26543 > Project: Hive > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)