Admin privileges on http://ci.hive.apache.org/

2023-08-15 Thread Stamatis Zampetakis
Hey all,

I was wondering who has admin privileges for http://ci.hive.apache.org/ ?

I would like to check and potentially upgrade some plugins that are
currently installed. Is it possible to get permissions to manage the
Jenkins instance?

As a side note we may want to document the current administrators and the
process to get permissions when necessary.


Best,
Stamatis


MiniHS2 and postgresql jars

2023-08-15 Thread Zsolt Miskolczi
Hey there!Do you know how it is possible to use minihs2 with embedded
metastore service but postgresql as the metastore database?

Since I'm pretty sure it broke with that change
https://github.com/apache/hive/pull/4317, handling drivers is changed:

We don't bundle postgresql drivers with the hive build.Firstly, when I copy
the postgresql driver jar into the
packaging/target/apache-hive-4.0.0-beta-1-SNAPSHOT-bin/apache-hive-4.0.0-beta-1-SNAPSHOT-bin/lib
directory, I can run the schematool as it sees the driver.
The real issue is with miniHS2Cluster: it is basically a maven test and I
have really no idea how I can pass the driver to the test. If it would be a
simple java command, I would try to pass the -cp argument but I see no
other way to add extra jar file to the test execution.I want to run minihs2
with this command: mvn test -Dtest=StartMiniHS2Cluster -DminiHS2.run=true
-DminiHS2.usePortsFromConf=true -DminiHS2.clusterType=LLAP
-DminiHS2.conf="../../data/conf/llap/hive-site.xml"
-Dpackaging.minimizeJar=false -DskipShade -Dremoteresources.skip=true
-Dmaven.javadoc.skip=true -Denforcer.skip=trueAnd get that error (it seems
the metastore client cannot find the proper driver):

java.lang.RuntimeException: Error applying authorization policy on hive
configuration: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to
instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hive.service.cli.CLIService.init(CLIService.java:122)
at org.apache.hive.service.CompositeService.init(CompositeService.java:59)
at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:243)
at org.apache.hive.jdbc.miniHS2.MiniHS2.start(MiniHS2.java:394)
at
org.apache.hive.jdbc.miniHS2.StartMiniHS2Cluster.testRunCluster(StartMiniHS2Cluster.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:377)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:138)
at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:465)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:451)
Caused by: java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to instantiate
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at
org.apache.hadoop.hive.ql.session.SessionState.setupAuth(SessionState.java:1001)
at
org.apache.hadoop.hive.ql.session.SessionState.applyAuthorizationPolicy(SessionState.java:2003)
at
org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:135)
at org.apache.hive.service.cli.CLIService.init(CLIService.java:119)
... 32 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to
instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at
org.apache.hadoop.hive.ql.session.SessionState.setAuthorizerV2Config(SessionState.java:1033)
at
org.apache.hadoop.hive.ql.session.SessionState.setupAuth(SessionState.java:993)
... 35 more
Caused by: java.lang.RuntimeException: Unable to instantiate
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at

[ANNOUNCE] Apache Hive 4.0.0-beta-1 Released

2023-08-15 Thread Stamatis Zampetakis
The Apache Hive team is proud to announce the release of Apache Hive
version 4.0.0-beta-1.

The Apache Hive (TM) data warehouse software facilitates querying and
managing large datasets residing in distributed storage. Built on top
of Apache Hadoop (TM), it provides, among others:

* Tools to enable easy data extract/transform/load (ETL)

* A mechanism to impose structure on a variety of data formats

* Access to files stored either directly in Apache HDFS (TM) or in other
  data storage systems such as Apache HBase (TM)

* Query execution via Apache Tez Frameworks.

For Hive release details and downloads, please visit:
https://hive.apache.org/downloads.html

Hive 4.0.0-beta-1 Release Notes are available here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12353351=Text=12310843

We would like to thank the many contributors who made this release
possible.

Regards,

The Apache Hive Team