Re: [RESULT][VOTE] Apache Hive 2.3.7 Release Candidate 0

2020-04-17 Thread Alan Gates
the signature & sha. > > - I built the project. > > - I ran a handful of unit tests. > > > > .. Owen > > > > On Tue, Apr 7, 2020 at 8:34 PM Hyukjin Kwon wrote: > > > >> Thank you so much Alan for doing this. > >>

[ANNOUNCE] Apache Hive 2.3.7 Released

2020-04-19 Thread Alan Gates
The Apache Hive team is proud to announce the release of Apache Hive version 2.3.7. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides, among others: * Tools to enable easy

Re: What's master key in hive metastore?

2020-05-04 Thread Alan Gates
It is used in storing delegation tokens, which HS2 and the megastore need to act on the user's behalf when reading files, launching jobs, etc. See DelegationTokenStore. Alan. On Mon, May 4, 2020 at 2:00 AM Xi Chen wrote: > Dear all, > > I find several APIs about master key in hive metastore an

Re: Time to Remove Hive-on-Spark

2020-06-03 Thread Alan Gates
+1. Alan. On Wed, Jun 3, 2020 at 1:40 PM Prasanth Jayachandran wrote: > +1 > > > On Jun 3, 2020, at 1:38 PM, Ashutosh Chauhan > wrote: > > > > +1 > > > > On Wed, Jun 3, 2020 at 1:23 PM David Mollitor wrote: > > > >> Hello Gang, > >> > >> I have spent some time working on upgrading Avro (far l

Re: Time to Remove Hive-on-Spark

2020-07-22 Thread Alan Gates
re users that will be left > > > high > > > > > and dry by this move. > > > > > > > > > > If the community decides to desupport and eventually remove it, I > > think > > > > we > > > > > need to have a due process. We also n

Re: [VOTE] Should we release Hive Storage API 2.7.3-rc2?

2021-08-02 Thread Alan Gates
+1. Checked the keys and the sha checksum. Did a build and ran the tests. Ran rat. I did get one failing test, but it doesn't look crucial: TestBytesColumnVector.testConcatAndPadding:109 row 0 expected:<[?]> but was:<[???]> Alan. On Thu, Jul 29, 2021 at 3:14 PM Owen O'Malley wrote: > Hello

Re: [VOTE] Should we release Hive Storage API 2.8.1 rc2?

2021-08-02 Thread Alan Gates
+1. Built it, ran rat, checked the signature and the hash. Alan. On Thu, Jul 29, 2021 at 3:13 PM Owen O'Malley wrote: > Hello all, > > I would like to propose a new storage-api release including HIVE-25400. > > Shall we release the following artifacts as Hive Storage API 2.8.1? > > tar: http:/

Re: [VOTE] Should we release Hive Storage API 2.7.3-rc2?

2021-08-02 Thread Alan Gates
ilt Hive Storage API (did not get the failure that Alan called out) > >> using the tag > >> * Ran the individual test TestBytesColumnVector successfully > >> * Built ORC using 2.7.3 successfully > >> > >> Regards, > >> Pavan > >> > >&g

Re: Mail bounces from ebuddy.com

2014-08-18 Thread Alan Gates
Anyone who is an admin on the list (I don't who the admins are) can do this by doing user-unsubscribe-USERNAME=ebuddy@hive.apache.org where USERNAME is the name of the bouncing user (see http://untroubled.org/ezmlm/ezman/ezman1.html ) Alan. Thejas Nair A

Re: Timeline for release of Hive 0.14

2014-08-21 Thread Alan Gates
+1, Eugene and I are working on getting HIVE-5317 (insert, update, delete) done and would like to get it in. Alan. Nick Dimiduk August 20, 2014 at 12:27 It'd be great to get HIVE-4765 included in 0.14. The proposed changes are a big improvement for us HBase folks.

Re: [VOTE] Apache Hive 0.14.0 Release Candidate 0

2014-11-10 Thread Alan Gates
Where can I find the public key used to sign this release? Alan. Gunther Hagleitner November 9, 2014 at 0:58 Apache Hive 0.14.0 Release Candidate 0 is available here: http://people.apache.org/~gunther/apache-hive-0.14.0-candidate-0/ Maven artifacts are available he

Re: [VOTE] Apache Hive 0.14.0 Release Candidate 0

2014-11-10 Thread Alan Gates
+1 Checked the signatures, built the code, looked for errant binary files. Alan. Gunther Hagleitner November 9, 2014 at 0:58 Apache Hive 0.14.0 Release Candidate 0 is available here: http://people.apache.org/~gunther/apache-hive-0.14.0-candidate-0/ Maven artifacts

Re: How to configure multiple instances of Hive terminal?

2014-11-17 Thread Alan Gates
When using Hive in the default mode with embedded Derby as the backing RDBMS for the metastore you cannot have more than one hive client connected to the metastore at a time. This is the error you're getting. You can set up a remote metastore, rather than using the embedded ones, using the in

Propose to put JIRA traffic on separate hive list

2014-11-17 Thread Alan Gates
The hive dev list generates a lot of traffic. The average for October was 192 messages per day. As a result no one sends hive dev directly to their inbox. They either unsubscribe or they build filters that ship most or all of it to a folder. Chasing people off the dev list is obviously not

Re: Propose to put JIRA traffic on separate hive list

2014-11-21 Thread Alan Gates
eftylever...@gmail.com> November 18, 2014 at 0:49 +1 Would it be possible to send commits to the dev list, as well as creates? Or maybe all changes to the Resolution or Status? -- Lefty Alan Gates <mailto:ga...@hortonworks.com> November 17, 2014 at 14:27 The hive dev list generates a l

Re: Propose to put JIRA traffic on separate hive list

2014-11-21 Thread Alan Gates
issues created. Thanks, Szehon On Fri, Nov 21, 2014 at 1:15 PM, Prasanth Jayachandran < Prasanth Jayachandran <mailto:pjayachand...@hortonworks.com> November 21, 2014 at 13:15 +1 - Prasanth Alan Gates <mailto:ga...@hortonworks.com> November 21, 2014 at 12:59 Poke, I got some scatt

Re: Propose to put JIRA traffic on separate hive list

2014-11-21 Thread Alan Gates
n On Fri, Nov 21, 2014 at 1:15 PM, Prasanth Jayachandran < Prasanth Jayachandran <mailto:pjayachand...@hortonworks.com> November 21, 2014 at 13:15 +1 - Prasanth Alan Gates <mailto:ga...@hortonworks.com> November 21, 2014 at 12:59 Poke, I got some scattered +1s but I'd l

Re: Propose to put JIRA traffic on separate hive list

2014-11-22 Thread Alan Gates
tonworks.com> wrote: +1 Thanks, Gunther. On Fri, Nov 21, 2014 at 5:41 PM, Thejas Nair wrote: +1 On Fri, Nov 21, 2014 at 5:16 PM, Alan Gates wrote: Do you mean RB creation? I wouldn't be in favor of sending all RB activity to it, since we're trying to create a low traffic list.

Re: Propose to put JIRA traffic on separate hive list

2014-11-22 Thread Alan Gates
Ok, +1, makes sense. Alan. Brock Noland <mailto:br...@cloudera.com> November 22, 2014 at 15:50 Sorry I was unclear. Today RB traffic goes to the dev list. I'd like that mail to not go to the dev list, thus reducing traffic. Alan Gates <mailto:ga...@hortonworks.com> November

Re: A possible big bug: Delta files created by hive hcatalog streaming cannot be compacted!

2014-11-25 Thread Alan Gates
Can you file a JIRA for this. We can get it fixed and included in the 0.14 branch. Alan. Jihong Liu November 25, 2014 at 10:54 hive hcatalog streaming will also create a file like bucket_n_flush_length in each delta directory. Where "n" is the bucket number. But

Re: dev-ow...@hive.apache.org.

2014-12-04 Thread Alan Gates
Define unstructured. Hive can handle data such Avro or JSON, which I would call self-structured. I believe the SerDes for these types can even set the schema for the table or partition you are reading based on the data in the file. Alan. Mohan Krishna Decem

Deprecating CLI

2014-12-08 Thread Alan Gates
Changing the subject to reflect where the conversation is going. It's possible to run beeline with HS2 embedded, so there's no need to setup HS2. We could change the CLI in Hive to call beeline in this embedded mode, thus eliminating a code path for us to test. But before we do this there's

Re: Propose to put JIRA traffic on separate hive list

2014-12-15 Thread Alan Gates
#x27;d like that mail to not go to the dev list, thus reducing traffic. Alan Gates <mailto:ga...@hortonworks.com> November 21, 2014 at 17:16 Do you mean RB creation? I wouldn't be in favor of sending all RB activity to it, since we're trying to create a low traffic list.

Can someone make Jihong Liu a contributor on JIRA

2014-12-22 Thread Alan Gates
I need to assign a JIRA to him, since he has provided the patch. HIs Jira name is Jihong Liu and his email listed on JIRA is " jhliu08 at yahoo dot com". Thanks. Alan. -- Sent with Postbox -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for t

Re: Building Hive-0.14 is failing because artifact pentaho-aggdesigner-algorithm-5.1.3-jhyde could not be resolved

2014-12-29 Thread Alan Gates
There was an issue with Hive 0.14 when it was released. We missed the fact that it still had two SNAPSHOT dependencies in the pom. If you apply the patches on HIVE-8845 (for Tez) and HIVE-8873 (for Calcite) that should address your issue. This will be fixed in Hive 0.14.1. Alan. Ravi Pra

Re: Propose to put JIRA traffic on separate hive list

2015-01-12 Thread Alan Gates
sues-subscr...@hive.apache.org). But so far it doesn't have any traffic. -- Lefty On Mon, Jan 12, 2015 at 12:30 AM, Lars Francke Alan Gates <mailto:ga...@hortonworks.com> December 15, 2014 at 14:20 Sorry, I dropped the ball on this. I seemed to get enough +1s and no major objections, so I&

Re: Hive 0.14.1 release

2015-01-19 Thread Alan Gates
I'd really like to get HIVE-8966 in there, since it breaks streaming ingest. The patch is ready to go, it's just waiting on a review, which Owen has promised to do soon. Alan. Vikram Dixit K January 19, 2015 at 18:53 Hi All, I am going to be creating the bran

Re: Created branch 1.0

2015-01-22 Thread Alan Gates
> >> > Regards >> > Vikram. >> > >> > On Tue, Jan 20, 2015 at 1:00 PM, Vaibhav Gumashta < >> > vgumas...@hortonworks.com >> > > wrote: >> > >> > > Hi Vikram, >> > > >> > > I'd like to ge

Creating a branch for hbase metastore work

2015-01-22 Thread Alan Gates
I've been working on a prototype of using HBase to store Hive's metadata. Basically I've built a new implementation of RawStore that writes to HBase rather than DataNucleus. I want to see if I can build something that has a much more straightforward schema than DN and that is much faster. I

Re: Creating a branch for hbase metastore work

2015-01-23 Thread Alan Gates
s pluggable so it works with nosql beyond hbase. Nick Dimiduk <mailto:ndimi...@gmail.com> January 22, 2015 at 22:48 +1 Brock Noland <mailto:br...@cloudera.com> January 22, 2015 at 21:58 +1 Alan Gates <mailto:ga...@hortonworks.com> January 22, 2015 at 18:19 I've been workin

Re: 0.15 release

2015-01-26 Thread Alan Gates
Brock, Given there isn't consensus on numbering yet, could you holding off making the 0.15 branch. We should come to a conclusion on whether we're doing 0.14.1/0.15 or 1.0/1.1 before assigning anymore numbers. Alan. Brock Noland January 20, 2015 at 21:25 Just a

Re: 0.15 release

2015-01-26 Thread Alan Gates
etely reasonable. In short, everything I have experienced at Apache indicates that the folks who want to release 0.15 should be free to do the work to make that happen. Brock Alan Gates <mailto:ga...@hortonworks.com> January 26, 2015 at 7:02 Brock, Given there isn't consensus on numberin

Re: [VOTE] Apache Hive 2.3.1 Release Candidate 0

2017-10-24 Thread Alan Gates
+1. Built from source with a clean repo, checked signatures, ran rat. Alan. On Tue, Oct 24, 2017 at 8:40 AM, Ashutosh Chauhan wrote: > - Built from sources. > - Ran few unit tests. > - Checked md5sum. > > Everything looks good. +1 > > Thanks Jesus for putting this release together. > Ashutosh

Question on TransactionalValidationListener

2017-10-25 Thread Alan Gates
Looking at this code in the TransactionalValidationListener, around line 186: *if *(hive_metastoreConstants.*TABLE_IS_TRANSACTIONAL*.equalsIgnoreCase(key)) { transactional = parameters.get(key); parameters.remove(key); } Why does it remove the parameter after checking? In local metastore

Proposal to create a branch for the standalone-metastore work

2017-10-30 Thread Alan Gates
​I propose that we create a branch to continue the standalone metastore work in. So far we’ve been doing it in master one patch at a time. However, the speed that we can produce patches outstrips the speed at which we can get them reviewed, fully tested, and into master. I would like to put those

Re: Hive metastore TLP

2017-11-01 Thread Alan Gates
Excellent, I am glad to hear that this could be useful for you. After discussing the proposal in the community [1] we agreed that the first step should be to break out the metastore as a separately releasable module inside Hive. You can see the progress of that work at HIVE-17159[2]. With this c

Re: Proposal to create a branch for the standalone-metastore work

2017-11-03 Thread Alan Gates
often leads to a much cleaner final git history that using multiple merges. > For the first couple rebases of your development branch, you might want to > tell people just before you do it by sending email out to dev@hive. > > Thanks, >Owen > > On Mon, Oct 30, 2017 at 3

Re: Integrating Yetus with Precommit job

2017-11-07 Thread Alan Gates
I’ve put some feedback in HIVE-17995. 17996 and 17997 look good. I’ll commit them once the tests run. I think you’ll need to do similar patches for storage-api, as it is also not connected to the hive pom anymore. Alan. On Tue, Nov 7, 2017 at 6:17 AM, Adam Szita wrote: > Thanks for all the r

Re: What happened with HMS on Hbase project?

2017-11-08 Thread Alan Gates
Several things happened: 1) By far the biggest issue was running well in the cloud. HBase can be run in the cloud, but it’s hard to do it well in a cost efficient way. While each cloud does provide a native key/value store, these don’t all have the advanced functionality that we need (coprocessor

Rebasing standalone-metastore branch

2017-11-21 Thread Alan Gates
I'm about to check in HIVE-17967. Once I do that, I will rebase the standalone-metastore branch onto master post that commit and then force push it. This way the branch will be up to date with master again. Alan.

Re: HMS dependency on fb303.FacebookService

2017-11-28 Thread Alan Gates
Removing this break our backwards compatibility. This interface provides public methods like getName. Hive may not be using them but we have no idea if others are in the wild. Given that including this has little or no cost to us AFAIK, why remove it? Alan.​ On Mon, Nov 27, 2017 at 5:21 PM, Al

Re: HMS dependency on fb303.FacebookService

2017-12-01 Thread Alan Gates
ses. For backwards > compatibility we may provide some simple implementation ourselves - does > this sound reasonable? > > Alex > >> On Tue, Nov 28, 2017 at 9:35 AM, Alan Gates wrote: >> >> Removing this break our backwards compatibility. This interface provides >> pub

Rebasing standalone-metastore branch and database install/upgrade tests

2017-12-06 Thread Alan Gates
As HIVE-17980 has been committed to master, I will be rebasing the standalone-metastore branch up to the latest in master. This will again be a force push. In this rebase I am also including a newer version of HIVE-17983, which includes integration tests that use docker images to test the databas

Dataworks Summit EU call for abstracts

2017-12-07 Thread Alan Gates
Dataworks Summit EU 2018 is in Berlin, April 16-19. The call for abstracts is open through December 15th. One of the tracks is Datawarehousing and Operational Data Store, which is a great fit for Hive talks. https://dataworkssummit.com/abstracts/ Alan.

Re: [DISCUSS] IMetaStoreClient and HMS Thrift API exception handling

2017-12-15 Thread Alan Gates
We do not want to break either the Thrift APIs or the IMetaStoreClient ones. I do not know if we have ever declared them to be public or not, but they are de facto public in that everyone uses them. Consider that these are used by Impala, Presto, Qubole, Amazon's Glue, Spark, and probably others

Re: [DISCUSS] IMetaStoreClient and HMS Thrift API exception handling

2017-12-15 Thread Alan Gates
ot break any applications. > The only concern I have is some issues if old client is used with new > servers. We need to verifiy that the old client is able to deserialize a > response with new exceptions. > > > On Fri, Dec 15, 2017 at 7:33 AM, Alan Gates wrote: > > > We

Rebasing standalone-metastore branch post HIVE-17981

2017-12-18 Thread Alan Gates
I have committed HIVE-17981 to master and will be rebasing the standalone-metastore up to the current master branch. Alan.

Re: [DISCUSS] IMetaStoreClient and HMS Thrift API exception handling

2017-12-19 Thread Alan Gates
ning, and deprecation policies. > > Is it OK for everyone? > > Thanks, > Peter > > > > On Dec 15, 2017, at 8:15 PM, Alan Gates wrote: > > > > Sorry, I didn’t make clear which suggestion I was responding to, as there > > are multiple suggestions in

Rebasing standalone-metastore branch

2018-01-16 Thread Alan Gates
I’ve committed HIVE-17982 to master. I have been rebasing standalone-metastore after each push of a patch from it to master to keep it close to master. Vihang and maybe Peter have patches against it, so this will bust your history. It will force you to rebase your branches when you fetch from Ap

Re: Rebasing standalone-metastore branch

2018-01-18 Thread Alan Gates
an 17, 2018, at 12:40 AM, Vihang Karajgaonkar > > > wrote: > > > > > > Thanks for the headsup Alan. I am okay with the rebasing > > > standalone-metastore branch. Will update my WIP patches accordingly. > > > > > > On Tue, Jan 16, 2018 at 2:01

Hive packaging and the standalone metastore

2018-01-24 Thread Alan Gates
In HIVE-17983 I have been working on packaing and start/stop scripts for the standalone metastore. One question this brings up is how Hive will be released now, with or without the metastore. I can see two options: 1) We continue to ship the metastore with Hive. Not only does this mean the meta

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alan Gates
o you think about somehow separating lib/bin directories created in > > the distro so Hive and metastore have a separate set of bin/lib dirs? > > > > - Alex > > > > On Wed, Jan 24, 2018 at 12:16 PM, Alan Gates > wrote: > > > > > In HIVE-17983 I have be

Re: Hive packaging and the standalone metastore

2018-01-26 Thread Alan Gates
7;mvn install -Pdist' builds the packages as before. So I think we’ve covered the bases there. Alan.​ > > On Fri, Jan 26, 2018 at 10:42 AM, Alan Gates wrote: > > > I’m not seeing the value of moving the jars to a different path. If > > someone just wants to run the me

Long running time for recently added tests in standalone-metastore

2018-01-29 Thread Alan Gates
With all of the added tests in standalone-metastore/…/client directory, the runtime of ‘mvn test’ in standalone-metastore went from 6 minutes to 26 on my humble laptop. We do not want to get ourselves back where the rest of Hive is; currently Hive developers don’t run the unit tests themselves bec

Yetus JDK version

2018-01-30 Thread Alan Gates
I put code in the latest patch for HIVE-17983 that executes one of the compiled classes as part of the maven build. (It does this to automatically generate the config template.) This works locally and in the ptest build. But in the Yetus tests it fails with: Exception in thread "main" java.lang

Re: Yetus JDK version

2018-02-01 Thread Alan Gates
infrastructure. Is there anything else we need to do? We clearly already have 1.8 installed on the test machines because the code compiles with 1.8, but I don’t know what the path is, etc. Alan. On Tue, Jan 30, 2018 at 4:58 PM, Alan Gates wrote: > I put code in the latest patch for HIVE-17

Dataworks Summit San Jose Call for Abstracts closes Friday Feb 9

2018-02-06 Thread Alan Gates
All, Dataworks Summit San Jose 2018 is June 17-21. The call for abstracts is open through February 9th. One of the tracks is Datawarehousing and Operational Data Store, which is a great fit for Hive talks. You can submit an abstract at https://dataworkssummit.com/san-jose-2018/ Alan.

Question on CachedStore cache update

2018-02-06 Thread Alan Gates
I’m confused by the following code in the CachedStore. This in in the CacheUpdateMasterWork thread, in the updateDatabases method (which is called by update()): *// Skip background updates if we detect change* *if *(*isDatabaseCacheDirty*.compareAndSet(*true*, *false*)) { *LOG*.debug(*"Skippi

Test scripts for various metastore databases

2018-02-12 Thread Alan Gates
With the commit of HIVE-17983 to master there are now tests for install and upgrade scripts for the metastore database for all 4 of the database types (mysql, postgres, oracle, and sql server). These are not run by default as they take a bit and require docker to be installed on the box. For inst

Rebased standalone-metastore

2018-02-12 Thread Alan Gates
With the commit of HIVE-17983 I have rebased the standalone-metastore branch. I also put HIVE-18588 onto the branch. Alan.

Re: [DISCUSS] deprecation policy

2018-02-13 Thread Alan Gates
+1 to Ed’s comments. Alan. On Tue, Feb 13, 2018 at 7:08 AM, Edward Capriolo wrote: > I do not think we should remove: > > https://issues.apache.org/jira/browse/HIVE-18692 > > One of the challenges of HQL is not having a procedure language. This > forces users into oozie/airflow/spark even to or

Re: Test scripts for various metastore databases

2018-02-13 Thread Alan Gates
could set it up so they only run if a change is made to the install or upgrade scripts. Alan. On Tue, Feb 13, 2018 at 2:43 PM, Vineet Garg wrote: > Hi Alan, > > Will these tests be run as part of pre commit testing job? > > Thanks, > Vineet G > > > On Feb 12, 2018, at

Fwd: Travel Assistance applications open. Please inform your communities

2018-02-14 Thread Alan Gates
-- Forwarded message -- From: Gavin McDonald Date: Wed, Feb 14, 2018 at 1:34 AM Subject: Travel Assistance applications open. Please inform your communities To: travel-assista...@apache.org Hello PMCs. Please could you forward on the below email to your dev and user lists. Than

Re: reverting test-breaking changes

2018-02-22 Thread Alan Gates
+1. Alan. On Thu, Feb 22, 2018 at 8:25 AM, Thejas Nair wrote: > +1 > I agree, this makes sense. The number of failures keeps increasing. > A 24 hour heads up in either case before revert would be good. > > > On Thu, Feb 22, 2018 at 2:45 AM, Peter Vary wrote: > > > I agree with Zoltan. The cont

Re: HMS API testing and direct SQL

2018-03-06 Thread Alan Gates
I would do it at the ObjectStore level. It's faster and will cover 99% of what we want to test between the two. Alan. On Tue, Mar 6, 2018 at 8:10 AM, Peter Vary wrote: > Hi Team, > > The MetaStore API tests are designed to be easily extensible by new > MetaStore configurations. Just take a loo

Possible bug in obtaining database paths

2018-03-16 Thread Alan Gates
In the Warehouse class there are a couple of methods to determine the path of a database: getDatabasePath() and getDefaultDatabasePath(). getDatabasePath() reads the location out of the database object, except in the case of the 'default' database, where it returns the warehouse root. getDefaultD

Re: Hive 3.0 release

2018-03-21 Thread Alan Gates
+1. And +1 to Vihang's comment that this will be helpful for the standalone-metastore. We should work on producing a standalone-metastore release in the same time frame so that the schema's, etc. match. I can RM that unless someone else wants to. Alan. On Wed, Mar 21, 2018 at 12:05 PM, Andrew

Re: Integration testing for clients

2018-03-22 Thread Alan Gates
Any reason we shouldn't publish our tests jar? I know it isn't clean and nice and easy to use. And we'd need to be explicit about any interfaces we're guaranteeing not to change (very few at this point I think). But the tools in MetaStoreTestUtils would be really useful for other projects. Given

Re: [VOTE] Should we release Hive Storage API 2.5.0 rc0?

2018-03-27 Thread Alan Gates
+1. Ran 'mvn install' in a clean repo, verified the signature and checksum, ran rat. Alan. On Tue, Mar 27, 2018 at 9:49 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > +1 > - verified signature, licenses and checksum > - compiled from src > - ran unit tests > > Thanks > Pras

Re: [VOTE] Apache Hive 2.3.3 Release Candidate 0

2018-03-29 Thread Alan Gates
+1. Did a build in an empty repo, ran rat, checked the key signature and sha256, checked for any binary objects in the output. Alan. On Thu, Mar 29, 2018 at 12:26 AM, Daniel Dai wrote: > Apache Hive 2.3.3 Release Candidate 0 is available here: > > http://people.apache.org/~daijy/apache-hive-2.

Documenting standalone metastore

2018-04-02 Thread Alan Gates
I've started looking at what will be required to document the new standalone metastore. I started by reviewing the existing admin guide for the metastore at https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin Much of this will need to change for the standalone metastore, a

Re: org.apache.hadoop.hive.ql.metadata.HiveMetaStoreClientFactory

2018-04-23 Thread Alan Gates
Your code searching skills are intact (or, at least this doesn't prove they aren't). That class doesn't exist in Hive and I assume was invented by Amazon. I assume they placed it in o.a.h.hive so they could access package specific classes etc. Apache doesn't prohibit using its name in package na

Re: Metastore thrift client to get the table location on hdfs

2018-04-26 Thread Alan Gates
The calls you want are in ThriftHiveMetastore.h. You can use these to get lists of tables and objects representing each table. One of the fields in the Table object is a StorageDescriptor, which has a field called 'location'. If you are working with partitioned tables the location information fo

Re: [VOTE] Should we release storage-api 2.6.0 rc0?

2018-04-27 Thread Alan Gates
+1 Did a build in a clean mvn repo, ran rat, looked over NOTICE and LICENSE files. On Fri, Apr 27, 2018 at 8:53 AM, Jesus Camacho Rodriguez < jcama...@apache.org> wrote: > +1 > - compiled from src > - ran unit tests > - ran rat > > -Jesús > > > > On 4/26/18, 8:30 AM, "Owen O'Malley" wrote: > >

Re: [DISCUSS] Unsustainable situation with ptests

2018-05-14 Thread Alan Gates
​I see there's support for this, but people are still pouring in commits. I proposed we have a quick vote on this to lock down the commits until we get to green. That way everyone knows we have drawn the line at a specific point. Any commits after that point would be reverted. There isn't a cate

Re: [DISCUSS] Unsustainable situation with ptests

2018-05-14 Thread Alan Gates
there be a separate voting thread? Or the voting on this thread is > sufficient for lock down? > > Thanks > Prasanth > > > On May 14, 2018, at 2:34 PM, Alan Gates wrote: > > > > ​I see there's support for this, but people are still pouring in commits. > >

Re: [VOTE] Stricter commit guidelines

2018-05-15 Thread Alan Gates
+1. Alan. On Tue, May 15, 2018 at 9:12 AM, Sergio Pena wrote: > +1 > > On Tue, May 15, 2018 at 11:05 AM, Gunther Hagleitner < > ghagleit...@hortonworks.com> wrote: > > > +1 > > > > From: Sankar Hariappan > > Sent: Tuesday, May 15, 2018 9:03 AM > > To: d

Re: build broken by glassfish dependency again

2018-05-16 Thread Alan Gates
+1. It can't be too important because I was able to get my build going without the poms by copying the directory structure and pom.lastUpdated files in from another repo. Alan. On Wed, May 16, 2018 at 5:29 PM, Sergey Shelukhin wrote: > Could not transfer artifact org.glassfish:javax.el:pom:3.0

Question on branches

2018-05-22 Thread Alan Gates
I have a series of patches that fix bugs in the recently released 3.0, e.g. HIVE-19531. I would like these to go out in Hive 3.0.1, assuming we create such a release at some point. Which branch(es) should I put the patch on in addition to master? Or to put the question another way, what branch(e

DB install and upgrade scripts in the brave new world of multiple release lines

2018-05-24 Thread Alan Gates
The change to have branches running with master as 4 and branch-3 for 3.x releases is complicating our DB install and upgrade scripts. There's a JIRA to track the changes but some discussion on that JIRA of how best to proceed, starting with the comment https://issues.apache.org/jira/browse/HIVE-1

Re: [VOTE] Apache Hive 1.0 Release Candidate 1

2015-01-29 Thread Alan Gates
+1. Downloaded it, checked out the signatures, did a build, checked there were no snapshot dependencies. Alan. Vikram Dixit K January 27, 2015 at 14:28 Apache Hive 1.0 Release Candidate 1 is available here: http://people.apache.org/~vikram/hive/apache-hive-1.0-

Re: [VOTE] Apache Hive 1.0 Release Candidate 2 [WARNING: DKIM validation failed]

2015-01-30 Thread Alan Gates
+1, again. :) Checked the keys and hash, built it with a fresh maven repo. Alan. On 1/29/15, 17:05, "Vikram Dixit K" wrote: >Apache Hive 1.0 Release Candidate 2 is available here: >http://cp.mcafee.com/d/2DRPow82gwrhojjvuLtYsrKrhKUZtZxBBwSztMQsIecEEFCQrKf >nvoppvdETsd7ab3dT63p7p_g54WNDm1yIiJen

Re: Created branch 1.0

2015-02-09 Thread Alan Gates
hink it makes more sense to release 0.15 as 0.15, and later we release 1.0 as the major release that supersedes any previous releases. That will fulfill the expectations of a major release. Thanks, Xuefu Alan Gates <mailto:ga...@hortonworks.com> January 22, 2015 at 12:12 I had one clarifyin

Re: Propose to put JIRA traffic on separate hive list

2015-02-10 Thread Alan Gates
I just got around to creating the ticket for this: https://issues.apache.org/jira/browse/INFRA-9156 Sorry to be so slow on it. Alan. Lefty Leverenz <mailto:leftylever...@gmail.com> February 9, 2015 at 22:02 Nudge, nudge. (Or is there an INFRA ticket pending?) -- Lefty Alan

Documentation in HBase metastore branch

2015-02-10 Thread Alan Gates
Lefty, Should we file one JIRA under HIVE-9452 to track all the doc issues for this? This seems to me better than using TODOC tags since I have no idea what release this will actually be released as part of. Then I can try to remember to add to this JIRA each time we make any changes that n

Re: VOTE Bylaw for having branch committers in hive

2015-02-11 Thread Alan Gates
+1 Alan. Vikram Dixit K February 9, 2015 at 14:43 Hi Folks, We seem to have quite a few projects going around and in the interest of time and the project as a whole, it seems good to have branch committers much like what is there in the Hadoop project. I am prop

Re: Fwd: Hive 0.14

2015-02-11 Thread Alan Gates
The patches on HIVE-9481 are built from trunk rather than Hive 0.14, so the easiest option is to apply them to that code base. If that isn't an option, you will have to look at the .rej files created by the patch command and figure out how to apply the change by hand. Also, Eugene has posted

Re: Hive 1.0

2015-02-12 Thread Alan Gates
No, HIVE-9481 is not yet committed to trunk. It should be released in 1.2. Alan. Srinivas Thunga February 12, 2015 at 3:28 Hi Team, In hive 1.0, hive-9481 patch is updated ? because i have installed hive 1.0 And tried selected columns to insert insert int

Re: [VOTE] Apache Hive 1.1.0 Release Candidate 1

2015-02-17 Thread Alan Gates
It looks like a jar file snuck into the source release: gates> find . -name \*.jar ./testlibs/ant-contrib-1.0b3.jar Apache policy is that binary files cannot be in releases. Alan. Brock Noland February 16, 2015 at 21:08 Apache Hive 1.1.0 Release Candidate 0 is avail

Fix version for hbase-metastore branch

2015-02-19 Thread Alan Gates
I've been marking JIRAs on this branch as fixed in 1.2, since that's the next version. But that seems wrong as I doubt this code will be in by 1.2. What's the usual practice here? It seems it would make sense to make a label for this branch and mark them as fixed with that label and then whe

Re: Fix version for hbase-metastore branch

2015-02-19 Thread Alan Gates
This is what we have been doing for cbo work. e.g. https://issues.apache.org/jira/browse/HIVE-9581 Thejas Nair <mailto:thejas.n...@gmail.com> February 19, 2015 at 11:17 I agree, using a label for fix version makes sense in this case. I believe that is what had been done for hive-on-spark and

Re: Fix version for hbase-metastore branch

2015-02-20 Thread Alan Gates
the hbase-metastore branch? Maybe TODOC-HBMETA? -- Lefty Alan Gates <mailto:alanfga...@gmail.com> February 19, 2015 at 19:12 Could someone with admin permissions on our JIRA add an hbase-metastore-branch label? I'll take care of changing all the fix versions for the few JIRA'

Re: Is it allowed to include GPLv2 software to Apache projects

2015-02-20 Thread Alan Gates
No. Alan. Alexander Pivovarov February 20, 2015 at 14:30 Hi Everyone Apache License v2.0 and GPL Compatibility page clearly says "GPLv3 software cannot be included in Apache projects" http://www.apache.org/licenses/GPL-compatibility.html What about GPLv2 softw

Re: Not getting some JIRA resolution messages

2015-02-26 Thread Alan Gates
The issues list should be getting all JIRA notifications except CREATE, you shouldn't need to watch it. You can go look at the mail archives to see if the issue is with the list or on your end. If they aren't all showing up in the list we should file an INFRA JIRA. Alan. Lefty Leverenz

Re: Adding A Table In HIVE Does Not Create A Table On Mysql Which Is The Metastore

2015-03-02 Thread Alan Gates
Your hive-site.xml referenced a metastore service at localhost:9083. Did you start it with this same hive-site.xml? Alan. Praseetha Krishnamurthy February 28, 2015 at 9:29 Hi, I have configured remote metastore(mysql) for hive. I created a t

Re: How to merge the data for hive-0.14

2015-03-04 Thread Alan Gates
When data is written to a table labeled transactional each row contains a transaction id and row id. At read time the reader merges the records on these transaction ids and rowids and chooses which version to return to the query based on the reader's transaction state. For example, you might have

Re: YourKit open source license

2015-03-30 Thread Alan Gates
See https://www.yourkit.com/customers/. Alan. Li, Rui March 30, 2015 at 0:54 Hi guys, I want to use YourKit to profile hive performance. According to the wiki hive has been granted open source license. Co

Re: ORC separate project

2015-04-01 Thread Alan Gates
Carl Steinbach April 1, 2015 at 0:01 Hi Owen, I think you're referring to the following questions I asked last week on the PMC mailing list: 1) How much if any of the code for vectorization/sargs/ACID will migrate over to the new ORC project. 2) Will Hive contr

Re: ORC separate project

2015-04-03 Thread Alan Gates
A couple of points: 1) ORC isn't going into the incubator. The proposal before the board is for it to go straight to TLP. There's no graduation to depend on. 2) As currently proposed Hive would not depend on ORC to build. Hive users who wished to used ORC would obviously need to pull in ORC

Re: Not getting some JIRA resolution messages

2015-04-08 Thread Alan Gates
I have found the best way to get infra's attention is to hop on the IRC #asfinfra and ping them about the JIRA. Alan. Lefty Leverenz April 8, 2015 at 11:23 The problem continues. I posted a few more examples on INFRA-9221

<    1   2   3   4   5   6   7   8   9   10   >