from:"Chris Drome"

Re: How is it that every hive release in maven depends on

2012-12-06 Thread Chris Drome

These jars are pulled in by datanucleus which is a dependency of hive-metastore.

The datanucleus project manages its own repositories for these jars:

http://www.datanucleus.org/downloads/maven2

chris

From: Edward Capriolo edlinuxg...@gmail.commailto:edlinuxg...@gmail.com
Reply-To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org
Date: Thursday, December 6, 2012 8:56 AM
To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org
Subject: How is it that every hive release in maven depends on

http://mvnrepository.com/artifact/org.apache.hive/hive-metastore/0.9.0

javax.jdohttp://mvnrepository.com/artifact/javax.jdo  
jdo2-apihttp://mvnrepository.com/artifact/javax.jdo/jdo2-api  2.3-ec

2.3-ec is not in maven central.

All our poms seem to reference this. What is the deal here?

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Chris Drome

Congratulations Thejas!

chris

On 8/20/13 3:31 AM, Carl Steinbach c...@apache.org wrote:

The Apache Hive PMC has voted to make Thejas Nair a committer on the
Apache
Hive project.

Please join me in congratulating Thejas!

Re: [ANNOUNCE] New Hive PMC Members - Thejas Nair and Brock Noland

2013-10-28 Thread Chris Drome

Congratulations Brock and Thejas!

On 10/24/13 3:10 PM, Carl Steinbach c...@apache.org wrote:

I am pleased to announce that Thejas Nair and Brock Noland have been
elected to the Hive Project Management Committee. Please join me in
congratulating Thejas and Brock!

Thanks.

Carl

Re: java.lang.NoSuchFieldError: SASL_PROPS

2014-07-16 Thread Chris Drome

Can you verify that you are using the latest hive JARs.
This should be 0.12.3.0.1407011540_H2.

Thanks,

chris

From: Shreyas Shetty shet...@yahoo-inc.commailto:shet...@yahoo-inc.com
Reply-To: Shreyas Shetty shet...@yahoo-inc.commailto:shet...@yahoo-inc.com
Date: Wednesday, July 16, 2014 at 4:19 PM
To: hcat-us...@yahoo-inc.commailto:hcat-us...@yahoo-inc.com 
hcat-us...@yahoo-inc.commailto:hcat-us...@yahoo-inc.com, 
hive-u...@hadoop.apache.orgmailto:hive-u...@hadoop.apache.org 
hive-u...@hadoop.apache.orgmailto:hive-u...@hadoop.apache.org
Subject: java.lang.NoSuchFieldError: SASL_PROPS

Hi,

I have a sample Hcatalog MR program. I am running into the error [1] while 
running it on my launcher.
I tried setting 
hive.metastore_uris=thrift://nitroblue-hcat.blue.ygrid.yahoo.com:8020 and 
hive.metastore_uris=thrift://nitroblue-hcat.blue.ygrid.yahoo.com:50513 but it 
did not help (This started happening after NitroBlue upgade today).

Any help is appreciated.

Thanks
Shreyas

[1] ing to a remote metastore.
14/07/16 23:15:39 INFO hive.metastore: Trying to connect to metastore with URI 
thrift://nitroblue-hcat.blue.ygrid.yahoo.com:50513
Exception in thread main com.google.common.util.concurrent.ExecutionError: 
java.lang.NoSuchFieldError: SASL_PROPS
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2232)
at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
at 
com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4764)
at 
org.apache.hcatalog.common.HiveClientCache.getOrCreate(HiveClientCache.java:168)
at org.apache.hcatalog.common.HiveClientCache.get(HiveClientCache.java:144)
at org.apache.hcatalog.common.HCatUtil.getHiveClient(HCatUtil.java:547)
at 
org.apache.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:87)
at 
org.apache.hcatalog.mapreduce.HCatOutputFormat.setOutput(HCatOutputFormat.java:67)
at com.yahoo.extruder.WccHcatTest.run(WccHcatTest.java:94)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.yahoo.extruder.WccHcatTest.main(WccHcatTest.java:118)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.lang.NoSuchFieldError: SASL_PROPS
at 
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S.getHadoopSaslProperties(HadoopThriftAuthBridge20S.java:106)
at 
org.apache.hadoop.hive.metastore.MetaStoreUtils.getMetaStoreSaslProperties(MetaStoreUtils.java:1275)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:274)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaStoreClient.java:169)
at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaStoreClient.java:109)
at 
org.apache.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient.init(HiveClientCache.java:247)
at 
org.apache.hcatalog.common.HiveClientCache$4.call(HiveClientCache.java:171)
at 
org.apache.hcatalog.common.HiveClientCache$4.call(HiveClientCache.java:168)
at 
com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4767)
at 
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
at 
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2313)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

2014-10-27 Thread Chris Drome

Congratulations Alan!

From: Carl Steinbach c...@apache.orgmailto:c...@apache.org
Reply-To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org
Date: Monday, October 27, 2014 at 3:38 PM
To: d...@hive.apache.orgmailto:d...@hive.apache.org 
d...@hive.apache.orgmailto:d...@hive.apache.org, 
user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org, 
ga...@apache.orgmailto:ga...@apache.org 
ga...@apache.orgmailto:ga...@apache.org
Subject: [ANNOUNCE] New Hive PMC Member - Alan Gates

I am pleased to announce that Alan Gates has been elected to the Hive Project 
Management Committee. Please join me in congratulating Alan!

Thanks.

- Carl

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

2015-04-14 Thread Chris Drome

Congratulations Mithun!
 


 On Tuesday, April 14, 2015 2:57 PM, Carl Steinbach c...@apache.org wrote:
   

 The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on the 
Apache Hive Project. 
Please join me in congratulating Mithun.
Thanks.
- Carl

Re: how to customize tez query app name

2017-01-20 Thread Chris Drome

Frank, I looked into this quite a while ago.According to my notes you can set 
hive.query.id before running your query to set the DAG name (which is normally 
just an auto-incrementing integer value).
At the time, there was no way to set the name of the AM process, which is what 
you are looking for.TezSessionState hard codes the name as HIVE- 
when creating the TezClient.
chris 

On Friday, January 20, 2017 12:10 PM, Frank Luo  wrote:
 

  So no one has a 
solution?    From: Frank Luo 
Sent: Thursday, January 19, 2017 6:14 PM
To: user@hive.apache.org
Cc: Shylaja H. Nagenhalli 
Subject: how to customize tez query app name    When running tez query, the 
“Applications” page shows the job as “HIVE-9c5a8bf1-911b-427a-8d16” for 
example, which is not helpful, especially when a ton of jobs running at the 
same time.    So is there any way to customize the app name?    
“mapreduce.job.name” works for M/R queries, not Tez.     Thx! This email and 
any attachments transmitted with it are intended for use by the intended 
recipient(s) only. If you have received this email in error, please notify the 
sender immediately and then delete it. If you are not the intended recipient, 
you must not keep, use, disclose, copy or distribute this email without the 
author’s prior permission. We take precautions to minimize the risk of 
transmitting software viruses, but we advise you to perform your own virus 
checks on any attachment to this message. We cannot accept liability for any 
loss or damage caused by software viruses. The information contained in this 
communication may be confidential and may be subject to the attorney-client 
privilege.

Re: tez + union stmt

2017-01-10 Thread Chris Drome

Elliot,

Mithun already created the following ticket to track the issue:
https://issues.apache.org/jira/browse/HIVE-15575
chris

On Tuesday, January 10, 2017 11:05 PM, Elliot West wrote:

Thanks Rohini,
This is good to know. Could you perhaps raise an issue in the Hive JIRA?
Thanks,
Elliot.
On Tue, 10 Jan 2017 at 22:55, Rohini Palaniswamy
wrote:

The implementation in hive does look wrong. The concept of VertexGroups was
added in Tez specifically for the case of union to support writing to same
directory from different vertices. Sub-directories should not be required as a
workaround.
Regards,Rohini

On Sun, Dec 25, 2016 at 10:58 AM, Stephen Sprague wrote:

Thanks Elliot. Nice christmas present. Those settings in that stackoverflow
link look to me to be exactly what i need to set for MR jobs to pick that data
up that Tez created.

Cheers,
Stephen.

On Sun, Dec 25, 2016 at 2:45 AM, Elliot West wrote:

I believe that tez will generate subfolders for unioned data. As far as I know,
this is the expected behaviour and there is no alternative. Presumably this is
to prevent multiple tasks from attempting to write the same file?
We've experienced issues when switching from mr to tez; downstream jobs weren't
expecting subfolders and had trouble reading previously accessible datasets.
Apparently there are workarounds within
Hive:http://stackoverflow.com/questions/39511585/hive-create-table-not-insert-data

Merry Christmas,
Elliot.
On Sun, 25 Dec 2016 at 03:11, Rajesh Balamohan wrote:

Are there any exceptions in hive.log?. Is tmp_pv_v4* table part of the select
query?
Assuming you are creating the table in staging.db, it would have created the
table location as staging.db/foo (as you have not specified the location).
Adding user@hive.apache.org as this is hive related.

~Rajesh.B
On Sun, Dec 25, 2016 at 12:08 AM, Stephen Sprague wrote:

all,

i'm running tez with the sql pattern:

* create table foo as select * from (select... UNION select... UNION
select...)

in the logs the final step is this:

* Moving data to directory
hdfs://dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4
from
hdfs://dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/.hive-staging_hive_2016-12-24_10-05-40_048_4896412314807355668-899/-ext-10002

when querying the table i got zero rows returned which made me curious. so i
queried the hdfs location and see this:

$ hdfs dfs -ls
hdfs://dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4

Found 3 items
drwxrwxrwx - dwr supergroup 0 2016-12-24 10:05
hdfs://dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/1
drwxrwxrwx - dwr supergroup 0 2016-12-24 10:06
hdfs://dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/2
drwxrwxrwx - dwr supergroup 0 2016-12-24 10:06
hdfs://dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/3

and yes the data files are under these three dirs.

so i ask... i'm not used to seeing sub-directories under the tablename unless
the table is partitioned. is this legit? might there be some config settings i
need to set to see this data via sql?

thanks,
Stephen.

Re: please help unsubscribing from mailing lists

2017-08-15 Thread Chris Drome

Thanks Alan. That did the trick.

On Tue, Aug 15, 2017 at 1:43 PM, Alan Gates <alanfga...@gmail.com> wrote:

> I think http://untroubled.org/ezmlm/manual/Unsubscribing.html#
> Unsubscribing has what you need.
>
> Alan.
>
> On Tue, Aug 15, 2017 at 1:09 PM, Chris Drome <cdr...@oath.com> wrote:
>
>> I am currently subscribed to all three Hive mailing lists (user, dev,
>> commits) using cdr...@yahoo-inc.com.
>>
>> I'm trying to unsubscribe from these lists, but am no longer able to send
>> emails from my old cdr...@yahoo-inc.com account.
>>
>> Is there anyone who can help me unsubscribe from these mailing lists?
>>
>> Much appreciated.
>>
>> chris
>>
>
>

please help unsubscribing from mailing lists