RE: [Announce] New Hive Committer - Mohit Sabharwal

[Xu, Cheng A]

Congrats!!

-Original Message-
From: Jimmy Xiang [mailto:jxc...@gmail.com] 
Sent: Saturday, July 02, 2016 4:33 AM
To: d...@hive.apache.org
Cc: user@hive.apache.org
Subject: Re: [Announce] New Hive Committer - Mohit Sabharwal

Congrats!!

On Fri, Jul 1, 2016 at 1:04 PM, Lenni Kuff  wrote:
> Congrats Mohit!
>
> On Fri, Jul 1, 2016 at 3:27 PM, Peter Vary  wrote:
>
>> Congratulations Mohit!
>> 2016. júl. 1. 19:10 ezt írta ("Vihang Karajgaonkar" > >):
>>
>> > Congratulations Mohit!
>> >
>> > > On Jul 1, 2016, at 10:05 AM, Chao Sun  wrote:
>> > >
>> > > Congratulations Mohit! Good job!
>> > >
>> > > Best,
>> > > Chao
>> > >
>> > > On Fri, Jul 1, 2016 at 9:57 AM, Szehon Ho > > > wrote:
>> > > On behalf of the Apache Hive PMC, I'm pleased to announce that Mohit
>> > Sabharwal has been voted a committer on the Apache Hive project.
>> > >
>> > > Please join me in congratulating Mohit !
>> > >
>> > > Thanks,
>> > > Szehon
>> > >
>> >
>> >
>>

RE: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Xu, Cheng A]

Congratulations, Ashutosh!

-Original Message-
From: Mohammad Islam [mailto:misla...@yahoo.com.INVALID] 
Sent: Thursday, September 17, 2015 8:23 AM
To: user@hive.apache.org; Hive
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Asutosh! 


 On Wednesday, September 16, 2015 4:51 PM, Bright Ling 
 wrote:
   

 #yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285 
{font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7221259285 
{font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 
{panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7221259285 
{font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7221259285 
{font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;} _filtered #yiv7221259285 
{panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 {panose-1:2 1 6 0 3 1 
1 1 1 1;}#yiv7221259285 #yiv7221259285 p.yiv7221259285MsoNormal, #yiv7221259285 
li.yiv7221259285MsoNormal, #yiv7221259285 div.yiv7221259285MsoNormal 
{margin:0cm;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7221259285 a:link, 
#yiv7221259285 span.yiv7221259285MsoHyperlink 
{color:blue;text-decoration:underline;}#yiv7221259285 a:visited, #yiv7221259285 
span.yiv7221259285MsoHyperlinkFollowed 
{color:purple;text-decoration:underline;}#yiv7221259285 
p.yiv7221259285MsoAcetate, #yiv7221259285 li.yiv7221259285MsoAcetate, 
#yiv7221259285 div.yiv7221259285MsoAcetate 
{margin:0cm;margin-bottom:.0001pt;font-size:8.0pt;}#yiv7221259285 
span.yiv7221259285EmailStyle17 {color:#1F497D;}#yiv7221259285 
span.yiv7221259285BalloonTextChar {}#yiv7221259285 .yiv7221259285MsoChpDefault 
{font-size:10.0pt;} _filtered #yiv7221259285 {margin:72.0pt 72.0pt 72.0pt 
72.0pt;}#yiv7221259285 div.yiv7221259285WordSection1 {}#yiv7221259285 
Congratulations Asutosh!       From: Sathi Chowdhury 
[mailto:sathi.chowdh...@lithium.com]
Sent: Thursday, 17 September 2015 8:04 AM
To: user@hive.apache.org
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats 
Asutosh!    From:Sergey Shelukhin
Reply-To: "user@hive.apache.org"
Date: Wednesday, September 16, 2015 at 2:31 PM
To: "user@hive.apache.org"
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats!    
From:Alpesh Patel 
Reply-To: "user@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 13:24
To: "user@hive.apache.org" 
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    
Congratulations Ashutosh    On Wed, Sep 16, 2015 at 1:23 PM, Pengcheng Xiong 
 wrote: Congratulations Ashutosh!    On Wed, Sep 16, 2015 at 
1:17 PM, John Pullokkaran  wrote: Congrats 
Ashutosh!    From:Vaibhav Gumashta 
Reply-To: "user@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 1:01 PM
To: "user@hive.apache.org" , "d...@hive.apache.org" 

Cc: Ashutosh Chauhan 
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats 
Ashutosh!     —Vaibhav    From:Prasanth Jayachandran 

Reply-To: "user@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "d...@hive.apache.org" , "user@hive.apache.org" 

Cc: "d...@hive.apache.org" , Ashutosh Chauhan 

Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    
Congratulations Ashutosh!     

 On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  
wrote: Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as 
> the new VP of the Apache Hive project. Ashutosh has been a longtime 
> contributor to Hive and has played a pivotal role in many of the major 
> advances that have been made over the past couple of years. Please 
> join me in congratulating Ashutosh on his new role!
>       

  

RE: Request write access to the Hive wiki

[Xu, Cheng A]

Thanks Xuefu.

From: Xuefu Zhang [mailto:xzh...@cloudera.com]
Sent: Tuesday, August 11, 2015 3:38 AM
To: user@hive.apache.org
Subject: Re: Request write access to the Hive wiki

Done!

On Mon, Aug 10, 2015 at 1:05 AM, Xu, Cheng A 
cheng.a...@intel.commailto:cheng.a...@intel.com wrote:
Hi,
I’d like to have write access to the Hive wiki. My Confluence username is 
cheng.a...@intel.commailto:cheng.a...@intel.com with Full Name “Ferdinand 
Xu”. Please help me deal with it. Thank you!

Regards,
Ferdinand Xu

RE: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

[Xu, Cheng A]

Please send mail to 
user-unsubscr...@hive.apache.orgmailto:user-unsubscr...@hive.apache.org.

From: Teja Kunapareddy [mailto:tejakunapare...@gmail.com]
Sent: Thursday, April 16, 2015 8:37 AM
To: user@hive.apache.org
Subject: RE: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

unsubscribe

From: Vaibhav Gumashta [mailto:vgumas...@hortonworks.com]
Sent: Wednesday, April 15, 2015 5:08 PM
To: user@hive.apache.orgmailto:user@hive.apache.org; venkatanathen kannan; 
d...@hive.apache.orgmailto:d...@hive.apache.org; Chris Drome
Cc: mit...@apache.orgmailto:mit...@apache.org
Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun.

-Vaibhav

From: venkatanathen kannan 
venkatanat...@yahoo.commailto:venkatanat...@yahoo.com
Reply-To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org, venkatanathen kannan 
venkatanat...@yahoo.commailto:venkatanat...@yahoo.com
Date: Wednesday, April 15, 2015 at 11:40 AM
To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org, 
d...@hive.apache.orgmailto:d...@hive.apache.org 
d...@hive.apache.orgmailto:d...@hive.apache.org, Chris Drome 
cdr...@yahoo-inc.commailto:cdr...@yahoo-inc.com
Cc: mit...@apache.orgmailto:mit...@apache.org 
mit...@apache.orgmailto:mit...@apache.org
Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun !


On Wednesday, April 15, 2015 2:18 PM, Sergey Shelukhin 
ser...@hortonworks.commailto:ser...@hortonworks.com wrote:

Congrats!

From: Xu, Cheng A cheng.a...@intel.commailto:cheng.a...@intel.com
Reply-To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org
Date: Tuesday, April 14, 2015 at 18:03
To: user@hive.apache.orgmailto:user@hive.apache.org 
user@hive.apache.orgmailto:user@hive.apache.org, 
d...@hive.apache.orgmailto:d...@hive.apache.org 
d...@hive.apache.orgmailto:d...@hive.apache.org, Chris Drome 
cdr...@yahoo-inc.commailto:cdr...@yahoo-inc.com
Cc: mit...@apache.orgmailto:mit...@apache.org 
mit...@apache.orgmailto:mit...@apache.org
Subject: RE: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun!

From: Gunther Hagleitner [mailto:ghagleit...@hortonworks.com]
Sent: Wednesday, April 15, 2015 8:10 AM
To: d...@hive.apache.orgmailto:d...@hive.apache.org; Chris Drome; 
user@hive.apache.orgmailto:user@hive.apache.org
Cc: mit...@apache.orgmailto:mit...@apache.org
Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun!

Thanks,
Gunther.

From: Chao Sun c...@cloudera.commailto:c...@cloudera.com
Sent: Tuesday, April 14, 2015 3:48 PM
To: d...@hive.apache.orgmailto:d...@hive.apache.org; Chris Drome
Cc: user@hive.apache.orgmailto:user@hive.apache.org; 
mit...@apache.orgmailto:mit...@apache.org
Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun!

On Tue, Apr 14, 2015 at 3:29 PM, Chris Drome 
cdr...@yahoo-inc.com.invalidmailto:cdr...@yahoo-inc.com.invalid wrote:
Congratulations Mithun!



 On Tuesday, April 14, 2015 2:57 PM, Carl Steinbach 
c...@apache.orgmailto:c...@apache.org wrote:


 The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on the 
Apache Hive Project.
Please join me in congratulating Mithun.
Thanks.
- Carl






--
Best,
Chao

RE: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

[Xu, Cheng A]

Congrats Mithun!

From: Gunther Hagleitner [mailto:ghagleit...@hortonworks.com]
Sent: Wednesday, April 15, 2015 8:10 AM
To: d...@hive.apache.org; Chris Drome; user@hive.apache.org
Cc: mit...@apache.org
Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan


Congrats Mithun!



Thanks,

Gunther.


From: Chao Sun c...@cloudera.commailto:c...@cloudera.com
Sent: Tuesday, April 14, 2015 3:48 PM
To: d...@hive.apache.orgmailto:d...@hive.apache.org; Chris Drome
Cc: user@hive.apache.orgmailto:user@hive.apache.org; 
mit...@apache.orgmailto:mit...@apache.org
Subject: Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun!

On Tue, Apr 14, 2015 at 3:29 PM, Chris Drome 
cdr...@yahoo-inc.com.invalidmailto:cdr...@yahoo-inc.com.invalid wrote:
Congratulations Mithun!



 On Tuesday, April 14, 2015 2:57 PM, Carl Steinbach 
c...@apache.orgmailto:c...@apache.org wrote:


 The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on the 
Apache Hive Project.
Please join me in congratulating Mithun.
Thanks.
- Carl






--
Best,
Chao

RE: [Hive] Slow Loading Data Process with Parquet over 30k Partitions

[Xu, Cheng A]

Hi Tianqi,
Can you attach hive.log as more detailed information?
+Sergio

Yours,
Ferdinand Xu

From: Tianqi Tong [mailto:tt...@brightedge.com]
Sent: Friday, April 10, 2015 1:34 AM
To: user@hive.apache.org
Subject: [Hive] Slow Loading Data Process with Parquet over 30k Partitions

Hello Hive,
I'm a developer using Hive to process TB level data, and I'm having some 
difficulty loading the data to table.
I have 2 tables now:

-- table_1:
CREATE EXTERNAL TABLE `table_1`(
  `keyword` string,
  `domain` string,
  `url` string
  )
PARTITIONED BY (yearmonth INT, partition1 STRING)
STORED AS RCfile

-- table_2:
CREATE EXTERNAL TABLE `table_2`(
  `keyword` string,
  `domain` string,
  `url` string
  )
PARTITIONED BY (yearmonth INT, partition2 STRING)
STORED AS Parquet

I'm doing an INSERT OVERWRITE to table_2 from SELECT FROM table_1 with dynamic 
partitioning, and the number of partitions grows dramatically from 1500 to 40k 
(because I want to use something else as partitioning).
The mapreduce job was fine.
Somehow the process stucked at  Loading data to table default.table_2 
(yearmonth=null, domain_prefix=null) , and I've been waiting for hours.

Is this expected when we have 40k partitions?

--
Refs - Here are the parameters that I used:
export HADOOP_HEAPSIZE=16384
set PARQUET_FILE_SIZE=268435456;
set parquet.block.size=268435456;
set dfs.blocksize=268435456;
set parquet.compression=SNAPPY;
SET hive.exec.dynamic.partition.mode=nonstrict;
SET hive.exec.max.dynamic.partitions=50;
SET hive.exec.max.dynamic.partitions.pernode=5;
SET hive.exec.max.created.files=100;


Thank you very much!
Tianqi Tong

RE: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and Sergio Pena

[Xu, Cheng A]

Congratulations!!!

From: @Sanjiv Singh [mailto:sanjiv.is...@gmail.com]
Sent: Tuesday, March 24, 2015 12:45 PM
To: user@hive.apache.org
Cc: d...@hive.apache.org; mmccl...@hortonworks.com; jxi...@apache.org; 
sergio.p...@cloudera.com
Subject: Re: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and 
Sergio Pena

Congratulations !!!

Regards
Sanjiv Singh
Mob :  +091 9990-447-339

On Mon, Mar 23, 2015 at 11:38 PM, Carl Steinbach 
c...@apache.orgmailto:c...@apache.org wrote:
The Apache Hive PMC has voted to make Jimmy Xiang, Matt McCline, and Sergio 
Pena committers on the Apache Hive Project.

Please join me in congratulating Jimmy, Matt, and Sergio.

Thanks.

- Carl

RE: hive cli problem

[Xu, Cheng A]

Hi,
Can you use linux command *locate* to find jline jar file? It should be added 
into the class path of HIVE. Another way is by running “export 
HADOOP_USER_CLASSPATH_FIRST=true” instead of removing it.

Yours,
Ferdinand Xu

From: Srinivas Thunga [mailto:srinivas.thu...@gmail.com]
Sent: Tuesday, March 10, 2015 1:51 PM
To: user@hive.apache.org
Subject: Re: hive cli problem

Hi,

I am also getting the same problem in Hive 1.1.0

As said by you, jline jar is not there in Hadoop.

How to find where this jar located and will be removed.

Mine is

Inside hadoop i am having folders like

client, client-0.20 and cloudera, lib

Thanks  Regards,

Srinivas T

On Mon, Mar 9, 2015 at 11:47 PM, Prasanth Jayachandran 
pjayachand...@hortonworks.commailto:pjayachand...@hortonworks.com wrote:
Hi Garry

Try removing jline-0.9.94.jar from hadoop. The exact path is this 
$HADOOP_PREFIX/share/hadoop/yarn/lib/jline-0.9.94.jar

See here for discussion 
https://issues.apache.org/jira/browse/HIVE-8609?focusedCommentId=14215543page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14215543

Thanks
Prasanth

On Mar 9, 2015, at 11:02 AM, Garry Chen 
g...@cornell.edumailto:g...@cornell.edu wrote:

Hi All,
New to hive and run into problem when try to lunch hive cli as 
follow.  Please help.
hadoop hive

Logging initialized using configuration in 
jar:file:/u01/app/hive-1.1.0/lib/hive-common-1.1.0.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in 
[jar:file:/u01/app/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in 
[jar:file:/u01/app/hive-1.1.0/lib/hive-jdbc-1.1.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[ERROR] Terminal initialization failed; falling back to unsupported
java.lang.IncompatibleClassChangeError: Found class jline.Terminal, but 
interface was expected
at jline.TerminalFactory.create(TerminalFactory.java:101)
at jline.TerminalFactory.get(TerminalFactory.java:158)
at jline.console.ConsoleReader.init(ConsoleReader.java:229)
at jline.console.ConsoleReader.init(ConsoleReader.java:221)
at jline.console.ConsoleReader.init(ConsoleReader.java:209)
at 
org.apache.hadoop.hive.cli.CliDriver.getConsoleReader(CliDriver.java:773)
at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:715)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Exception in thread main java.lang.IncompatibleClassChangeError: Found class 
jline.Terminal, but interface was expected
at jline.console.ConsoleReader.init(ConsoleReader.java:230)
at jline.console.ConsoleReader.init(ConsoleReader.java:221)
at jline.console.ConsoleReader.init(ConsoleReader.java:209)
at 
org.apache.hadoop.hive.cli.CliDriver.getConsoleReader(CliDriver.java:773)
at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:715)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:615)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

RE: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui Li

[Xu, Cheng A]

Congrats!

-Original Message-
From: Li, Rui [mailto:rui...@intel.com] 
Sent: Wednesday, February 11, 2015 10:26 AM
To: user@hive.apache.org; d...@hive.apache.org
Subject: RE: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui 
Li

Thanks guys. It's a great honor!

Cheers,
Rui Li


-Original Message-
From: Vaibhav Gumashta [mailto:vgumas...@hortonworks.com] 
Sent: Tuesday, February 10, 2015 6:12 AM
To: user@hive.apache.org; d...@hive.apache.org
Subject: Re: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui 
Li

Congratulations to all.

Vaibhav

On 2/9/15, 2:06 PM, Prasanth Jayachandran
pjayachand...@hortonworks.com wrote:

Congratulations!

 On Feb 9, 2015, at 1:57 PM, Na Yang ny...@maprtech.com wrote:
 
 Congratulations!
 
 On Mon, Feb 9, 2015 at 1:06 PM, Vikram Dixit K vikram.di...@gmail.com
 wrote:
 
 Congrats guys!
 
 On Mon, Feb 9, 2015 at 12:42 PM, Szehon Ho sze...@cloudera.com wrote:
 
 Congratulations guys !
 
 On Mon, Feb 9, 2015 at 3:38 PM, Jimmy Xiang jxi...@cloudera.com
wrote:
 
 Congrats!!
 
 On Mon, Feb 9, 2015 at 12:36 PM, Alexander Pivovarov 
 apivova...@gmail.com
 
 wrote:
 
 Congrats!
 
 On Mon, Feb 9, 2015 at 12:31 PM, Carl Steinbach c...@apache.org
 wrote:
 
 The Apache Hive PMC has voted to make Chao Sun, Chengxiang Li, and
 Rui
 Li
 committers on the Apache Hive Project.
 
 Please join me in congratulating Chao, Chengxiang, and Rui!
 
 Thanks.
 
 - Carl
 
 
 
 
 
 
 
 
 --
 Nothing better than when appreciated for hard work.
 -Mark
 

RE: Encrypting data in Hive

[Xu, Cheng A]

Actually Xiaomeng is working on this jira 
https://issues.apache.org/jira/browse/HIVE-7934
And we have a plan to move this feature forwards recently.

+ xiaomeng

From: Venkat, Ankam [mailto:ankam.ven...@centurylink.com]
Sent: Thursday, November 20, 2014 5:15 AM
To: 'user@hive.apache.org'
Subject: Encrypting data in Hive

I need to encrypt few columns (like SSN, Credit Card Number etc) in Hive Table.

Is there a built-in feature available in Hive?   I see a Jira at 
https://issues.apache.org/jira/browse/HIVE-6329 which is still unresolved.

If there is no built-in feature,  are there any open source UDFs available for 
this?

Thanks in advance.

Regards,
Venkat

This communication is the property of CenturyLink and may contain confidential 
or privileged information. Unauthorized use of this communication is strictly 
prohibited and may be unlawful. If you have received this communication in 
error, please immediately notify the sender by reply e-mail and destroy all 
copies of the communication and any attachments.

RE: Possible to create ORC file with specific name in reducer?

[Xu, Cheng A]

You can refer to the unit test for TestNewInputOutputFormat

FileOutputFormat.setOutputPath(job, outputPath);

From: Robert Towne [mailto:robert.to...@webtrends.com]
Sent: Wednesday, October 29, 2014 6:35 AM
To: user@hive.apache.org
Subject: Possible to create ORC file with specific name in reducer?

I want to write to a new ORC file from a map/reduce job outside of Hive.

I'd like to setup a job without using the format like this:
job.setOutputFormatClass(OrcNewOutputFormat.class);

But instead specify:
job.setOutputFormatClass(NullOutputFormat.class);

And in the reducer, specify the filename, iterate through the results, and 
close the file at the end.



Something akin to:

@Override
public void reduce(final Text key, final IterableMyClass myClasses, final 
Context context)  {
RecordWriter orcWriter = new OrcNewOutputFormat().getRecordWriter(context);
for (MyClass myClass : myClasses) {
orcWriter = new OrcNewOutputFormat().getRecordWriter(context);
}
orcWriter.close(context);

But there is no public constructor for OrcNewOutputFormat to specify the 
filename I'd like.

Am I missing something, or does anyone know how to specify the filename?

Thank you,
Robert Towne

RE: How to run TestCliDriver Unit Test

[Xu, Cheng A]

Please refer to 
https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-HowdoIupdatetheoutputofaCliDrivertestcase?

From: Gordon Wang [mailto:gw...@pivotal.io]
Sent: Tuesday, October 28, 2014 11:41 AM
To: user
Cc: Gordon Wang
Subject: Fwd: How to run TestCliDriver Unit Test

+ hive user group. :)

-- Forwarded message --
From: Gordon Wang gw...@pivotal.iomailto:gw...@pivotal.io
Date: Tue, Oct 28, 2014 at 11:22 AM
Subject: How to run TestCliDriver Unit Test
To: d...@hive.apache.orgmailto:d...@hive.apache.org

Hi all,

I am working on a hive issue and I want to add a Unit test for hive query 
parser.

Before hive 0.13, it is built with ant. And the query parser test cases were 
ran with TestCliDriver.

In current trunk, hive is built with maven. Could you give me some guide about 
how to run TestCliDriver unit test?

I tried  mvn clean test -Phadoop-2  -Dtest=TestCliDriver, but it didn't work. 
Seems that TestCliDriver.java is not genrated yet.

Many thanks.

--
Regards
Gordon Wang



--
Regards
Gordon Wang

RE: How to run TestCliDriver Unit Test

[Xu, Cheng A]

Please refer to 
https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-HowdoIupdatetheoutputofaCliDrivertestcase?

From: Gordon Wang [mailto:gw...@pivotal.io]
Sent: Tuesday, October 28, 2014 11:41 AM
To: user
Cc: Gordon Wang
Subject: Fwd: How to run TestCliDriver Unit Test

+ hive user group. :)

-- Forwarded message --
From: Gordon Wang gw...@pivotal.iomailto:gw...@pivotal.io
Date: Tue, Oct 28, 2014 at 11:22 AM
Subject: How to run TestCliDriver Unit Test
To: d...@hive.apache.orgmailto:d...@hive.apache.org

Hi all,

I am working on a hive issue and I want to add a Unit test for hive query 
parser.

Before hive 0.13, it is built with ant. And the query parser test cases were 
ran with TestCliDriver.

In current trunk, hive is built with maven. Could you give me some guide about 
how to run TestCliDriver unit test?

I tried  mvn clean test -Phadoop-2  -Dtest=TestCliDriver, but it didn't work. 
Seems that TestCliDriver.java is not genrated yet.

Many thanks.

--
Regards
Gordon Wang



--
Regards
Gordon Wang