Re: Hive Web UI (HWI) 404 error

2010-02-12 Thread Edward Capriolo
If you are running hadoop 20 you no longer need the ant libs, something about the way jetty was packaged in 17 18 19 required this. As for the 404. The server should come up on http://0.0.0.0:/hwi If startup failed you woulds see many ugly error messages on the console. What is you hadoop and

Re: Best way to move Hive tables+data from one Hadoop cluster to another

2010-02-12 Thread Edward Capriolo
On Thu, Feb 11, 2010 at 12:32 PM, Ryan LeCompte lecom...@gmail.com wrote: I see. Here's my problem, though. I already have a new derby metastoredb setup and configured in the NEW cluster. I don't want to blow that one away, since I have some tables that I don't want to get rid of. I

Re: Distributing additional files for reduce scripts

2010-02-12 Thread Adam O'Donnell
I see, said the blind man. Thanks! On Thu, Feb 11, 2010 at 10:30 PM, Zheng Shao zsh...@gmail.com wrote: add file myfile.txt; You can find some examples in *.q files in the distribution. Zheng On Thu, Feb 11, 2010 at 10:23 PM, Adam O'Donnell a...@immunet.com wrote: Guys: How do you go

Re: SerDe issue

2010-02-12 Thread Zheng Shao
Hi Roberto, The reason that Text is passed in is because the table is defined as TextFile format (the default). There are some examples (*.q files) of using SequenceFile format ( CREATE TABLE xxx STORED AS SEQUENCEFILE). SEQUENCEFILE will return BytesWritable by default. Please have a try.

JSON serde

2010-02-12 Thread Peter Sankauskas
Hey All, I want to use a JSON serde to read some data in Hive, and was wondering if there is an open source one available somewhere? I know AWS has one available at: s3://elasticmapreduce/samples/hive-ads/libs/jsonserde.jar but I cannot find the source or documentation for it. Kind regards,

Re: SerDe issue

2010-02-12 Thread Roberto Congiu
Thanks Zheng, Didn't think of that. that worked! R. On Fri, Feb 12, 2010 at 1:19 PM, Zheng Shao zsh...@gmail.com wrote: Hi Roberto, The reason that Text is passed in is because the table is defined as TextFile format (the default). There are some examples (*.q files) of using SequenceFile

Create table as select

2010-02-12 Thread E. Sammer
The Hive wiki states the following for the CREATE TABLE ... DDL: AS select_statement] (Note: this feature is only available on the latest trunk or versions higher than 0.4.0.) I'm testing this syntax on 0.4.0(+14 - Cloudera distro) and I'm getting errors from the query parser at the second

RE: Create table as select

2010-02-12 Thread Namit Jain
Create table as select in supported in Hive 0.4 release. It is a new feature in 0.5 -Original Message- From: E. Sammer [mailto:e...@lifeless.net] Sent: Friday, February 12, 2010 4:41 PM To: hive-user@hadoop.apache.org Subject: Create table as select The Hive wiki states the following

Re: Distributing additional files for reduce scripts

2010-02-12 Thread Adam O'Donnell
So when I use the add file command in amazon's hive distribution, it appears that the files get rewritten to have the s3:// url as part of the file name, so that: add file s3://bucket/module becomes s3_bucket_module. Is there any way to get the add command to refer to the file as its name

Re: Create table as select

2010-02-12 Thread E. Sammer
On 2/12/10 7:43 PM, Namit Jain wrote: Create table as select in supported in Hive 0.4 release. It is a new feature in 0.5 These two sentences seem contradictory. Did you mean create table as select is NOT supported in Hive 0.4 release, maybe? -Original Message- From: E. Sammer

Re: Create table as select

2010-02-12 Thread E. Sammer
On 2/12/10 7:57 PM, Ning Zhang wrote: I guess what Namit meant is CTAS is NOT supported in release 0.4, but only in 0.5 or trunk. Got it. That's what I thought. Thanks! -- Eric Sammer e...@lifeless.net http://esammer.blogspot.com