Re: Hadoop/Hive observations

2010-09-14 Thread Ning Zhang
Hi Paul, You are right in the sense that Hive and Hadoop are not optimized for response time and emphasize more on scalability (on large data set and clusters). It's also true that Hive currently lacks good micro benchmarks that test the performance of each operations. However, you can get

Windows JDBC Connection to Hive

2010-09-14 Thread Michael Styles
I am new to Hive. I am trying to connect to Hive from a Windows JDBC client. The Hive server is running on a Linux machine. I'm getting the following error: Caused by: java.sql.SQLException: Invalid URL: jdbc:hive//myserver:1/default at

Re: Windows JDBC Connection to Hive

2010-09-14 Thread Ariel Leiva
Hi Michael, could you give more details about this exception? What happen if you do a telnet myserver 1 Ariel On Tue, Sep 14, 2010 at 10:47 AM, Michael Styles michael.sty...@ca.ibm.comwrote: I am new to Hive. I am trying to connect to Hive from a Windows JDBC client. The Hive server is

Re: Hadoop/Hive observations

2010-09-14 Thread Daniel Einspanjer
Paul, Like Ning, I doubt that Hive will be very suitable for the low latency response times you are looking for here. HBase might work for you depending on what types of data access you need. For instance, the count query won't work well directly. Rather, you'd have to have application

Re: Windows JDBC Connection to Hive

2010-09-14 Thread Michael Styles
telnet myserver 1 does not work. I get the following error: Could not open connection to the host, on port 1: Connect failed The following works: ssh myserver Michael Styles Senior Software Developer Business Analytics Tel: (613) 356-6483, T/L 315-6483 Email:

Re: Windows JDBC Connection to Hive

2010-09-14 Thread Michael Styles
I just realized I was missing a ':' in the URL specification - everything is fine now. Michael Styles Senior Software Developer Business Analytics Tel: (613) 356-6483, T/L 315-6483 Email: michael.sty...@ca.ibm.com From: Michael Styles/Ottawa/i...@ibmca To:

Is deserialize(Writable field) able to handle any writable class

2010-09-14 Thread Rodriguez, John
I have a custom Writable called DigestWritable. The DigestWritable is stored in a SequenceFile. For illustration, assume it is like this: public class DigestWritable implements org.apache.hadoop.io.Writable { String str; int I; } I started to write a SerDe in order to read the

Hive can't run query with a TextInputFormat exception

2010-09-14 Thread Tianqiang Li
Hi, hive-users, I am a new Hive users, install hive recently, when I type any query-related command in Hive cli, it throws the exception, but create table are ok: $ hive Hive history file=/tmp/pli/hive_job_log_pli_201009141519_1503313446.txt hive create table test5(a int); OK Time taken: 2.551

Re: Hive can't run query with a TextInputFormat exception

2010-09-14 Thread Tianqiang Li
Some more context: I run Hive on a client machine which is NOT one of the hadoop cluster nodes, I suppose Hive can run well and submit job from a client machine, so I didn't change hadoop-env.sh on cluster nodes. On this client machine, hadoop java jobs and pig have been successfully submitted to

Seattle Hadoop Distributing Computing User Meeting, September 16th

2010-09-14 Thread sean jensen-grey
ROOM CHANGE TO 211 (one floor up from usual) Hello Fellow Hadoopists, We are meeting at 7:15 pm on September 16th at the University Heights Community Center 5031 University Way NE Seattle WA 98105 Room #211 note room change The meetings are informal and highly conversational. If you have

question about reading a sequencefile

2010-09-14 Thread Rodriguez, John
I have a sequence file that has custom Writables in it. For illustration, assume the value in the SequenceFile is like this: public class DigestWritable implements org.apache.hadoop.io.Writable { String str; int I; } I wrote a SerDe, expecting that the value passed into