Re: Hive query not working

2014-09-27 Thread Aditya exalter
Hi , I got the issue and solved it , As my metastore was configure with PostgreSQL we are unable to query with partition.But after we changed it to MySQL i a m able to query with partition. Thanks, Aditya K. On Fri, Sep 26, 2014 at 12:15 AM, Aditya exalter wrote: > HI all, > > I have a h

RE: From java application : how to access kerberosed hadoop HDFS ?

2014-09-27 Thread Liu, Yi A
You should configure "hadoop.security.authentication" to Kerberos in your core-site.xml. Please refer to http://hadoop.apache.org/docs/r2.5.1/hadoop-project-dist/hadoop-common/SecureMode.html Regards, Yi Liu -Original Message- From: Xiaohua Chen [mailto:xiaohua.c...@gmail.com] Sent:

where does the temporary task directory get created in mapred?

2014-09-27 Thread Koert Kuipers
i was looking at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter's setupTask method, but it does nothing and states: // FileOutputCommitter's setupTask doesn't do anything. Because the // temporary task directory is created on demand when the // task is writing. ok i got th

Re: No space when running a hadoop job

2014-09-27 Thread Alexander Pivovarov
It can read/write in parallel to all drives. More hdd more io speed. On Sep 27, 2014 7:28 AM, "Susheel Kumar Gadalay" wrote: > Correct me if I am wrong. > > Adding multiple directories will not balance the files distributions > across these locations. > > Hadoop will add exhaust the first direct

Re: No space when running a hadoop job

2014-09-27 Thread Susheel Kumar Gadalay
Correct me if I am wrong. Adding multiple directories will not balance the files distributions across these locations. Hadoop will add exhaust the first directory and then start using the next, next .. How can I tell Hadoop to evenly balance across these directories. On 9/26/14, Matt Narrell w