You may want to try instantiating a PigServer for each thread via
thread local storage.
http://download.oracle.com/docs/cd/E17409_01/javase/6/docs/api/java/lang/ThreadLocal.html
On Wed, Jul 21, 2010 at 7:09 AM, Wouter de Bie
wouter.de@deltaprojects.se wrote:
Hi all,
We're building an
Hi
INFRA == pig 0.6 OVER hadoop 0.20.2
Here is the scenario
A = LOAD 'file:///home/hadoop/a' using PigStorage(',') AS
(c1:int,c2:double);
DUMP A
(2,0.0060)
(3,0.0050)
(3,0.0060)
B = FOREACH A GENERATE c1*c2;
(0.012)
(0.015)
(0.018002)
WHAT does *(0.018002)
Strangest thing
public class Test1 {
public static void main(String[] args) throws Exception{
System.out.println(new Double(new Double(3) * new Double(0.006)));
}
}
Also gives output as 0.018002
Regards
Rohan
Rohan Rai wrote:
Hi
INFRA == pig 0.6 OVER hadoop
The float/double type have a representation truth hidden in them, its
time you learnt of that ;)
This should help: http://www.lahey.com/float.htm
If you need such an accuracy, consider using BigDecimal or other such libraries.
Another good article (from the Python folks) is:
I keep gettin this error when i try to compile a java program using
pig...can anyone help? Thanks
pig-0.7.0$ javac -cp pig.jar idmapreduce.java
idmapreduce.java:2: package org.apache.pig does not exist
import org.apache.pig.PigServer;
^
idmapreduce.java:12: cannot find
Thanks there Dmitriy. I will write my own then.
Renato M.
2010/7/21 Dmitriy Ryaboy dvrya...@gmail.com
that has to be a UDF, there is nothing built in for this.
On Wed, Jul 21, 2010 at 6:33 PM, Renato Marroquín Mogrovejo
renatoj.marroq...@gmail.com wrote:
Hey everybody, Does any body
Hi,
I am seeing the below two errors consistently while running my script. This
does not stop my script, but throws an error on datanode and successfully
completes the same task on a different datanode. The task could fail on any
datanode, there are no blacklisted datanodes.
Any thoughts on
Found this almost a year old discussion, on the same error code and it looks
like a JVM crash.
The discussion confirms the crash on JDK 14 and I am using JDK version 18.
http://markmail.org/message/74yv7zyuq7ucm2z6
From: mdwa...@hotmail.com
To: pig-user@hadoop.apache.org
Subject:
Hi All,
This is my first mail in the apache mailing list... please bear with me as I
am absolutely new to Hadoop and its family.
This is my question... I have some data on my hdfs in the following form.
(number:int,word:chararray, word2:chararray,somethingelse:int)
I want to get this data into
