[Pig Wiki] Update of PipelineImpl by Shravan Narayanamurthy

2008-02-14 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Pig Wiki for change 
notification.

The following page has been changed by Shravan Narayanamurthy:
http://wiki.apache.org/pig/PipelineImpl

--
   * Implementation for the translation of Logical Plan into Physical plan
   * Implementation of the Stagification Process which converts the Physical 
Plan into multiple Map Reduce stages and submits each one as a separate job to 
the cluster
  
- The idea for the translation of Logical Plan to Physical Plan is to put a 
generic infrastructure in place without any ties to the implementation of the 
operators. Once the infrastructure is in place, we can develop the operators 
and the stagification parallely. 
+ The idea for the translation of Logical Plan to Physical Plan is to put a 
generic infrastructure in place without any ties to the implementation of the 
operators. Once the infrastructure is in place, we can develop the operators 
and the stagification in a parallel fashion.
  


[Pig Wiki] Update of PipelineImpl by Shravan Narayanamurthy

2008-02-14 Thread Apache Wiki
Dear Wiki user,

You have subscribed to a wiki page or wiki category on Pig Wiki for change 
notification.

The following page has been changed by Shravan Narayanamurthy:
http://wiki.apache.org/pig/PipelineImpl

--
  
  The idea for the translation of Logical Plan to Physical Plan is to put a 
generic infrastructure in place without any ties to the implementation of the 
operators. Once the infrastructure is in place, we can develop the operators 
and the stagification in a parallel fashion.
  
+ Timelines for each of these items need to include time for writing unit tests.
+ 


svn commit: r627897 - in /incubator/pig/trunk: ./ lib-src/shock/org/apache/pig/shock/ src/org/apache/pig/ src/org/apache/pig/backend/hadoop/executionengine/ src/org/apache/pig/backend/hadoop/execution

2008-02-14 Thread gates
Author: gates
Date: Thu Feb 14 14:24:04 2008
New Revision: 627897

URL: http://svn.apache.org/viewvc?rev=627897view=rev
Log:
PIG-84: Converted printStackTrace calls to calls to the logger.


Modified:
incubator/pig/trunk/CHANGES.txt

incubator/pig/trunk/lib-src/shock/org/apache/pig/shock/SSHSocketImplFactory.java
incubator/pig/trunk/src/org/apache/pig/Main.java
incubator/pig/trunk/src/org/apache/pig/StandAloneParser.java

incubator/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/HJob.java

incubator/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/SplitSpec.java

incubator/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapreduceExec/PigCombine.java

incubator/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapreduceExec/PigMapReduce.java

incubator/pig/trunk/src/org/apache/pig/backend/local/executionengine/POStore.java
incubator/pig/trunk/src/org/apache/pig/impl/PigContext.java
incubator/pig/trunk/src/org/apache/pig/impl/builtin/ShellBagEvalFunc.java
incubator/pig/trunk/src/org/apache/pig/impl/io/FileLocalizer.java
incubator/pig/trunk/src/org/apache/pig/impl/logicalLayer/schema/Schema.java
incubator/pig/trunk/src/org/apache/pig/impl/util/ObjectSerializer.java
incubator/pig/trunk/test/org/apache/pig/test/TestLogicalPlanBuilder.java

Modified: incubator/pig/trunk/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/incubator/pig/trunk/CHANGES.txt?rev=627897r1=627896r2=627897view=diff
==
--- incubator/pig/trunk/CHANGES.txt (original)
+++ incubator/pig/trunk/CHANGES.txt Thu Feb 14 14:24:04 2008
@@ -107,3 +107,6 @@
exception being caught, and a different exception then thrown.  All 
those
locations have been changed so that the new exception now wraps the old.
(francisoud via gates).
+
+   PIG-84: Converted printStackTrace calls to calls to the logger.
+   (francisoud via gates).

Modified: 
incubator/pig/trunk/lib-src/shock/org/apache/pig/shock/SSHSocketImplFactory.java
URL: 
http://svn.apache.org/viewvc/incubator/pig/trunk/lib-src/shock/org/apache/pig/shock/SSHSocketImplFactory.java?rev=627897r1=627896r2=627897view=diff
==
--- 
incubator/pig/trunk/lib-src/shock/org/apache/pig/shock/SSHSocketImplFactory.java
 (original)
+++ 
incubator/pig/trunk/lib-src/shock/org/apache/pig/shock/SSHSocketImplFactory.java
 Thu Feb 14 14:24:04 2008
@@ -401,7 +401,7 @@
log.error(EOF);
}
} catch (JSchException e) {
-   e.printStackTrace();
+   log.error(e);
IOException newE = new IOException(e.getMessage());
newE.setStackTrace(e.getStackTrace());
throw newE;
@@ -460,7 +460,7 @@

connectTest(www.yahoo.com);
log.error(Finished  + 
this);
} catch (Exception e) {
-   e.printStackTrace();
+   log.error(e);
}
}
}.start();
@@ -477,13 +477,13 @@

connectTest(www.flickr.com);
log.error(Finished  + 
this);
} catch (Exception e) {
-   e.printStackTrace();
+   log.error(e);
}
}
}.start();
}
} catch (Exception e) {
-   e.printStackTrace();
+   log.error(e);
}
}
 

Modified: incubator/pig/trunk/src/org/apache/pig/Main.java
URL: 
http://svn.apache.org/viewvc/incubator/pig/trunk/src/org/apache/pig/Main.java?rev=627897r1=627896r2=627897view=diff
==
--- incubator/pig/trunk/src/org/apache/pig/Main.java (original)
+++ incubator/pig/trunk/src/org/apache/pig/Main.java Thu Feb 14 14:24:04 2008
@@ -23,6 +23,8 @@
 import java.util.jar.*;
 import java.text.ParseException;
 
+import org.apache.commons.logging.Log;
+import org.apache.commons.logging.LogFactory;
 import org.apache.hadoop.util.HadoopExe;
 
 import org.apache.log4j.BasicConfigurator;
@@ -42,6 +44,7 @@
 public class Main
 {
 
+private final static Log log = LogFactory.getLog(Main.class);