Re: [VOTE] Release Pig 0.4.0 (candidate 0)
When I run this against a Hadoop 0.18.3 instance I can do DFS operations, but MR operations fail with: Error message from job controller - java.lang.AbstractMethodError: org.apache.xerces.dom.DocumentImpl.getXmlStandalone()Z at com .sun .org .apache.xalan.internal.xsltc.trax.DOM2TO.setDocumentInfo(DOM2TO.java: 373) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 127) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 94) at com .sun .org .apache .xalan .internal .xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java:662) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:708) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313) at org.apache.hadoop.conf.Configuration.write(Configuration.java: 994) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:780) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:370) at org .apache .hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) at org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279) at java.lang.Thread.run(Thread.java:619) Pig Stack Trace --- ERROR 6015: During execution, encountered a Hadoop error. org.apache.pig.backend.executionengine.ExecException: ERROR 6015: During execution, encountered a Hadoop error. at com .sun .org .apache.xalan.internal.xsltc.trax.DOM2TO.setDocumentInfo(DOM2TO.java: 373) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 127) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 94) at com .sun .org .apache .xalan .internal .xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java:662) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:708) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313) at org.apache.hadoop.conf.Configuration.write(Configuration.java: 994) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:780) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:370) at org .apache .hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) at org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279) Caused by: java.lang.AbstractMethodError: org.apache.xerces.dom.DocumentImpl.getXmlStandalone()Z ... 11 more = = = = = = = = This doesn't look good. Alan. On Sep 14, 2009, at 2:05 PM, Olga Natkovich wrote: Hi, I created a candidate build for Pig 0.4.0 release. The highlights of this release are - Performance improvements especially in the area of JOIN support where we introduced two new join types: skew join to deal with data skew and sort merge join to take advantage of the sorted data sets. - Support for Outer join. - Works with Hadoop 18 I ran the release audit and rat report looked fine. The relevant part is attached below. Keys used to sign the release are available at http://svn.apache.org/viewvc/hadoop/pig/trunk/KEYS?view=markup. Please download the release and try it out: http://people.apache.org/~olga/pig-0.4.0-candidate-0. Should we release this? Vote closes on Thursday, 9/17. Olga [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/ CHANGES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/zebra/ CHANG ES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/broken- links.x ml [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ cookbook.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/index.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/linkmap.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ piglatin_refer ence.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ piglatin_users .html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/setup.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ tutorial.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/udf.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/api/ package-li st [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/ changes. html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/ missingS inces.txt [java] !?
RE: [VOTE] Release Pig 0.4.0 (candidate 0)
Alan, I tried the jar packaged in the release and I am able to successfully run tests. Could you give it another try? Thanks, Olga -Original Message- From: Alan Gates [mailto:ga...@yahoo-inc.com] Sent: Wednesday, September 16, 2009 9:53 AM To: pig-dev@hadoop.apache.org Cc: priv...@hadoop.apache.org Subject: Re: [VOTE] Release Pig 0.4.0 (candidate 0) When I run this against a Hadoop 0.18.3 instance I can do DFS operations, but MR operations fail with: Error message from job controller - java.lang.AbstractMethodError: org.apache.xerces.dom.DocumentImpl.getXmlStandalone()Z at com .sun .org .apache.xalan.internal.xsltc.trax.DOM2TO.setDocumentInfo(DOM2TO.java: 373) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 127) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 94) at com .sun .org .apache .xalan .internal .xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java:662) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:708) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313) at org.apache.hadoop.conf.Configuration.write(Configuration.java: 994) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:780) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:370) at org .apache .hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) at org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279) at java.lang.Thread.run(Thread.java:619) Pig Stack Trace --- ERROR 6015: During execution, encountered a Hadoop error. org.apache.pig.backend.executionengine.ExecException: ERROR 6015: During execution, encountered a Hadoop error. at com .sun .org .apache.xalan.internal.xsltc.trax.DOM2TO.setDocumentInfo(DOM2TO.java: 373) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 127) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 94) at com .sun .org .apache .xalan .internal .xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java:662) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:708) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313) at org.apache.hadoop.conf.Configuration.write(Configuration.java: 994) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:780) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:370) at org .apache .hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) at org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279) Caused by: java.lang.AbstractMethodError: org.apache.xerces.dom.DocumentImpl.getXmlStandalone()Z ... 11 more = = = = = = = = This doesn't look good. Alan. On Sep 14, 2009, at 2:05 PM, Olga Natkovich wrote: Hi, I created a candidate build for Pig 0.4.0 release. The highlights of this release are - Performance improvements especially in the area of JOIN support where we introduced two new join types: skew join to deal with data skew and sort merge join to take advantage of the sorted data sets. - Support for Outer join. - Works with Hadoop 18 I ran the release audit and rat report looked fine. The relevant part is attached below. Keys used to sign the release are available at http://svn.apache.org/viewvc/hadoop/pig/trunk/KEYS?view=markup. Please download the release and try it out: http://people.apache.org/~olga/pig-0.4.0-candidate-0. Should we release this? Vote closes on Thursday, 9/17. Olga [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/ CHANGES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/zebra/ CHANG ES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/broken- links.x ml [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ cookbook.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/index.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/linkmap.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ piglatin_refer ence.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ piglatin_users .html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/setup.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs
Re: [VOTE] Release Pig 0.4.0 (candidate 0)
When I run it as: java -cp ./pig.jar:/home/y/conf/pig/piglet/released -Dhod.server= org.apac he.pig.Main /d1/pig_harness/out/pigtest/gates/gates.1253134669/ Checkin_2.pig it works. When I run it as: JAVA_HOME=/usr PIG_CONF_DIR=/home/y/conf/pig/piglet/released/ bin/pig ~/pig/scripts/Checkin_2.pig it fails with the stack given earlier. Alan. On Sep 16, 2009, at 12:46 PM, Olga Natkovich wrote: Alan, I tried the jar packaged in the release and I am able to successfully run tests. Could you give it another try? Thanks, Olga -Original Message- From: Alan Gates [mailto:ga...@yahoo-inc.com] Sent: Wednesday, September 16, 2009 9:53 AM To: pig-dev@hadoop.apache.org Cc: priv...@hadoop.apache.org Subject: Re: [VOTE] Release Pig 0.4.0 (candidate 0) When I run this against a Hadoop 0.18.3 instance I can do DFS operations, but MR operations fail with: Error message from job controller - java.lang.AbstractMethodError: org.apache.xerces.dom.DocumentImpl.getXmlStandalone()Z at com .sun .org .apache.xalan.internal.xsltc.trax.DOM2TO.setDocumentInfo(DOM2TO.java: 373) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 127) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 94) at com .sun .org .apache .xalan .internal .xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java: 662) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java: 708) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java: 313) at org.apache.hadoop.conf.Configuration.write(Configuration.java: 994) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java: 780) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:370) at org .apache .hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java: 247) at org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java: 279) at java.lang.Thread.run(Thread.java:619) Pig Stack Trace --- ERROR 6015: During execution, encountered a Hadoop error. org.apache.pig.backend.executionengine.ExecException: ERROR 6015: During execution, encountered a Hadoop error. at com .sun .org .apache.xalan.internal.xsltc.trax.DOM2TO.setDocumentInfo(DOM2TO.java: 373) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 127) at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java: 94) at com .sun .org .apache .xalan .internal .xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java: 662) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java: 708) at com .sun .org .apache .xalan .internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java: 313) at org.apache.hadoop.conf.Configuration.write(Configuration.java: 994) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java: 780) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:370) at org .apache .hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java: 247) at org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java: 279) Caused by: java.lang.AbstractMethodError: org.apache.xerces.dom.DocumentImpl.getXmlStandalone()Z ... 11 more = = = = = = = = = = == This doesn't look good. Alan. On Sep 14, 2009, at 2:05 PM, Olga Natkovich wrote: Hi, I created a candidate build for Pig 0.4.0 release. The highlights of this release are - Performance improvements especially in the area of JOIN support where we introduced two new join types: skew join to deal with data skew and sort merge join to take advantage of the sorted data sets. - Support for Outer join. - Works with Hadoop 18 I ran the release audit and rat report looked fine. The relevant part is attached below. Keys used to sign the release are available at http://svn.apache.org/viewvc/hadoop/pig/trunk/KEYS?view=markup. Please download the release and try it out: http://people.apache.org/~olga/pig-0.4.0-candidate-0. Should we release this? Vote closes on Thursday, 9/17. Olga [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/ CHANGES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/zebra/ CHANG ES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/broken- links.x ml [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ cookbook.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/index.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ linkmap.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/ piglatin_refer ence.html
RE: [VOTE] Release Pig 0.4.0 (candidate 0)
+1 for release. -Original Message- From: Olga Natkovich [mailto:ol...@yahoo-inc.com] Sent: Monday, September 14, 2009 2:06 PM To: pig-dev@hadoop.apache.org; priv...@hadoop.apache.org Subject: [VOTE] Release Pig 0.4.0 (candidate 0) Hi, I created a candidate build for Pig 0.4.0 release. The highlights of this release are - Performance improvements especially in the area of JOIN support where we introduced two new join types: skew join to deal with data skew and sort merge join to take advantage of the sorted data sets. - Support for Outer join. - Works with Hadoop 18 I ran the release audit and rat report looked fine. The relevant part is attached below. Keys used to sign the release are available at http://svn.apache.org/viewvc/hadoop/pig/trunk/KEYS?view=markup. Please download the release and try it out: http://people.apache.org/~olga/pig-0.4.0-candidate-0. Should we release this? Vote closes on Thursday, 9/17. Olga [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/CHANGES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/contrib/zebra/CHANG ES.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/broken-links.x ml [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/cookbook.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/index.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/linkmap.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/piglatin_refer ence.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/piglatin_users .html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/setup.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/tutorial.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/udf.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/api/package-li st [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes. html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/missingS inces.txt [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/user_com ments_for_pig_0.3.1_to_pig_0.5.0-dev.xml [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ alldiffs_index_additions.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ alldiffs_index_all.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ alldiffs_index_changes.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ alldiffs_index_removals.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ changes-summary.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ classes_index_additions.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ classes_index_all.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ classes_index_changes.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ classes_index_removals.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ constructors_index_additions.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ constructors_index_all.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ constructors_index_changes.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ constructors_index_removals.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ fields_index_additions.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ fields_index_all.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ fields_index_changes.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ fields_index_removals.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ jdiff_help.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ jdiff_statistics.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ jdiff_topleftframe.html [java] !? /home/olgan/src/pig-apache/trunk/build/pig-0.5.0-dev/docs/jdiff/changes/ methods_index_additions.html [java]
