Re: help : error run pig

2010-09-27 Thread Jeff Zhang
But it's weird that the port in your error is 54310 while in your configuration file it is 9000 On Tue, Sep 28, 2010 at 10:22 AM, Ngô Văn Vĩ wrote: > "192.168.230.130" is IP of my machine > @JeffZhang: can you explain clearly? > Thanks > > On Tue, Sep 28, 2010

Re: help : error run pig

2010-09-27 Thread Jeff Zhang
192.168.230.130 is your local machine ? Then change /etc/hosts to map "localhost" to "127.0.0.1" On Tue, Sep 28, 2010 at 10:22 AM, Ngô Văn Vĩ wrote: > "192.168.230.130" is IP of my machine > @JeffZhang: can you explain clearly? > Thanks > > On Tu

Re: help : error run pig

2010-09-27 Thread Jeff Zhang
ing >>> connect to server: master/192.168.230.130:54310. Already tried 7 time(s). >>> 2010-09-27 08:39:49,770 [main] INFO  org.apache.hadoop.ipc.Client - >>> Retrying >>> connect to server: master/192.168.230.130:54310. Already tried 8 time(s). >>> 2010-09-27 08:39:50,771 [main] INFO  org.apache.hadoop.ipc.Client - >>> Retrying >>> connect to server: master/192.168.230.130:54310. Already tried 9 time(s). >>> 2010-09-27 08:39:50,780 [main] ERROR org.apache.pig.Main - ERROR 2999: >>> Unexpected internal error. Failed to create DataStorage >>> >>> Help me?? >>> Thanks >>> -- >>> Ngô Văn Vĩ >>> Công Nghệ Phần Mềm >>> Phone: 01695893851 >>> >> >> > > > -- > Ngô Văn Vĩ > Công Nghệ Phần Mềm > Phone: 01695893851 > -- Best Regards Jeff Zhang

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-09-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907049#action_12907049 ] Jeff Zhang commented on PIG-794: Doug, I am using avro trunk revision 988779 > U

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-09-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12906671#action_12906671 ] Jeff Zhang commented on PIG-794: Dmitriy, In my patch I turn InternalMap as an avro a

[jira] Resolved: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1602. - Resolution: Fixed > The .classpath of eclipse template still use hbase-0.2

[jira] Commented: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12906467#action_12906467 ] Jeff Zhang commented on PIG-1602: - Patch committed to both trunk and branch-0.8 &

[jira] Updated: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1602: Attachment: PIG_1602.patch > The .classpath of eclipse template still use hbase-0.2

[jira] Created: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-05 Thread Jeff Zhang (JIRA)
Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor Fix For: 0.8.0 The .classpath of eclipse template still use hbase-0.20.0, it should be updated to hbase-0.20.6 -- This message is automatically generated by JIRA. - You can reply to this

[jira] Resolved: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1596. - Fix Version/s: (was: 0.9.0) Resolution: Fixed > NPE's thrown when attempting to lo

[jira] Commented: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12906418#action_12906418 ] Jeff Zhang commented on PIG-1596: - Combine the new test case with existing ones. And co

[jira] Commented: (PIG-1597) Development snapshot jar no longer picked up by bin/pig

2010-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905825#action_12905825 ] Jeff Zhang commented on PIG-1597: - +1 > Development snapshot jar no longer picked up

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905765#action_12905765 ] Jeff Zhang commented on PIG-794: Dmitriy, The InternalMap's key and value mu

[jira] Updated: (PIG-794) Use Avro serialization in Pig

2010-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-794: --- Attachment: AvroStorage_4.patch Attach the patch according Doug's suggestion, extend GenericDatumReade

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905437#action_12905437 ] Jeff Zhang commented on PIG-794: Scott & Doug, thanks for your review. Scott, It

[jira] Updated: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1596: Attachment: PIG_1596_2.patch Dmitriy, you are right. I updated the patch according your suggestion

[jira] Updated: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1596: Attachment: PIG_1596.patch Attach patch (modify HBaseStorage and add new TestCase) > NPE's thr

[jira] Commented: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905388#action_12905388 ] Jeff Zhang commented on PIG-1596: - George, thanks for your suggestion. And I believe you

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904575#action_12904575 ] Jeff Zhang commented on PIG-794: Attach the updated patch Avro_Strorage_3.patch ( I found

[jira] Updated: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-794: --- Attachment: AvroStorage_3.patch > Use Avro serialization in

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904555#action_12904555 ] Jeff Zhang commented on PIG-794: Besides the above experiment, I also did a experimen

[jira] Updated: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-794: --- Attachment: AvroTest.java > Use Avro serialization in

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904551#action_12904551 ] Jeff Zhang commented on PIG-794: I did some experiment on Avro, Avro_Storage_2.patch is

[jira] Updated: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-794: --- Attachment: AvroStorage_2.patch > Use Avro serialization in

[jira] Updated: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1426: Status: Resolved (was: Patch Available) Resolution: Won't Fix This issue is similar with PIG

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
BTW, actually Dmitriy has invited me to join this meeting through skype, but it's pity that I have no time to join it this time. On Thu, Aug 26, 2010 at 6:15 PM, Jeff Zhang wrote: > Alan, > > That's great, next time I will try to join the contributor meeting. > > On T

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
Alan, That's great, next time I will try to join the contributor meeting. On Thu, Aug 26, 2010 at 11:35 AM, Alan Gates wrote: > > On Aug 26, 2010, at 12:55 AM, Jeff Zhang wrote: > >> Wonderful, Dmitriy, It's pity for me missing the contributor meeting. >> And an

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
ect can be another > collaboration point between the projects. Not clear how that would work, > Carl will talk to other Hive people. > > Pig 0.9 > So far the items on the list for 0.9 are: better type propagation / > resolution story and documentation,  perhaps different parser (ANTLR?), some > performance tweaks, and map types with fixed-type values. Much still to be > decided. > > The next contributor meeting will be hosted by LinkedIn in October. > > -Dmitriy > -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1564) add support for multiple filesystems

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902276#action_12902276 ] Jeff Zhang commented on PIG-1564: - Andrew, could you add unit test for your patch ? &

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12901924#action_12901924 ] Jeff Zhang commented on PIG-1205: - Dmitriy, I found the problem. This is really a bu

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12901799#action_12901799 ] Jeff Zhang commented on PIG-1205: - Dmitriy, The testcase of testLoadWithParameters_1

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Attachment: PIG_1205_8.patch Several updates continue Dmitriy's work. 1. Add unit test to HBaseSt

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900140#action_12900140 ] Jeff Zhang commented on PIG-1205: - Dimitiy, One suggestion of Point 1: You can set

Re: [VOTE] Pig to become a top level Apache project

2010-08-18 Thread Jeff Zhang
//bit.ly/bvOTRq for an example resolution) and sent to the Apache > board. > The Apache board will then vote on whether to make Pig a TLP. > -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899718#action_12899718 ] Jeff Zhang commented on PIG-1205: - Several comments: 1. Is it possible to spe

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899691#action_12899691 ] Jeff Zhang commented on PIG-1205: - I am reviewing this patch. > Enhance HBaseStorage

Re: Restarting discussion on Pig as a TLP

2010-08-16 Thread Jeff Zhang
from "not yet" to "now is > a > > good time". I think Pig is ready to be a TLP. We have a community of > > contributors and users that is growing both in numbers and in diversity. > We > > have a strong group of committers who I believe are ready to take on > > leadership of the project and who will benefit from being mentored by the > > larger Apache community. > > > > Thoughts? > > > > Alan. > > > -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893016#action_12893016 ] Jeff Zhang commented on PIG-1423: - Yes, Olga, I agree with you > Suggest to ad

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Status: Patch Available (was: Open) > Safe-guards against misconfigured Pig scripts without PARAL

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Status: Open (was: Patch Available) > Safe-guards against misconfigured Pig scripts without PARAL

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892697#action_12892697 ] Jeff Zhang commented on PIG-1249: - Olga, I generated the patch for the latest trunk. And

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Attachment: PIG-1249_5.patch > Safe-guards against misconfigured Pig scripts without PARALLEL keyw

[jira] Updated: (PIG-259) allow store to overwrite existing directroy

2010-07-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-259: --- Affects Version/s: 0.9.0 (was: 0.8.0) Olga, Sorry, I am afraid I have no time to

[jira] Resolved: (PIG-1487) Replace "bz" with ".bz" in all the LoadFunc

2010-07-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1487. - Resolution: Fixed Commit the patch > Replace "bz" with ".bz&quo

Re: Pig filter by fails at backend , what am i doing wrong?

2010-07-19 Thread Jeff Zhang
the fix is just to remove the cast. But this error > pops up second time today for me in different contexts.. > > Thanks. > > -Dmitriy > > On Mon, Jul 19, 2010 at 10:03 PM, Jeff Zhang wrote: > > > It looks like a bug of Pig. > > I try the following script: &g

Re: Pig filter by fails at backend , what am i doing wrong?

2010-07-19 Thread Jeff Zhang
'filter by ... > (int)(contentRating.vendorId)==1 which did not change anything. > > Any ideas for workaround are appreciated. > > Thanks in advance. > -Dmitriy > -- Best Regards Jeff Zhang

[jira] Updated: (PIG-1487) Replace "bz" with ".bz" in all the LoadFunc

2010-07-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1487: Attachment: PIG_1487.patch Attach the patch > Replace "bz" with ".bz&quo

[jira] Commented: (PIG-1463) Replace "bz" with ".bz" in setStoreLocation in PigStorage

2010-07-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886186#action_12886186 ] Jeff Zhang commented on PIG-1463: - Thanks, Ashutosh. I check other places and find

[jira] Created: (PIG-1487) Replace "bz" with ".bz" in all the LoadFunc

2010-07-07 Thread Jeff Zhang (JIRA)
Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 This issue relates with PIG-1463. Thank Ashutosh find another place in PigStorage should be corrected. I check all the LoadFunc and found that TextLoader also has same problem. -- This message is automa

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-07-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884577#action_12884577 ] Jeff Zhang commented on PIG-794: We can leverage AvroInputFormat and AvroOutputForma

Re: Avoiding serialization/de-serialization in pig

2010-06-30 Thread Jeff Zhang
hese are ideas that don't involve changes to optimizer. Most of them >> involve changes in the load/store functions. >> >> Your feedback is welcome. >> >> Thanks, >> Thejas >> >> > -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1475) Large number of FILTER matching clauses causes internal error 2998

2010-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883768#action_12883768 ] Jeff Zhang commented on PIG-1475: - Mike, Could you paste your pig script and the

[jira] Commented: (PIG-1473) Avoid serialization/deserialization costs for PigStorage data - Use custom Map and Bag implementation

2010-06-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883382#action_12883382 ] Jeff Zhang commented on PIG-1473: - This sounds like the lazy deserialization in Hive, G

Re: load files

2010-06-28 Thread Jeff Zhang
result) or > part-r-x(for reduce result), which are different from the hadoop style > (part-x). So, can we control the name of each generated file? How? > > Thanks, > -Gang > > > > - 原始邮件 > 发件人: Jeff Zhang > 收件人: pig-dev@hadoop.apache.org >

Re: load files

2010-06-27 Thread Jeff Zhang
t a file or a > directory? Similarly, when we use store-load to connect two MR operators, is > the path specified in the store and load a directory? > > Thanks, > -Gang > > > > > -- Best Regards Jeff Zhang

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Attachment: PIG_1463.patch > Should clean the Graph when register another Pig Scr

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Status: Patch Available (was: Open) > Should clean the Graph when register another Pig Scr

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Attachment: (was: Pig-1406.patch) > Should clean the Graph when register another Pig Scr

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Attachment: Pig-1406.patch Attach the patch for this issue > Should clean the Graph when register anot

[jira] Created: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
Affects Versions: 0.8.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 In the current implementation, the variable names in pig script are all global variable. This make one pig script know the variable in other scripts. In my opinion, this is not

[jira] Resolved: (PIG-1463) Replace "bz" with ".bz" in setStoreLocation in PigStorage

2010-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1463. - Fix Version/s: 0.8.0 Resolution: Fixed Patch committed > Replace "bz"

[jira] Updated: (PIG-1463) Replace "bz" with ".bz" in setStoreLocation in PigStorage

2010-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1463: Attachment: PIG_1463.patch Attach the patch for this small issue. > Replace "bz"

[jira] Created: (PIG-1463) Replace "bz" with ".bz" in setStoreLocation in PigStorage

2010-06-23 Thread Jeff Zhang (JIRA)
Reporter: Jeff Zhang Assignee: Jeff Zhang -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881598#action_12881598 ] Jeff Zhang commented on PIG-1034: - Check the testReport, the failed testcase does not re

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Attachment: PIG_1034.patch Attach the patch > Pig does not support ORDER ... BY group al

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Fix Version/s: 0.8.0

[jira] Assigned: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned PIG-1034: --- Assignee: Jeff Zhang > Pig does not support ORDER ... BY group al

[jira] Updated: (PIG-1221) Filter equality does not work for tuples

2010-06-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1221: Status: Resolved (was: Patch Available) Resolution: Fixed > Filter equality does not work

[jira] Commented: (PIG-1221) Filter equality does not work for tuples

2010-06-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880704#action_12880704 ] Jeff Zhang commented on PIG-1221: - patch committed > Filter equality does not w

[jira] Commented: (PIG-1221) Filter equality does not work for tuples

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880035#action_12880035 ] Jeff Zhang commented on PIG-1221: - I checked the test log, the errors from contrib test

[jira] Commented: (PIG-1450) TestAlgebraicEvalLocal failures due to OOM

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12879833#action_12879833 ] Jeff Zhang commented on PIG-1450: - I believe so, hadoop's local mode need much mo

[jira] Updated: (PIG-1221) Filter equality does not work for tuples

2010-06-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1221: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 (was

[jira] Updated: (PIG-1221) Filter equality does not work for tuples

2010-06-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1221: Attachment: PIG_1221.patch Attach the patch for make Tuple and Map supported in filter statement (both

[jira] Assigned: (PIG-1221) Filter equality does not work for tuples

2010-06-16 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned PIG-1221: --- Assignee: Jeff Zhang > Filter equality does not work for tup

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-06-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876114#action_12876114 ] Jeff Zhang commented on PIG-1426: - Alan, I decide to defer this jira to future when

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874903#action_12874903 ] Jeff Zhang commented on PIG-1249: - Alan,Thanks for your help. > Safe-guards

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872758#action_12872758 ] Jeff Zhang commented on PIG-1426: - Alan, I look at your comments again. seems you

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872753#action_12872753 ] Jeff Zhang commented on PIG-1426: - Alan, but when writing we use the VInt, so it w

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Attachment: PIG_1249_3.patch Update the patch, including testcase of non-dfs input and do path checking when

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870948#action_12870948 ] Jeff Zhang commented on PIG-1249: - Response to Alan's questions, 1. In this c

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870937#action_12870937 ] Jeff Zhang commented on PIG-1426: - Alan, It won't affect Zebra and BinStorage. He

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Status: Open (was: Patch Available) > Safe-guards against misconfigured Pig scripts without PARAL

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Status: Patch Available (was: Open) > Safe-guards against misconfigured Pig scripts without PARAL

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Attachment: PIG_1249_2.patch Clear the logic. first check the PARALLE in query, if not set, then check the

Re: error while compiling pig

2010-05-23 Thread Jeff Zhang
; and it worked fine :) > Hey do you know if we can run PIG in mapreduce mode inside eclipse? I > haven't been able to even though I have my env variables set, and I > configured the run properties in the IDE. Thanks again. > > Renato M. > > 2010/5/24 Jeff Zhang > &

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870508#action_12870508 ] Jeff Zhang commented on PIG-1426: - I did a simple experiment for the performance compar

[jira] Updated: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1426: Status: Patch Available (was: Open) > Change the size of Tuple from Int to VInt when Serialize Tu

[jira] Updated: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1426: Attachment: PIG_1426.patch > Change the size of Tuple from Int to VInt when Serialize Tu

[jira] Created: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
Components: data Affects Versions: 0.8.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 Most of time, the size of tuple is not very large, one byte is enough for store the size of tuple. So I suggest to use VInt instead of Int for the size of

Re: error while compiling pig

2010-05-23 Thread Jeff Zhang
I dunno why I downloaded a previous one, but I would like know which the > actual used version is. > Thanks again. > > Renato M. > -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1359) bin/pig script does not pick up correct jar libraries

2010-05-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870258#action_12870258 ] Jeff Zhang commented on PIG-1359: - Daniel, I've committed the patch. > bi

[jira] Resolved: (PIG-1359) bin/pig script does not pick up correct jar libraries

2010-05-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1359. - Resolution: Fixed > bin/pig script does not pick up correct jar librar

[jira] Commented: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869833#action_12869833 ] Jeff Zhang commented on PIG-1422: - patch committed > Duplicate code in LOPrint

[jira] Resolved: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1422. - Resolution: Fixed > Duplicate code in LOPrinter.j

[jira] Updated: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-05-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1423: Status: Patch Available (was: Open) > Suggest to add clear command in grunt to clear the relation varia

[jira] Updated: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-05-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1423: Attachment: PIG-1423.patch > Suggest to add clear command in grunt to clear the relation varia

[jira] Created: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-05-19 Thread Jeff Zhang (JIRA)
Components: grunt Affects Versions: 0.8.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 The relation name in pig script can been considered as variable of programming language. One risk of the current grunt is that user may use the

[jira] Updated: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1422: Attachment: PIG_1422.patch Attach the patch for removing the duplicate code > Duplicate code

[jira] Created: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-19 Thread Jeff Zhang (JIRA)
Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor Fix For: 0.8.0 Today when I go through the source code , I find the following duplicate code in LOPrinter.java (line 153 --- line 170) {code} else if(node instanceof LOJoin

[jira] Commented: (PIG-1359) bin/pig script does not pick up correct jar libraries

2010-05-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869459#action_12869459 ] Jeff Zhang commented on PIG-1359: - Hi Daniel, Does it mean in development stage, I hav

  1   2   3   4   >