Re: help : error run pig

2010-09-27 Thread Jeff Zhang
org.apache.pig.Main - ERROR 2999: Unexpected internal error. Failed to create DataStorage Help me?? Thanks -- Ngô Văn Vĩ Công Nghệ Phần Mềm Phone: 01695893851 -- Ngô Văn Vĩ Công Nghệ Phần Mềm Phone: 01695893851 -- Best Regards Jeff Zhang

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-09-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12907049#action_12907049 ] Jeff Zhang commented on PIG-794: Doug, I am using avro trunk revision 988779 Use Avro

[jira] Commented: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906467#action_12906467 ] Jeff Zhang commented on PIG-1602: - Patch committed to both trunk and branch-0.8

[jira] Resolved: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1602. - Resolution: Fixed The .classpath of eclipse template still use hbase-0.20.0

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-09-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906671#action_12906671 ] Jeff Zhang commented on PIG-794: Dmitriy, In my patch I turn InternalMap as an avro array

[jira] Commented: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906418#action_12906418 ] Jeff Zhang commented on PIG-1596: - Combine the new test case with existing ones. And commit

[jira] Resolved: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1596. - Fix Version/s: (was: 0.9.0) Resolution: Fixed NPE's thrown when attempting to load hbase

[jira] Created: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-05 Thread Jeff Zhang (JIRA)
Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor Fix For: 0.8.0 The .classpath of eclipse template still use hbase-0.20.0, it should be updated to hbase-0.20.6 -- This message is automatically generated by JIRA. - You can reply

[jira] Updated: (PIG-1602) The .classpath of eclipse template still use hbase-0.20.0

2010-09-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1602: Attachment: PIG_1602.patch The .classpath of eclipse template still use hbase-0.20.0

[jira] Commented: (PIG-1597) Development snapshot jar no longer picked up by bin/pig

2010-09-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12905825#action_12905825 ] Jeff Zhang commented on PIG-1597: - +1 Development snapshot jar no longer picked up by bin

[jira] Updated: (PIG-794) Use Avro serialization in Pig

2010-09-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-794: --- Attachment: AvroStorage_4.patch Attach the patch according Doug's suggestion, extend GenericDatumReader

[jira] Commented: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12905388#action_12905388 ] Jeff Zhang commented on PIG-1596: - George, thanks for your suggestion. And I believe you

[jira] Updated: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1596: Attachment: PIG_1596.patch Attach patch (modify HBaseStorage and add new TestCase) NPE's thrown when

[jira] Updated: (PIG-1596) NPE's thrown when attempting to load hbase columns containing null values

2010-09-01 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1596: Attachment: PIG_1596_2.patch Dmitriy, you are right. I updated the patch according your suggestion

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12904551#action_12904551 ] Jeff Zhang commented on PIG-794: I did some experiment on Avro, Avro_Storage_2.patch

[jira] Updated: (PIG-794) Use Avro serialization in Pig

2010-08-31 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-794: --- Attachment: AvroStorage_3.patch Use Avro serialization in Pig

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
different parser (ANTLR?), some performance tweaks, and map types with fixed-type values. Much still to be decided. The next contributor meeting will be hosted by LinkedIn in October. -Dmitriy -- Best Regards Jeff Zhang

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
Alan, That's great, next time I will try to join the contributor meeting. On Thu, Aug 26, 2010 at 11:35 AM, Alan Gates ga...@yahoo-inc.com wrote: On Aug 26, 2010, at 12:55 AM, Jeff Zhang wrote: Wonderful, Dmitriy, It's pity for me missing the contributor meeting. And any ppt shared ? Jeff

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
BTW, actually Dmitriy has invited me to join this meeting through skype, but it's pity that I have no time to join it this time. On Thu, Aug 26, 2010 at 6:15 PM, Jeff Zhang zjf...@gmail.com wrote: Alan, That's great, next time I will try to join the contributor meeting. On Thu, Aug 26, 2010

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Attachment: PIG_1205_8.patch Several updates continue Dmitriy's work. 1. Add unit test to HBaseStorage

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12901799#action_12901799 ] Jeff Zhang commented on PIG-1205: - Dmitriy, The testcase of testLoadWithParameters_1

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12901924#action_12901924 ] Jeff Zhang commented on PIG-1205: - Dmitriy, I found the problem. This is really a bug

Re: [VOTE] Pig to become a top level Apache project

2010-08-18 Thread Jeff Zhang
board will then vote on whether to make Pig a TLP. -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-18 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12900140#action_12900140 ] Jeff Zhang commented on PIG-1205: - Dimitiy, One suggestion of Point 1: You can set

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899691#action_12899691 ] Jeff Zhang commented on PIG-1205: - I am reviewing this patch. Enhance HBaseStorage-- Make

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12899718#action_12899718 ] Jeff Zhang commented on PIG-1205: - Several comments: 1. Is it possible to specify

Re: Restarting discussion on Pig as a TLP

2010-08-16 Thread Jeff Zhang
that is growing both in numbers and in diversity. We have a strong group of committers who I believe are ready to take on leadership of the project and who will benefit from being mentored by the larger Apache community. Thoughts? Alan. -- Best Regards Jeff Zhang

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Attachment: PIG-1249_5.patch Safe-guards against misconfigured Pig scripts without PARALLEL keyword

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12892697#action_12892697 ] Jeff Zhang commented on PIG-1249: - Olga, I generated the patch for the latest trunk. And add

[jira] Resolved: (PIG-1487) Replace bz with .bz in all the LoadFunc

2010-07-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1487. - Resolution: Fixed Commit the patch Replace bz with .bz in all the LoadFunc

[jira] Updated: (PIG-259) allow store to overwrite existing directroy

2010-07-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-259: --- Affects Version/s: 0.9.0 (was: 0.8.0) Olga, Sorry, I am afraid I have no time

[jira] Commented: (PIG-1463) Replace bz with .bz in setStoreLocation in PigStorage

2010-07-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12886186#action_12886186 ] Jeff Zhang commented on PIG-1463: - Thanks, Ashutosh. I check other places and find

[jira] Updated: (PIG-1487) Replace bz with .bz in all the LoadFunc

2010-07-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1487: Attachment: PIG_1487.patch Attach the patch Replace bz with .bz in all the LoadFunc

[jira] Commented: (PIG-794) Use Avro serialization in Pig

2010-07-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12884577#action_12884577 ] Jeff Zhang commented on PIG-794: We can leverage AvroInputFormat and AvroOutputFormat in Avro

[jira] Commented: (PIG-1475) Large number of FILTER matching clauses causes internal error 2998

2010-06-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12883768#action_12883768 ] Jeff Zhang commented on PIG-1475: - Mike, Could you paste your pig script and the full

[jira] Commented: (PIG-1473) Avoid serialization/deserialization costs for PigStorage data - Use custom Map and Bag implementation

2010-06-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12883382#action_12883382 ] Jeff Zhang commented on PIG-1473: - This sounds like the lazy deserialization in Hive, Great

Re: load files

2010-06-27 Thread Jeff Zhang
operator, is it a file or a directory? Similarly, when we use store-load to connect two MR operators, is the path specified in the store and load a directory? Thanks, -Gang -- Best Regards Jeff Zhang

[jira] Created: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
Affects Versions: 0.8.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 In the current implementation, the variable names in pig script are all global variable. This make one pig script know the variable in other scripts. In my opinion

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Attachment: Pig-1406.patch Attach the patch for this issue Should clean the Graph when register another

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Attachment: PIG_1463.patch Should clean the Graph when register another Pig Script

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Status: Patch Available (was: Open) Should clean the Graph when register another Pig Script

[jira] Updated: (PIG-1464) Should clean the Graph when register another Pig Script

2010-06-25 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1464: Attachment: (was: Pig-1406.patch) Should clean the Graph when register another Pig Script

[jira] Commented: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12881598#action_12881598 ] Jeff Zhang commented on PIG-1034: - Check the testReport, the failed testcase does not relate

[jira] Created: (PIG-1463) Replace bz with .bz in setStoreLocation in PigStorage

2010-06-23 Thread Jeff Zhang (JIRA)
Zhang Assignee: Jeff Zhang -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Updated: (PIG-1463) Replace bz with .bz in setStoreLocation in PigStorage

2010-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1463: Attachment: PIG_1463.patch Attach the patch for this small issue. Replace bz with .bz in setStoreLocation

[jira] Resolved: (PIG-1463) Replace bz with .bz in setStoreLocation in PigStorage

2010-06-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1463. - Fix Version/s: 0.8.0 Resolution: Fixed Patch committed Replace bz with .bz in setStoreLocation

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Fix Version/s: 0.8.0

[jira] Updated: (PIG-1034) Pig does not support ORDER ... BY group alias

2010-06-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1034: Attachment: PIG_1034.patch Attach the patch Pig does not support ORDER ... BY group alias

[jira] Commented: (PIG-1221) Filter equality does not work for tuples

2010-06-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880704#action_12880704 ] Jeff Zhang commented on PIG-1221: - patch committed Filter equality does not work for tuples

[jira] Updated: (PIG-1221) Filter equality does not work for tuples

2010-06-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1221: Status: Resolved (was: Patch Available) Resolution: Fixed Filter equality does not work for tuples

[jira] Assigned: (PIG-1221) Filter equality does not work for tuples

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned PIG-1221: --- Assignee: Jeff Zhang Filter equality does not work for tuples

[jira] Updated: (PIG-1221) Filter equality does not work for tuples

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1221: Attachment: PIG_1221.patch Attach the patch for make Tuple and Map supported in filter statement (both

[jira] Updated: (PIG-1221) Filter equality does not work for tuples

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1221: Status: Patch Available (was: Open) Affects Version/s: 0.8.0

[jira] Commented: (PIG-1450) TestAlgebraicEvalLocal failures due to OOM

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12879833#action_12879833 ] Jeff Zhang commented on PIG-1450: - I believe so, hadoop's local mode need much more memory

[jira] Commented: (PIG-1221) Filter equality does not work for tuples

2010-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880035#action_12880035 ] Jeff Zhang commented on PIG-1221: - I checked the test log, the errors from contrib tests do

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-06-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12876114#action_12876114 ] Jeff Zhang commented on PIG-1426: - Alan, I decide to defer this jira to future when it's

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12874903#action_12874903 ] Jeff Zhang commented on PIG-1249: - Alan,Thanks for your help. Safe-guards against

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12872753#action_12872753 ] Jeff Zhang commented on PIG-1426: - Alan, but when writing we use the VInt, so it won't affect

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-27 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12872758#action_12872758 ] Jeff Zhang commented on PIG-1426: - Alan, I look at your comments again. seems you

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Attachment: PIG_1249_3.patch Update the patch, including testcase of non-dfs input and do path checking when

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Status: Open (was: Patch Available) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12870937#action_12870937 ] Jeff Zhang commented on PIG-1426: - Alan, It won't affect Zebra and BinStorage. Here I only

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12870948#action_12870948 ] Jeff Zhang commented on PIG-1249: - Response to Alan's questions, 1. In this code, what

[jira] Created: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
Components: data Affects Versions: 0.8.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 Most of time, the size of tuple is not very large, one byte is enough for store the size of tuple. So I suggest to use VInt instead of Int for the size

[jira] Updated: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1426: Attachment: PIG_1426.patch Change the size of Tuple from Int to VInt when Serialize Tuple

[jira] Commented: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-05-23 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12870508#action_12870508 ] Jeff Zhang commented on PIG-1426: - I did a simple experiment for the performance comparison

Re: error while compiling pig

2010-05-23 Thread Jeff Zhang
:) Hey do you know if we can run PIG in mapreduce mode inside eclipse? I haven't been able to even though I have my env variables set, and I configured the run properties in the IDE. Thanks again. Renato M. 2010/5/24 Jeff Zhang zjf...@gmail.com After you run ant jar, the jline 0.94

[jira] Created: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-05-20 Thread Jeff Zhang (JIRA)
Components: grunt Affects Versions: 0.8.0 Reporter: Jeff Zhang Assignee: Jeff Zhang Fix For: 0.8.0 The relation name in pig script can been considered as variable of programming language. One risk of the current grunt is that user may use

[jira] Updated: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-05-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1423: Attachment: PIG-1423.patch Suggest to add clear command in grunt to clear the relation variable

[jira] Updated: (PIG-1423) Suggest to add clear command in grunt to clear the relation variable

2010-05-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1423: Status: Patch Available (was: Open) Suggest to add clear command in grunt to clear the relation variable

[jira] Resolved: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang resolved PIG-1422. - Resolution: Fixed Duplicate code in LOPrinter.java

[jira] Commented: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12869833#action_12869833 ] Jeff Zhang commented on PIG-1422: - patch committed Duplicate code in LOPrinter.java

[jira] Commented: (PIG-1359) bin/pig script does not pick up correct jar libraries

2010-05-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12869459#action_12869459 ] Jeff Zhang commented on PIG-1359: - Hi Daniel, Does it mean in development stage, I have

[jira] Created: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-19 Thread Jeff Zhang (JIRA)
Reporter: Jeff Zhang Assignee: Jeff Zhang Priority: Minor Fix For: 0.8.0 Today when I go through the source code , I find the following duplicate code in LOPrinter.java (line 153 --- line 170) {code} else if(node instanceof LOJoin

[jira] Updated: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-19 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1422: Attachment: PIG_1422.patch Attach the patch for removing the duplicate code Duplicate code

[jira] Assigned: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned PIG-1249: --- Assignee: Jeff Zhang Safe-guards against misconfigured Pig scripts without PARALLEL keyword

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Attachment: PIG-1249.patch The current idea is borrowed from hive, use the input file size to estimate

[jira] Updated: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-05-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1249: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Safe-guards against

Re: Pig 0.7.0 is released!

2010-05-14 Thread Jeff Zhang
. Daniel -- Best Regards Jeff Zhang

Re: svn commit: r943516 - in /hadoop/pig/trunk/patches: ./ Pig_1406_submit.patch

2010-05-12 Thread Jeff Zhang
String[cmdTokens.size()])); ++      } ++      )+ ++      | +       CAT +       ( +       t1 = GetPath() -- Best Regards Jeff Zhang

[jira] Commented: (PIG-1406) Allow to run shell commands from grunt

2010-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866622#action_12866622 ] Jeff Zhang commented on PIG-1406: - patch committed. Allow to run shell commands from grunt

[jira] Commented: (PIG-1410) Make PigServer can handle files with parameters

2010-05-12 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866623#action_12866623 ] Jeff Zhang commented on PIG-1410: - patch committed Make PigServer can handle files

[jira] Updated: (PIG-1406) Allow to run shell commands from grunt

2010-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1406: Status: Open (was: Patch Available) Allow to run shell commands from grunt

[jira] Updated: (PIG-1406) Allow to run shell commands from grunt

2010-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1406: Status: Patch Available (was: Open) Allow to run shell commands from grunt

[jira] Updated: (PIG-1406) Allow to run shell commands from grunt

2010-05-11 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1406: Attachment: Pig-1406_2.patch Alan, you are right. I agree the behavior of sh command should be the same

[jira] Updated: (PIG-1410) Make PigServer can handle files with parameters

2010-05-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1410: Status: Open (was: Patch Available) Make PigServer can handle files with parameters

[jira] Updated: (PIG-1410) Make PigServer can handle files with parameters

2010-05-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1410: Attachment: Pig_1410_2.patch Alan, thanks for your comments. I've updated the patch. Make PigServer can

[jira] Updated: (PIG-1410) Make PigServer can handle files with parameters

2010-05-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1410: Status: Patch Available (was: Open) Make PigServer can handle files with parameters

[jira] Created: (PIG-1410) Make PigServer can handle files with parameters

2010-05-09 Thread Jeff Zhang (JIRA)
Make PigServer can handle files with parameters --- Key: PIG-1410 URL: https://issues.apache.org/jira/browse/PIG-1410 Project: Pig Issue Type: Improvement Reporter: Jeff Zhang

[jira] Updated: (PIG-1410) Make PigServer can handle files with parameters

2010-05-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1410: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Make PigServer can handle

[jira] Updated: (PIG-1406) Allow to run shell commands from grunt

2010-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1406: Attachment: Pig-1406.patch The current design is using sh as the indicator, e.g. you can run shell

[jira] Updated: (PIG-1406) Allow to run shell commands from grunt

2010-05-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1406: Status: Patch Available (was: Open) Affects Version/s: 0.8.0 Tags: grunt

[jira] Commented: (PIG-915) Load row names in HBase loader

2010-03-24 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849230#action_12849230 ] Jeff Zhang commented on PIG-915: Olga, sorry for reply you late. This feature has been

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-03-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12846327#action_12846327 ] Jeff Zhang commented on PIG-1205: - Dmitriy, do you mean the HBaseStorage's performance is far

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-03-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12843946#action_12843946 ] Jeff Zhang commented on PIG-1205: - Dmitriy, Thanks for your suggestion, I adopt your idea

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-03-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Status: Patch Available (was: Open) Enhance HBaseStorage-- Make it support loading row key and implement

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-03-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Attachment: PIG_1205_3.patch Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-03-08 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Status: Patch Available (was: Open) Enhance HBaseStorage-- Make it support loading row key and implement

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Attachment: PIG_1205_2.patch Submit the patch for trunk Enhance HBaseStorage-- Make it support loading row

[jira] Updated: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1205: Status: Open (was: Patch Available) Enhance HBaseStorage-- Make it support loading row key and implement

  1   2   3   >