Re: [jira] Updated: (PIG-1309) Map-side Cogroup

2010-09-03 Thread Mridul Muralidharan
Condition (1) refers to only explicit (user specified) statements right ? Not implicit project introduced by pig to conform to schema ? Regards, Mridul On Saturday 21 August 2010 12:59 AM, Ashutosh Chauhan (JIRA) wrote: [

[jira] Commented: (PIG-1309) Sort Merge Cogroup

2010-09-03 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12905859#action_12905859 ] Mridul Muralidharan commented on PIG-1309: -- Condition (1) refers to only explicit

[jira] Commented: (PIG-1321) Logical Optimizer: Merge cascading foreach

2010-08-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12902392#action_12902392 ] Mridul Muralidharan commented on PIG-1321: -- Is the merge prevented only if flatten

[jira] Commented: (PIG-365) Map side optimization for Limit (top k case)

2010-08-18 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1280#action_1280 ] Mridul Muralidharan commented on PIG-365: - collecting only top k per mapper

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-18 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1292#action_1292 ] Mridul Muralidharan commented on PIG-1518: -- if optimizer is turned off, does

[jira] Commented: (PIG-1530) PIG Logical Optimization: Push LOFilter above LOCogroup

2010-08-01 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12894368#action_12894368 ] Mridul Muralidharan commented on PIG-1530: -- This looks more like a developer coding

[jira] Commented: (PIG-1530) PIG Logical Optimization: Push LOFilter above LOCogroup

2010-08-01 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12894388#action_12894388 ] Mridul Muralidharan commented on PIG-1530: -- Cant edit comments .. to add to previous

[jira] Commented: (PIG-566) Dump and store outputs do not match for PigStorage

2010-05-17 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868155#action_12868155 ] Mridul Muralidharan commented on PIG-566: - Just to point out an error in the comment

Re: optimizer hints in Pig

2009-11-14 Thread Mridul Muralidharan
This should be interesting to pursue. For non-trivial plans, it can be used to model how join's are to be optimized for example - instead of having users specify it, infer based on the hints from various stages. Similarly, an oft-repeated request is making pig infer the value of PARALLEL -

[jira] Commented: (PIG-940) Cross site HDFS access using the default.fs.name not possible in Pig

2009-09-01 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12749905#action_12749905 ] Mridul Muralidharan commented on PIG-940: - Is this supported in hadoop ? As in, can

[jira] Commented: (PIG-826) DISTINCT as Function/Operator rather than statement/operator - High Level Pig

2009-06-02 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12715745#action_12715745 ] Mridul Muralidharan commented on PIG-826: - This would be a welcome change ! Another

Re: A proposal for changing pig's memory management

2009-06-01 Thread Mridul Muralidharan
Alan Gates wrote: On May 19, 2009, at 10:30 PM, Mridul Muralidharan wrote: I am still not very convinced about the value about this implementation - particularly considering the advances made since 1.3 in memory allocators and garbage collection. My fundamental concern

[jira] Commented: (PIG-807) PERFORMANCE: Provide a way for UDFs to use read-once bags (backed by the Hadoop values iterator)

2009-05-19 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12710901#action_12710901 ] Mridul Muralidharan commented on PIG-807: - I think I am missing something here. If I

Re: A proposal for changing pig's memory management

2009-05-19 Thread Mridul Muralidharan
I am still not very convinced about the value about this implementation - particularly considering the advances made since 1.3 in memory allocators and garbage collection. The side effect of this proposal is many, and sometimes non-obvious. Like implicitly moving young generation data into

[jira] Commented: (PIG-788) Proposal to remove float from Pig data types

2009-05-12 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708341#action_12708341 ] Mridul Muralidharan commented on PIG-788: - We do use floats quite a bit in our

Re: [jira] Updated: (PIG-690) UNION doesn't work in the latest code

2009-03-03 Thread Mridul Muralidharan
Great, thanks ! I am assuming this might also fix load related schema issues too (with BinStorage) ? Looked kind of similar issue as I reported in pig usergroup. - Mridul Pradeep Kamath (JIRA) wrote: [

Re: Pig compile error

2009-02-13 Thread Mridul Muralidharan
You need jdk 1.6. Maybe that will help ? - Mridul nitesh bhatia wrote: Hi I've downloaded latest Pig code from trunk today. It is not getting compiled using 'ant' command. Trace: nitesh-bhatias-macbook:trunk niteshbhatia$ ant Buildfile: build.xml init: cc-compile: compile: [echo]

Re: switching to different parser in Pig

2009-02-12 Thread Mridul Muralidharan
This sounds like a great idea ! Would be great if other means of generating ast's for pig was possible. Regards, Mridul Ted Dunning wrote: In general, it would be really, really nice if it were easy to build abstract Pig syntax trees outside of the normal parser. For instance, I find the