[jira] [Commented] (PIG-3021) Split results missing records when there is null values in the column comparison

2017-04-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973449#comment-15973449 ] Cheolsoo Park commented on PIG-3021: [~daijy], no I don't remember. Sorry for the late reply. > Split

[jira] [Commented] (PIG-4940) Predicate push-down filtering unary expressions can be pushed.

2016-06-28 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353741#comment-15353741 ] Cheolsoo Park commented on PIG-4940: Sorry, but I'll let someone who is still active in the community

[jira] [Updated] (PIG-4850) Registered jars do not use submit replication

2016-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4850: --- Resolution: Fixed Fix Version/s: 0.16.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (PIG-4850) Registered jars do not use submit replication

2016-03-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212561#comment-15212561 ] Cheolsoo Park commented on PIG-4850: Oh so PIG-4074 missed a code path for registered jars. LGTM.

[jira] [Updated] (PIG-4696) Empty map returned by a streaming_python udf wrongly contains a null key

2015-10-08 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4696: --- Resolution: Fixed Fix Version/s: 0.16.0 Status: Resolved (was: Patch Available)

[jira] [Created] (PIG-4696) Empty map returned by a streaming_python udf wrongly contains a null key

2015-10-07 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4696: -- Summary: Empty map returned by a streaming_python udf wrongly contains a null key Key: PIG-4696 URL: https://issues.apache.org/jira/browse/PIG-4696 Project: Pig

[jira] [Updated] (PIG-4696) Empty map returned by a streaming_python udf wrongly contains a null key

2015-10-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4696: --- Status: Patch Available (was: Open) > Empty map returned by a streaming_python udf wrongly contains a

[jira] [Updated] (PIG-4696) Empty map returned by a streaming_python udf wrongly contains a null key

2015-10-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4696: --- Attachment: PIG-4696.1.patch > Empty map returned by a streaming_python udf wrongly contains a null key

[jira] [Commented] (PIG-4066) An optimization for ROLLUP operation in Pig

2015-05-21 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555615#comment-14555615 ] Cheolsoo Park commented on PIG-4066: [~daijy], sorry for the trouble and thanks for the

[jira] [Commented] (PIG-3294) Allow Pig use Hive UDFs

2015-05-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14548184#comment-14548184 ] Cheolsoo Park commented on PIG-3294: [~daijy], thank you for the great work! I am

[jira] [Commented] (PIG-4511) Add columns to prune from PluckTuple

2015-04-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514310#comment-14514310 ] Cheolsoo Park commented on PIG-4511: +1. I'll commit the patch soon. Add columns to

[jira] [Resolved] (PIG-4511) Add columns to prune from PluckTuple

2015-04-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-4511. Resolution: Fixed Committed to branch-0.15 and trunk. Thank you [~jbabcock]! Add columns to prune

[jira] [Commented] (PIG-4511) Add columns to prune from PluckTuple

2015-04-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14511777#comment-14511777 ] Cheolsoo Park commented on PIG-4511: [~daijy], actually I think we shouldn't commit this

[jira] [Updated] (PIG-4511) Add columns to prune from PluckTuple

2015-04-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4511: --- Affects Version/s: 0.14.0 Fix Version/s: (was: 0.14.0) 0.15.0 Add

[jira] [Assigned] (PIG-4511) Add columns to prune from PluckTuple

2015-04-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4511: -- Assignee: Joseph Babcock Assigning to Joseph. Add columns to prune from PluckTuple

[jira] [Created] (PIG-4409) fs.defaultFS is overwritten in JobConf by replicated join at runtime

2015-02-04 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4409: -- Summary: fs.defaultFS is overwritten in JobConf by replicated join at runtime Key: PIG-4409 URL: https://issues.apache.org/jira/browse/PIG-4409 Project: Pig

[jira] [Updated] (PIG-4409) fs.defaultFS is overwritten in JobConf by replicated join at runtime

2015-02-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4409: --- Status: Patch Available (was: Open) fs.defaultFS is overwritten in JobConf by replicated join at

[jira] [Updated] (PIG-4409) fs.defaultFS is overwritten in JobConf by replicated join at runtime

2015-02-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4409: --- Attachment: PIG-4409-1.patch Uploading a patch that fixes the issue. fs.defaultFS is overwritten in

[jira] [Updated] (PIG-4409) fs.defaultFS is overwritten in JobConf by replicated join at runtime

2015-02-04 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4409: --- Resolution: Fixed Fix Version/s: 0.14.1 Status: Resolved (was: Patch Available)

[jira] [Created] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4401: -- Summary: Add pattern matching to PluckTuple Key: PIG-4401 URL: https://issues.apache.org/jira/browse/PIG-4401 Project: Pig Issue Type: Improvement

[jira] [Updated] (PIG-4402) JavaScript UDF example in the doc is broken

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4402: --- Attachment: PIG-4402-1.patch JavaScript UDF example in the doc is broken

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Status: Patch Available (was: Open) Add pattern matching to PluckTuple

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Attachment: PIG-4401-1.patch Attaching a patch. It also updates TestPluckTuple with a test case. Add

[jira] [Created] (PIG-4402) JavaScript UDF example in the doc is broken

2015-01-29 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4402: -- Summary: JavaScript UDF example in the doc is broken Key: PIG-4402 URL: https://issues.apache.org/jira/browse/PIG-4402 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4402) JavaScript UDF example in the doc is broken

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4402: --- Status: Patch Available (was: Open) JavaScript UDF example in the doc is broken

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Daniel

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Attachment: PIG-4401-3.patch Add pattern matching to PluckTuple --

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Attachment: (was: PIG-4401-3.patch) Add pattern matching to PluckTuple

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Affects Version/s: (was: 0.15.0) Fix Version/s: 0.15.0 Add pattern matching to PluckTuple

[jira] [Updated] (PIG-4401) Add pattern matching to PluckTuple

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4401: --- Attachment: PIG-4401-3.patch Sure. I incorporated your comments in the new patch, Thanks! Add pattern

[jira] [Updated] (PIG-4402) JavaScript UDF example in the doc is broken

2015-01-29 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4402: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Commented] (PIG-4375) ObjectCache should use ProcessorContext.getObjectRegistry()

2015-01-22 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287943#comment-14287943 ] Cheolsoo Park commented on PIG-4375: [~rohini], I haven't tested join + group by. But I

[jira] [Commented] (PIG-4066) An optimization for ROLLUP operation in Pig

2014-12-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244477#comment-14244477 ] Cheolsoo Park commented on PIG-4066: +1. I will commit this patch today. This

[jira] [Updated] (PIG-4066) An optimization for ROLLUP operation in Pig

2014-12-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4066: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (PIG-4351) TestPigRunner.simpleTest2 fail on trunk

2014-12-09 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239788#comment-14239788 ] Cheolsoo Park commented on PIG-4351: +1 TestPigRunner.simpleTest2 fail on trunk

[jira] [Updated] (PIG-4343) Tez auto parallelism fails at query compile time

2014-11-25 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4343: --- Issue Type: Sub-task (was: Bug) Parent: PIG-3446 Tez auto parallelism fails at query compile

[jira] [Created] (PIG-4343) Tez auto parallelism fails at query compile time

2014-11-24 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4343: -- Summary: Tez auto parallelism fails at query compile time Key: PIG-4343 URL: https://issues.apache.org/jira/browse/PIG-4343 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-4343) Tez auto parallelism fails at query compile time

2014-11-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223693#comment-14223693 ] Cheolsoo Park commented on PIG-4343: My workaround is to disable

[jira] [Commented] (PIG-4329) Fetch optimization should be disabled when limit is not pushed up

2014-11-13 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209996#comment-14209996 ] Cheolsoo Park commented on PIG-4329: +1. I'll commit it shortly. Thank you Lorand!

[jira] [Updated] (PIG-4329) Fetch optimization should be disabled when limit is not pushed up

2014-11-13 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4329: --- Resolution: Fixed Assignee: Lorand Bendig (was: Cheolsoo Park) Status: Resolved (was:

[jira] [Created] (PIG-4329) Fetch optimization should be disabled when limit is not pushed up

2014-11-12 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4329: -- Summary: Fetch optimization should be disabled when limit is not pushed up Key: PIG-4329 URL: https://issues.apache.org/jira/browse/PIG-4329 Project: Pig Issue

[jira] [Updated] (PIG-4329) Fetch optimization should be disabled when limit is not pushed up

2014-11-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4329: --- Description: Although PIG-4135 disable fetch optimization when there is no limit in the plan, that

[jira] [Updated] (PIG-4329) Fetch optimization should be disabled when limit is not pushed up

2014-11-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4329: --- Attachment: PIG-4329-1.patch Uploading a patch that disables fetch optimization when limit is not

[jira] [Updated] (PIG-4329) Fetch optimization should be disabled when limit is not pushed up

2014-11-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4329: --- Status: Patch Available (was: Open) Fetch optimization should be disabled when limit is not pushed up

[jira] [Updated] (PIG-3346) New property that controls the number of combined splits

2014-11-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3346: --- Attachment: PIG-3346-3.patch New property that controls the number of combined splits

[jira] [Reopened] (PIG-3346) New property that controls the number of combined splits

2014-11-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reopened PIG-3346: Reopening this issue as I ran into it again. I rebased my patch to trunk and added a new counter called

[jira] [Updated] (PIG-3346) New property that controls the number of combined splits

2014-11-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-3346: --- Fix Version/s: 0.15.0 New property that controls the number of combined splits

[jira] [Updated] (PIG-4298) Descending order-by is broken in some cases when key is bytearrays

2014-11-07 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4298: --- Resolution: Fixed Fix Version/s: (was: 0.15.0) 0.14.0 Status:

[jira] [Commented] (PIG-4298) Descending order-by is broken in some cases when key is bytearrays

2014-11-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201163#comment-14201163 ] Cheolsoo Park commented on PIG-4298: [~daijy], I think it goes to a different code path

[jira] [Commented] (PIG-4298) Descending order-by is broken in some cases when key is bytearrays

2014-11-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201262#comment-14201262 ] Cheolsoo Park commented on PIG-4298: Thanks Daniel! The new patch LGTM. Descending

[jira] [Created] (PIG-4298) Descending order-by is broken in some cases when key is bytearrays

2014-11-05 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4298: -- Summary: Descending order-by is broken in some cases when key is bytearrays Key: PIG-4298 URL: https://issues.apache.org/jira/browse/PIG-4298 Project: Pig

[jira] [Updated] (PIG-4298) Descending order-by is broken in some cases when key is bytearrays

2014-11-05 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4298: --- Description: Here is a repo script (using [PigPen|https://github.com/Netflix/PigPen] )- {code} REGISTER

[jira] [Updated] (PIG-4298) Descending order-by is broken in some cases when key is bytearrays

2014-11-05 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4298: --- Attachment: repo.tar.gz Uploading the repo script in case someone want to reproduce the error.

[jira] [Updated] (PIG-4241) Auto local mode mistakenly converts large jobs to local mode when using with Hive tables

2014-10-27 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4241: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thank you Daniel for reviewing.

[jira] [Commented] (PIG-2836) Namespace in Pig macros collides with Pig scripts

2014-10-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184558#comment-14184558 ] Cheolsoo Park commented on PIG-2836: [~eyal], did you try 0.13? I believe it's fixed by

[jira] [Updated] (PIG-4241) Auto local mode mistakenly converts large jobs to local mode when using with Hive tables

2014-10-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4241: --- Attachment: PIG-4241-3.patch {quote} Does all non-file-based job convert to auto local mode? {quote}

[jira] [Updated] (PIG-4247) S3 properties are not picked up from core-site.xml in local mode

2014-10-26 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4247: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Created] (PIG-4247) S3 properties are not picked up from core-site.xml in local mode

2014-10-23 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4247: -- Summary: S3 properties are not picked up from core-site.xml in local mode Key: PIG-4247 URL: https://issues.apache.org/jira/browse/PIG-4247 Project: Pig Issue

[jira] [Updated] (PIG-4247) S3 properties are not picked up from core-site.xml in local mode

2014-10-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4247: --- Attachment: PIG-4247-1.patch Uploading a patch that load s3-related properties from {{core-site.xml}}

[jira] [Updated] (PIG-4247) S3 properties are not picked up from core-site.xml in local mode

2014-10-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4247: --- Status: Patch Available (was: Open) S3 properties are not picked up from core-site.xml in local mode

[jira] [Updated] (PIG-4241) Auto local mode mistakenly converts large jobs to local mode when using with Hive tables

2014-10-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4241: --- Attachment: PIG-4241-2.patch Fixed {{TestInputSizeReducerEstimator}} in a new patch. Auto local mode

[jira] [Updated] (PIG-4241) Auto local mode mistakenly converts large jobs to local mode when using with Hive tables

2014-10-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4241: --- Attachment: PIG-4241-1.patch Attached patch includes the following changes- # When Hive table name is

[jira] [Updated] (PIG-4241) Auto local mode mistakenly converts large jobs to local mode when using with Hive tables

2014-10-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4241: --- Status: Patch Available (was: Open) Auto local mode mistakenly converts large jobs to local mode when

[jira] [Created] (PIG-4241) Auto local mode mistakenly converts large jobs to local mode when using with Hive tables

2014-10-16 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4241: -- Summary: Auto local mode mistakenly converts large jobs to local mode when using with Hive tables Key: PIG-4241 URL: https://issues.apache.org/jira/browse/PIG-4241

[jira] [Commented] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172620#comment-14172620 ] Cheolsoo Park commented on PIG-4227: [~daijy], sorry for breaking unit tests. {quote} I

[jira] [Commented] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172658#comment-14172658 ] Cheolsoo Park commented on PIG-4227: {quote} Otherwise we break python udf which do

[jira] [Commented] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172704#comment-14172704 ] Cheolsoo Park commented on PIG-4227: Yes, you're right. Streaming Python UDF handles

[jira] [Commented] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173238#comment-14173238 ] Cheolsoo Park commented on PIG-4227: Yes, it works! I haven't verified the broken tests,

[jira] [Assigned] (PIG-4231) Make rank work with Spark

2014-10-14 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4231: -- Assignee: Carlos Balduz Make rank work with Spark -

[jira] [Updated] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-11 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4227: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Commented] (PIG-4184) UDF backward compatibility issue after POStatus.STATUS_NULL refactory

2014-10-10 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167506#comment-14167506 ] Cheolsoo Park commented on PIG-4184: +1. I ran into this problem while using another

[jira] [Created] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-09 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4227: -- Summary: Streaming Python UDF handles bag outputs incorrectly Key: PIG-4227 URL: https://issues.apache.org/jira/browse/PIG-4227 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-09 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4227: --- Status: Patch Available (was: Open) Streaming Python UDF handles bag outputs incorrectly

[jira] [Updated] (PIG-4227) Streaming Python UDF handles bag outputs incorrectly

2014-10-09 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4227: --- Attachment: PIG-4227-1.patch Attaching a patch. Streaming Python UDF handles bag outputs incorrectly

[jira] [Resolved] (PIG-4225) Allow users to specify Python executable for Pig streaming

2014-10-09 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-4225. Resolution: Duplicate This is already fixed by PIG-4124. Allow users to specify Python executable

[jira] [Updated] (PIG-4183) Fix classpath error when using pig command with Spark

2014-09-17 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4183: --- Issue Type: Sub-task (was: Bug) Parent: PIG-4059 Fix classpath error when using pig command

[jira] [Assigned] (PIG-4168) Initial implementation of unit tests for Pig on Spark

2014-09-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4168: -- Assignee: liyunzhang_intel Assigning to Liyun. Initial implementation of unit tests for Pig on

[jira] [Assigned] (PIG-4131) Pig - kerberos error

2014-09-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4131: -- Assignee: liyunzhang_intel Pig - kerberos error Key:

[jira] [Updated] (PIG-4171) Streaming UDF fails when direct fetch optimization is enabled

2014-09-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4171: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Commented] (PIG-4128) New logical optimizer rule: ConstantCalculator

2014-09-16 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136539#comment-14136539 ] Cheolsoo Park commented on PIG-4128: [~daijy], I want to say thank you for this patch.

[jira] [Commented] (PIG-4104) Accumulator UDF throws OOM in Tez

2014-09-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134035#comment-14134035 ] Cheolsoo Park commented on PIG-4104: +1. My test passes. Thank you Rohini! Accumulator

[jira] [Created] (PIG-4171) Streaming UDF fails when direct fetch optimization is enabled

2014-09-15 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4171: -- Summary: Streaming UDF fails when direct fetch optimization is enabled Key: PIG-4171 URL: https://issues.apache.org/jira/browse/PIG-4171 Project: Pig Issue

[jira] [Updated] (PIG-4171) Streaming UDF fails when direct fetch optimization is enabled

2014-09-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4171: --- Attachment: PIG-4171-1.patch Uploading a patch. Streaming UDF fails when direct fetch optimization is

[jira] [Updated] (PIG-4171) Streaming UDF fails when direct fetch optimization is enabled

2014-09-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4171: --- Status: Patch Available (was: Open) Streaming UDF fails when direct fetch optimization is enabled

[jira] [Commented] (PIG-4170) Multiquery with different type of key gives wrong result

2014-09-15 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134972#comment-14134972 ] Cheolsoo Park commented on PIG-4170: +1 Multiquery with different type of key gives

[jira] [Commented] (PIG-4104) Accumulator UDF throws OOM in Tez

2014-09-14 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133450#comment-14133450 ] Cheolsoo Park commented on PIG-4104: [~rohini], yes sure. I am running my job now. Your

[jira] [Updated] (PIG-4169) NPE in ConstantCalculator

2014-09-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4169: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Daniel

[jira] [Updated] (PIG-4148) Tez order-by is often skewed because FindQuantiles UDF is called with small number

2014-09-08 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4148: --- Attachment: popackage.log generate_sample.py samples_logs.tar.gz

[jira] [Updated] (PIG-4148) Tez order-by is often skewed because FindQuantiles UDF is called with small number

2014-09-08 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4148: --- Attachment: metric_retention.explain I am also attaching the explain output of my job. To summarize, it

[jira] [Commented] (PIG-4148) Tez order-by is often skewed because FindQuantiles UDF is called with small number

2014-09-08 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125768#comment-14125768 ] Cheolsoo Park commented on PIG-4148: Another interesting observation is that all the

[jira] [Updated] (PIG-4159) TestGroupConstParallelTez and TestJobSubmissionTez should be excluded in Hadoop 20 unit tests

2014-09-08 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4159: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thank you Daniel

[jira] [Created] (PIG-4158) TestAssert is broken in trunk

2014-09-06 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created PIG-4158: -- Summary: TestAssert is broken in trunk Key: PIG-4158 URL: https://issues.apache.org/jira/browse/PIG-4158 Project: Pig Issue Type: Bug Reporter:

[jira] [Updated] (PIG-4159) TestGroupConstParallelTez and TestJobSubmissionTez should be excluded in Hadoop 20 unit tests

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4159: --- Attachment: PIG-4159-1.patch TestGroupConstParallelTez and TestJobSubmissionTez should be excluded in

[jira] [Updated] (PIG-4159) TestGroupConstParallelTez and TestJobSubmissionTez should be excluded in Hadoop 20 unit tests

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-4159: --- Status: Patch Available (was: Open) TestGroupConstParallelTez and TestJobSubmissionTez should be

[jira] [Commented] (PIG-4157) Pig compilation failure due to HIVE-7208

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124730#comment-14124730 ] Cheolsoo Park commented on PIG-4157: +1. Pig compilation failure due to HIVE-7208

[jira] [Assigned] (PIG-4084) Port TestPigRunner to Tez

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4084: -- Assignee: (was: Cheolsoo Park) Port TestPigRunner to Tez -

[jira] [Assigned] (PIG-4148) Tez order-by is often skewed because FindQuantiles UDF is called with small number

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4148: -- Assignee: (was: Cheolsoo Park) Tez order-by is often skewed because FindQuantiles UDF is

[jira] [Assigned] (PIG-4104) Accumulator UDF throws OOM in Tez

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-4104: -- Assignee: (was: Cheolsoo Park) Accumulator UDF throws OOM in Tez

[jira] [Assigned] (PIG-3948) Delete CompareFunc as it's deprecated

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park reassigned PIG-3948: -- Assignee: (was: Cheolsoo Park) Delete CompareFunc as it's deprecated

[jira] [Resolved] (PIG-3288) Kill jobs if the number of output files is over a configurable limit

2014-09-06 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3288. Resolution: Won't Fix Kill jobs if the number of output files is over a configurable limit

  1   2   3   4   5   6   7   8   9   10   >