[jira] [Updated] (PIG-626) Statistics (records read by each mapper and reducer)

2014-06-18 Thread Maximus (JIRA)
[ https://issues.apache.org/jira/browse/PIG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximus updated PIG-626: Description: This uses (lalala) the counters framework that hadoop has. Initially, I am just interested in finding

[jira] [Created] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
Travis Woodruff created PIG-4018: Summary: Schema validation fails with UNION ONSCHEMA Key: PIG-4018 URL: https://issues.apache.org/jira/browse/PIG-4018 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Affects Version/s: 0.13.0 Schema validation fails with UNION ONSCHEMA

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Attachment: PIG-4018.patch This is an attempt at a patch. It moves UnionOnSchemaSetter above

[jira] [Updated] (PIG-4018) Schema validation fails with UNION ONSCHEMA

2014-06-18 Thread Travis Woodruff (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Woodruff updated PIG-4018: - Status: Patch Available (was: Open) Schema validation fails with UNION ONSCHEMA

[jira] [Created] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4019: --- Summary: Compilation broken after TEZ-1169 Key: PIG-4019 URL: https://issues.apache.org/jira/browse/PIG-4019 Project: Pig Issue Type: Bug Components: tez

[jira] [Updated] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4019: Attachment: PIG-4019-1.patch Compilation broken after TEZ-1169 -

[jira] [Created] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4020: --- Summary: Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7] Key: PIG-4020 URL: https://issues.apache.org/jira/browse/PIG-4020 Project: Pig Issue Type:

[jira] [Updated] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4020: Attachment: PIG-4020-1.patch Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

[jira] [Resolved] (PIG-4015) Provide a way to disable auto-parallism in tez

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4015. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review!

[jira] [Commented] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036154#comment-14036154 ] Alan Gates commented on PIG-4019: - +1 Compilation broken after TEZ-1169

[jira] [Resolved] (PIG-4019) Compilation broken after TEZ-1169

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4019. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Alan for review!

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036208#comment-14036208 ] Rohini Palaniswamy commented on PIG-4020: - Can you explain the failure root cause

[jira] [Commented] (PIG-4001) POPartialAgg aggregates too aggressively when multiple values aggregated

2014-06-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036254#comment-14036254 ] Cheolsoo Park commented on PIG-4001: +1. Will commit this later today. POPartialAgg

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036346#comment-14036346 ] Daniel Dai commented on PIG-4020: - In short, processInput() in MR will not result

[jira] [Commented] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036348#comment-14036348 ] Rohini Palaniswamy commented on PIG-4020: - +1 Fix tez e2e tests

[jira] [Resolved] (PIG-4020) Fix tez e2e tests MapPartialAgg_[2-4], StreamingPerformance_[6-7]

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4020. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Rohini for review! Fix

Trevni file format

2014-06-18 Thread Rohini Palaniswamy
Does Trevni as file format has some traction and used by anyone in production? Linkedin possibly? Since Cloudera is now supporting Parquet was wondering what is the state of Trevni. If Trevni is being deprecated in favor of Parquet we should deprecate our TrevniStorage as well sometime. Regards,

[jira] [Created] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4021: --- Summary: Fix TestHBaseStorage failure after auto local mode change (PIG-3463) Key: PIG-4021 URL: https://issues.apache.org/jira/browse/PIG-4021 Project: Pig Issue

[jira] [Commented] (PIG-3000) Optimize nested foreach

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036599#comment-14036599 ] Mona Chitnis commented on PIG-3000: --- thanks for taking a peek Daniel. I will rebase my

[jira] [Commented] (PIG-4021) Fix TestHBaseStorage failure after auto local mode change (PIG-3463)

2014-06-18 Thread Aniket Mokashi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036714#comment-14036714 ] Aniket Mokashi commented on PIG-4021: - I do not know why it should not. I may have also

[jira] [Assigned] (PIG-3972) java.lang.IndexOutOfBoundsException when flatten meets an empty row

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis reassigned PIG-3972: - Assignee: Mona Chitnis java.lang.IndexOutOfBoundsException when flatten meets an empty row

[jira] [Updated] (PIG-3972) java.lang.IndexOutOfBoundsException when flatten meets an empty row

2014-06-18 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis updated PIG-3972: -- Affects Version/s: 0.13.0 0.12.0 java.lang.IndexOutOfBoundsException when

[jira] Subscription: PIG patch available

2014-06-18 Thread jira
Issue Subscription Filter: PIG patch available (16 issues) Subscriber: pigdaily Key Summary PIG-4018Schema validation fails with UNION ONSCHEMA https://issues.apache.org/jira/browse/PIG-4018 PIG-4008Pig code change to enable Tez Local mode

[jira] [Assigned] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-4005: --- Assignee: Daniel Dai depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when

[jira] [Created] (PIG-4022) Fix tez e2e test SkewedJoin_6

2014-06-18 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4022: --- Summary: Fix tez e2e test SkewedJoin_6 Key: PIG-4022 URL: https://issues.apache.org/jira/browse/PIG-4022 Project: Pig Issue Type: Bug Components: tez

[jira] [Commented] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036854#comment-14036854 ] Anup Ahire commented on PIG-4023: - I can provide a patch BigDec/Int sort is broken

[jira] [Created] (PIG-4023) BigDec/Int sort is broken

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4023: --- Summary: BigDec/Int sort is broken Key: PIG-4023 URL: https://issues.apache.org/jira/browse/PIG-4023 Project: Pig Issue Type: Bug Affects Versions: 0.12.0

[jira] [Created] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4025: --- Summary: TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK Key: PIG-4025 URL:

[jira] [Created] (PIG-4024) TestPigStreamingUDF and TestPigStreaming fail on IBM JDK.

2014-06-18 Thread Anup Ahire (JIRA)
Anup Ahire created PIG-4024: --- Summary: TestPigStreamingUDF and TestPigStreaming fail on IBM JDK. Key: PIG-4024 URL: https://issues.apache.org/jira/browse/PIG-4024 Project: Pig Issue Type:

[jira] [Updated] (PIG-4025) TestLoadFuncWrapper, TestLoadFuncMetaDataWrapper,TestStoreFuncWrapper and TestStoreFuncMetadataWrapper fail on IBM JDK

2014-06-18 Thread Anup Ahire (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anup Ahire updated PIG-4025: Description: Method positioning on stack strace in IBM jdk is different which makes these tests fail . we

[jira] [Updated] (PIG-4005) depend on hbase-hadoop2-compat rather than hbase-hadoop1-compat when hbaseversion is 95

2014-06-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4005: Attachment: PIG-4005-1.patch Attach patch. Also change default hbaseversion to 95 since it has been out for