[jira] [Updated] (PIG-4903) Avoid add all spark dependency jars to SPARK_YARN_DIST_FILES and SPARK_DIST_CLASSPATH

2016-06-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4903: -- Attachment: PIG-4903_1.patch [~rohini]: I have submitted PIG-4903_1.patch. In this patch, it

Re: Is there any code style check tool in pig project?

2016-06-01 Thread Daniel Dai
There is an ant target “checkstyle”. But we didn’t enforce it for a long time. The only formatting we consistently check is don’t use tab, use space. Thanks, Daniel On 6/1/16, 7:59 PM, "Zhang, Liyun" wrote: > >Hi all: > Now I'm doing the merge work of spark branch,

[jira] [Updated] (PIG-4919) Upgrade spark.version to 1.6.1

2016-06-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-4919: -- Attachment: PIG-4919.patch Changes in PIG-4919.patch 1. upgrade spark.version to 1.6.1 2. upgrade

[jira] [Created] (PIG-4919) Upgrade spark.version to 1.6.1

2016-06-01 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-4919: - Summary: Upgrade spark.version to 1.6.1 Key: PIG-4919 URL: https://issues.apache.org/jira/browse/PIG-4919 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-4916) Pig on Tez fail to remove temporary HDFS files in some cases

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311391#comment-15311391 ] Chris Nauroth commented on PIG-4916: Hello [~daijy]. Thank you for the patch. +1 (non-binding) from

[jira] [Updated] (PIG-4918) Pig on Tez cannot switch pig.temp.dir to another fs

2016-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4918: Status: Patch Available (was: Open) Don't find an easy way to write a test since we need different fs to

[jira] [Updated] (PIG-4918) Pig on Tez cannot switch pig.temp.dir to another fs

2016-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4918: Attachment: PIG-4918-1.patch > Pig on Tez cannot switch pig.temp.dir to another fs >

[jira] [Created] (PIG-4918) Pig on Tez cannot switch pig.temp.dir to another fs

2016-06-01 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4918: --- Summary: Pig on Tez cannot switch pig.temp.dir to another fs Key: PIG-4918 URL: https://issues.apache.org/jira/browse/PIG-4918 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4916) Pig on Tez fail to remove temporary HDFS files in some cases

2016-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4916: Status: Patch Available (was: Open) I don't see a way to write a test case since this is non-deterministic

[jira] [Updated] (PIG-4916) Pig on Tez fail to remove temporary HDFS files in some cases

2016-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4916: Attachment: PIG-4916-1.patch > Pig on Tez fail to remove temporary HDFS files in some cases >

[jira] [Created] (PIG-4916) Pig on Tez fail to remove temporary HDFS files in some cases

2016-06-01 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4916: --- Summary: Pig on Tez fail to remove temporary HDFS files in some cases Key: PIG-4916 URL: https://issues.apache.org/jira/browse/PIG-4916 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-2315) Make as clause work in generate

2016-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311296#comment-15311296 ] Daniel Dai commented on PIG-2315: - +1. Also note there is a performance regression in some cases. For

[jira] [Commented] (PIG-4903) Avoid add all spark dependency jars to SPARK_YARN_DIST_FILES and SPARK_DIST_CLASSPATH

2016-06-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311028#comment-15311028 ] Rohini Palaniswamy commented on PIG-4903: - Please refer to my comment in

Jenkins build is still unstable: Pig-trunk-commit #2339

2016-06-01 Thread Apache Jenkins Server
See

[jira] [Commented] (PIG-4893) Task deserialization time is too long for spark on yarn mode

2016-06-01 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311013#comment-15311013 ] Rohini Palaniswamy commented on PIG-4893: - You should have the spark jars in global hdfs location

[jira] [Created] (PIG-4915) Eliminate duplicate split calculation for Order by and Skewed Join

2016-06-01 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-4915: --- Summary: Eliminate duplicate split calculation for Order by and Skewed Join Key: PIG-4915 URL: https://issues.apache.org/jira/browse/PIG-4915 Project: Pig

Re: please unsubscribe

2016-06-01 Thread Alan Gates
To unsubscribe send email to dev-unsubscr...@pig.apache.org Alan. > On Jun 1, 2016, at 07:40, asser dennis wrote: > >

please unsubscribe

2016-06-01 Thread asser dennis

[jira] [Resolved] (PIG-4898) Fix unit test failure after PIG-4771's patch was checked in

2016-06-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved PIG-4898. -- Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Fix unit test failure after PIG-4771's

[jira] [Commented] (PIG-4893) Task deserialization time is too long for spark on yarn mode

2016-06-01 Thread Pallavi Rao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310108#comment-15310108 ] Pallavi Rao commented on PIG-4893: -- +1 for addressing this. When I had noticed this problem, one way I

Build failed in Jenkins: Pig-trunk #1917

2016-06-01 Thread Apache Jenkins Server
See Changes: [daijy] PIG-4719: Documentation for PIG-4704: Customizable Error Handling for Storers in Pig [rohini] PIG-4821: Pig chararray field with special UTF-8 chars as part of tuple join key produces wrong results in Tez (rohini)

[jira] [Commented] (PIG-4893) Task deserialization time is too long for spark on yarn mode

2016-06-01 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309940#comment-15309940 ] liyunzhang_intel commented on PIG-4893: --- Here summary the reason why task deserialization time is too

Jenkins build is still unstable: Pig-trunk-commit #2338

2016-06-01 Thread Apache Jenkins Server
See

unsuscribe

2016-06-01 Thread GUILLERMO GARRIDO YUSTE
unsuscribe

[jira] [Updated] (PIG-4719) Documentation for PIG-4704: Customizable Error Handling for Storers in Pig

2016-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4719: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 Status: Resolved (was: