[jira] Subscription: PIG patch available

2016-11-28 Thread jira
Issue Subscription Filter: PIG patch available (27 issues) Subscriber: pigdaily Key Summary PIG-4926Modify the content of start.xml for spark mode https://issues-test.apache.org/jira/browse/PIG-4926 PIG-4922Deadlock between SpillableMemoryManager and

[jira] Subscription: PIG patch available

2016-11-28 Thread jira
Issue Subscription Filter: PIG patch available (32 issues) Subscriber: pigdaily Key Summary PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput https://issues.apache.org/jira/browse/PIG-5057 PIG-5043Slowstart not applied in Tez with PARALLEL

[jira] [Comment Edited] (PIG-5054) Initialize SchemaTupleBackend correctly in backend in spark mode if spark job has more than 1 stage

2016-11-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704260#comment-15704260 ] liyunzhang_intel edited comment on PIG-5054 at 11/29/16 5:31 AM: - [~szita]:

[jira] [Commented] (PIG-5054) Initialize SchemaTupleBackend correctly in backend in spark mode if spark job has more than 1 stage

2016-11-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704260#comment-15704260 ] liyunzhang_intel commented on PIG-5054: --- [~szita]: from piglog, i found that all the spark tasks are

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

2016-11-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-5068: - Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

2016-11-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703844#comment-15703844 ] liyunzhang_intel commented on PIG-5068: --- [~xuefuz]: please commit PIG-5068_2.patch to branch. thanks!

[jira] [Updated] (PIG-5068) Set SPARK_REDUCERS by pig.properties not by system configuration

2016-11-28 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5068: -- Status: Patch Available (was: Open) > Set SPARK_REDUCERS by pig.properties not by system

Re: Contributing UDFs in Java to PiggyBank

2016-11-28 Thread Daniel Dai
You can create a Jira ticket and upload patches there. You can follow instruction in https://cwiki.apache.org/confluence/display/PIG/HowToContribute Thanks, Daniel On 11/22/16, 8:59 PM, "Ravi Annadanam" wrote: >Hi, > >I joined this forum newly to

[jira] [Commented] (PIG-3938) Add LoadCaster to EvalFunc(UDF)

2016-11-28 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702978#comment-15702978 ] Koji Noguchi commented on PIG-3938: --- bq. Else, check the loadcaster used for all the params passed and see

[jira] [Commented] (PIG-5067) Revisit union on numeric type and chararray to bytearray

2016-11-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702964#comment-15702964 ] Daniel Dai commented on PIG-5067: - We shall mark it a backward incompatible change and document how to fix

[jira] [Commented] (PIG-5054) Initialize SchemaTupleBackend correctly in backend in spark mode if spark job has more than 1 stage

2016-11-28 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701856#comment-15701856 ] Adam Szita commented on PIG-5054: - [~kellyzly] I can't reproduce this even in yarn mode. I checked out pig

[jira] [Updated] (PIG-5054) Initialize SchemaTupleBackend correctly in backend in spark mode if spark job has more than 1 stage

2016-11-28 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5054: Attachment: script.pig piglog > Initialize SchemaTupleBackend correctly in backend in spark

[jira] [Comment Edited] (PIG-4899) The number of records of input file is calculated wrongly in spark mode in multiquery case

2016-11-28 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701500#comment-15701500 ] Adam Szita edited comment on PIG-4899 at 11/28/16 10:02 AM: Uploaded new patch

[jira] [Commented] (PIG-4899) The number of records of input file is calculated wrongly in spark mode in multiquery case

2016-11-28 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701500#comment-15701500 ] Adam Szita commented on PIG-4899: - Uploaded new patch [^PIG-4899.3IncrFrom2.patch] that has a different

[jira] [Updated] (PIG-4899) The number of records of input file is calculated wrongly in spark mode in multiquery case

2016-11-28 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-4899: Attachment: PIG-4899.3IncrFrom2.patch > The number of records of input file is calculated wrongly in spark

[jira] [Reopened] (PIG-4899) The number of records of input file is calculated wrongly in spark mode in multiquery case

2016-11-28 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita reopened PIG-4899: - [^PIG-4899.2.patch] introduced an issue. When running in yarn-client mode, we'd get NullPointerExceptions in

[jira] [Commented] (PIG-5069) Skewed Join is crashing job

2016-11-28 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701371#comment-15701371 ] Nandor Kollar commented on PIG-5069: It looks similar to PIG-3417. I took a look at that issue, and it