[jira] [Commented] (PIG-5277) Spark mode is writing nulls among tuples to the output

2017-08-02 Thread Rohini Palaniswamy (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112199#comment-16112199
 ] 

Rohini Palaniswamy commented on PIG-5277:
-

Not a Spark expert. So do not have any suggestions. 

If 3 or 4 is not possible, I would rather prefer approach 2. It is better to 
avoid writing garbage into file than try and skip while reading.

> Spark mode is writing nulls among tuples to the output 
> ---
>
> Key: PIG-5277
> URL: https://issues.apache.org/jira/browse/PIG-5277
> Project: Pig
>  Issue Type: Bug
>  Components: spark
>Reporter: Adam Szita
>Assignee: Adam Szita
>
> After committing PIG-3655 a couple of Spark mode tests (e.g. 
> org.apache.pig.test.TestEvalPipeline.testCogroupAfterDistinct) started 
> failing on:
> {code}
> java.lang.Error: java.io.IOException: Corrupt data file, expected tuple type 
> byte, but seen 27
>   at 
> org.apache.pig.backend.hadoop.executionengine.HJob$1.hasNext(HJob.java:122)
>   at 
> org.apache.pig.test.TestEvalPipeline.testCogroupAfterDistinct(TestEvalPipeline.java:1052)
> Caused by: java.io.IOException: Corrupt data file, expected tuple type byte, 
> but seen 27
>   at 
> org.apache.pig.impl.io.InterRecordReader.readDataOrEOF(InterRecordReader.java:158)
>   at 
> org.apache.pig.impl.io.InterRecordReader.nextKeyValue(InterRecordReader.java:194)
>   at org.apache.pig.impl.io.InterStorage.getNext(InterStorage.java:79)
>   at 
> org.apache.pig.impl.io.ReadToEndLoader.getNextHelper(ReadToEndLoader.java:238)
>   at 
> org.apache.pig.impl.io.ReadToEndLoader.getNext(ReadToEndLoader.java:218)
>   at 
> org.apache.pig.backend.hadoop.executionengine.HJob$1.hasNext(HJob.java:115)
> {code}
> This is because InterRecordReader became much stricter after PIG-3655. Before 
> it just simply skipped these bytes thinking that they are just garbage on the 
> split beginning. Now when we expect a [proper tuple with a tuple type 
> byte|https://github.com/apache/pig/blob/trunk/src/org/apache/pig/impl/io/InterRecordReader.java#L153]
>  we see these nulls and throw an Exception.
> As I can see it this is happening because JoinGroupSparkConverter has to 
> return something even when it shouldn't.
> When the POPackage operator returns a 
> [POStatus.STATUS_NULL|https://github.com/apache/pig/blob/trunk/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/JoinGroupSparkConverter.java#L211],
>  the converter shouldn't return a thing, but it can't do better than 
> returning a null. This then gets written out by Spark..



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5282) Upgade to Java 8

2017-08-02 Thread Rohini Palaniswamy (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112189#comment-16112189
 ] 

Rohini Palaniswamy commented on PIG-5282:
-

Sure. We have been running with Java 8 for years now. Would be good to compile 
with Java 8 as well. Things like adding method to interface will become easier.

> Upgade to Java 8
> 
>
> Key: PIG-5282
> URL: https://issues.apache.org/jira/browse/PIG-5282
> Project: Pig
>  Issue Type: Improvement
>Reporter: Nandor Kollar
> Fix For: 0.18.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (PIG-2595) BinCond only works inside parentheses

2017-08-02 Thread Weijun Qian (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Weijun Qian reassigned PIG-2595:


Assignee: Weijun Qian

> BinCond only works inside parentheses
> -
>
> Key: PIG-2595
> URL: https://issues.apache.org/jira/browse/PIG-2595
> Project: Pig
>  Issue Type: Bug
>Reporter: Daniel Dai
>Assignee: Weijun Qian
> Fix For: 0.18.0
>
>
> Not sure if we have a Jira for this before. This script does not work:
> {code}
> a = load '/user/pig/tests/data/singlefile/studenttab10k' using PigStorage() 
> as (name, age:int, gpa:double, instate:chararray);
> b = foreach a generate name, instate=='true'?gpa:gpa+1;
> dump b;
> {code}
> If we put bincond into parentheses, it works
> {code}
> a = load '/user/pig/tests/data/singlefile/studenttab10k' using PigStorage() 
> as (name, age:int, gpa:double, instate:chararray);
> b = foreach a generate name, (instate=='true'?gpa:gpa+1);
> dump b;
> {code}
> Exception:
> ERROR 1200:   mismatched input '==' expecting 
> SEMI_COLON
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1000: Error during 
> parsing.   mismatched input '==' expecting 
> SEMI_COLON
> at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1598)
> at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1541)
> at org.apache.pig.PigServer.registerQuery(PigServer.java:541)
> at 
> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:945)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:392)
> at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:190)
> at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:166)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
> at org.apache.pig.Main.run(Main.java:599)
> at org.apache.pig.Main.main(Main.java:153)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: Failed to parse:   mismatched 
> input '==' expecting SEMI_COLON
> at 
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:226)
> at 
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:168)
> at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1590)
> ... 14 more



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5254) Hit Ctrl-D to quit grunt shell fail

2017-08-02 Thread Weijun Qian (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Weijun Qian updated PIG-5254:
-
Attachment: PIG-5254.patch

> Hit Ctrl-D to quit grunt shell fail
> ---
>
> Key: PIG-5254
> URL: https://issues.apache.org/jira/browse/PIG-5254
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.18.0, 0.17.1
>Reporter: Daniel Dai
>Assignee: Weijun Qian
> Fix For: 0.18.0, 0.17.1
>
> Attachments: PIG-5254.patch
>
>
> Exception:
> {code}
> java.lang.NullPointerException
> at 
> org.apache.pig.tools.grunt.ConsoleReaderInputStream$ConsoleLineInputStream.read(ConsoleReaderInputStream.java:107)
> at java.io.InputStream.read(InputStream.java:170)
> at java.io.SequenceInputStream.read(SequenceInputStream.java:207)
> at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
> at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
> at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
> at java.io.InputStreamReader.read(InputStreamReader.java:184)
> at java.io.BufferedReader.fill(BufferedReader.java:161)
> at java.io.BufferedReader.read1(BufferedReader.java:212)
> at java.io.BufferedReader.read(BufferedReader.java:286)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.FillBuff(JavaCharStream.java:143)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.ReadByte(JavaCharStream.java:171)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.readChar(JavaCharStream.java:274)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.BeginToken(JavaCharStream.java:193)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParserTokenManager.getNextToken(PigScriptParserTokenManager.java:3215)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.jj_ntk(PigScriptParser.java:1511)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:117)
> at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
> at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
> at org.apache.pig.Main.run(Main.java:564)
> at org.apache.pig.Main.main(Main.java:175)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5254) Hit Ctrl-D to quit grunt shell fail

2017-08-02 Thread Weijun Qian (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Weijun Qian updated PIG-5254:
-
Affects Version/s: 0.17.1
   0.18.0
 Tags: PIG-5254
   Status: Patch Available  (was: Open)

Cause:
When hit Ctrl + D in grunt shell, the method ConsoleLineInputStream.read() in 
ConsoleReaderInputStream.java will call reader.readline(), which will return 
null. In this case, if we use the null to call getBytes(), it will throw a 
NullPointerException.

Solution:
Define a temporary String buff to store the return value from 
reader.readline(), check if it is null(the reason why it returns null could be 
found in jline.console.ConsoleReader.readLine()), if yes, assign "quit" to the 
temp buff, and then it will function as if we input a quit in the console.

Possible Improvement: There do exist a EOF token, a quit() hook in 
PigScriptParser.jj, and a corresponding case of EOF could also be found in 
PigScriptParser.java, however the process of converting a bytestream we get 
from ConsoleLineInputStream to a token recognizable by PigScriptParser is not 
clear(relates to a bunch of java.io files). If we can figure out how it works, 
we may resolve this problem in a more elegant way.
https://issues.apache.org/jira/browse/PIG-5254

> Hit Ctrl-D to quit grunt shell fail
> ---
>
> Key: PIG-5254
> URL: https://issues.apache.org/jira/browse/PIG-5254
> Project: Pig
>  Issue Type: Bug
>  Components: impl
>Affects Versions: 0.18.0, 0.17.1
>Reporter: Daniel Dai
>Assignee: Weijun Qian
> Fix For: 0.18.0, 0.17.1
>
>
> Exception:
> {code}
> java.lang.NullPointerException
> at 
> org.apache.pig.tools.grunt.ConsoleReaderInputStream$ConsoleLineInputStream.read(ConsoleReaderInputStream.java:107)
> at java.io.InputStream.read(InputStream.java:170)
> at java.io.SequenceInputStream.read(SequenceInputStream.java:207)
> at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
> at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
> at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
> at java.io.InputStreamReader.read(InputStreamReader.java:184)
> at java.io.BufferedReader.fill(BufferedReader.java:161)
> at java.io.BufferedReader.read1(BufferedReader.java:212)
> at java.io.BufferedReader.read(BufferedReader.java:286)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.FillBuff(JavaCharStream.java:143)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.ReadByte(JavaCharStream.java:171)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.readChar(JavaCharStream.java:274)
> at 
> org.apache.pig.tools.pigscript.parser.JavaCharStream.BeginToken(JavaCharStream.java:193)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParserTokenManager.getNextToken(PigScriptParserTokenManager.java:3215)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.jj_ntk(PigScriptParser.java:1511)
> at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:117)
> at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:230)
> at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:66)
> at org.apache.pig.Main.run(Main.java:564)
> at org.apache.pig.Main.main(Main.java:175)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Jenkins build is unstable: Pig-trunk-commit #2523

2017-08-02 Thread Apache Jenkins Server 
See

[jira] [Commented] (PIG-5282) Upgade to Java 8

2017-08-02 Thread Daniel Dai (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111280#comment-16111280
 ] 

Daniel Dai commented on PIG-5282:
-

I don't have problem for that. Hive already move to JDK 8 and we can follow.

> Upgade to Java 8
> 
>
> Key: PIG-5282
> URL: https://issues.apache.org/jira/browse/PIG-5282
> Project: Pig
>  Issue Type: Improvement
>Reporter: Nandor Kollar
> Fix For: 0.18.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5191) Pig HBase 2.0.0 support

2017-08-02 Thread Nandor Kollar (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111245#comment-16111245
 ] 

Nandor Kollar commented on PIG-5191:


Actually looks like replacing the deprecated API calls is sufficient, using the 
non-deprecated alternatives is compatible both with HBase 1.x and 2.x APIs.

> Pig HBase 2.0.0 support
> ---
>
> Key: PIG-5191
> URL: https://issues.apache.org/jira/browse/PIG-5191
> Project: Pig
>  Issue Type: Improvement
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5191_1.patch
>
>
> Pig doesn't support HBase 2.0.0. Since the new HBase API introduces several 
> API changes, we should find a way to support both 1.x and 2.x HBase API.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5191) Pig HBase 2.0.0 support

2017-08-02 Thread Nandor Kollar (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5191:
---
Attachment: PIG-5191_1.patch

> Pig HBase 2.0.0 support
> ---
>
> Key: PIG-5191
> URL: https://issues.apache.org/jira/browse/PIG-5191
> Project: Pig
>  Issue Type: Improvement
>Reporter: Nandor Kollar
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5191_1.patch
>
>
> Pig doesn't support HBase 2.0.0. Since the new HBase API introduces several 
> API changes, we should find a way to support both 1.x and 2.x HBase API.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-02 Thread Adam Szita (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5283:

Status: Patch Available  (was: Open)

> Configuration is not passed to SparkPigSplits on the backend
> 
>
> Key: PIG-5283
> URL: https://issues.apache.org/jira/browse/PIG-5283
> Project: Pig
>  Issue Type: Bug
>  Components: spark
>Reporter: Adam Szita
>Assignee: Adam Szita
> Attachments: PIG-5283.0.patch
>
>
> When a Hadoop ObjectWritable is created during a Spark job, the instantiated 
> PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration 
> instance.
> This happens 
> [here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-02 Thread Adam Szita (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111076#comment-16111076
 ] 

Adam Szita commented on PIG-5283:
-

I propose we make use of SparkPigSplit and write the conf along with the split 
as seen in: [^PIG-5283.0.patch]
[~kellyzly], [~nkollar] let me know what you think

> Configuration is not passed to SparkPigSplits on the backend
> 
>
> Key: PIG-5283
> URL: https://issues.apache.org/jira/browse/PIG-5283
> Project: Pig
>  Issue Type: Bug
>  Components: spark
>Reporter: Adam Szita
>Assignee: Adam Szita
> Attachments: PIG-5283.0.patch
>
>
> When a Hadoop ObjectWritable is created during a Spark job, the instantiated 
> PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration 
> instance.
> This happens 
> [here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-02 Thread Adam Szita (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5283:

Attachment: PIG-5283.0.patch

> Configuration is not passed to SparkPigSplits on the backend
> 
>
> Key: PIG-5283
> URL: https://issues.apache.org/jira/browse/PIG-5283
> Project: Pig
>  Issue Type: Bug
>  Components: spark
>Reporter: Adam Szita
>Assignee: Adam Szita
> Attachments: PIG-5283.0.patch
>
>
> When a Hadoop ObjectWritable is created during a Spark job, the instantiated 
> PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration 
> instance.
> This happens 
> [here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-02 Thread Adam Szita (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5283:

Attachment: (was: PIG-5283.0.patch)

> Configuration is not passed to SparkPigSplits on the backend
> 
>
> Key: PIG-5283
> URL: https://issues.apache.org/jira/browse/PIG-5283
> Project: Pig
>  Issue Type: Bug
>  Components: spark
>Reporter: Adam Szita
>Assignee: Adam Szita
>
> When a Hadoop ObjectWritable is created during a Spark job, the instantiated 
> PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration 
> instance.
> This happens 
> [here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-02 Thread Adam Szita (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5283:

Attachment: PIG-5283.0.patch

> Configuration is not passed to SparkPigSplits on the backend
> 
>
> Key: PIG-5283
> URL: https://issues.apache.org/jira/browse/PIG-5283
> Project: Pig
>  Issue Type: Bug
>  Components: spark
>Reporter: Adam Szita
>Assignee: Adam Szita
> Attachments: PIG-5283.0.patch
>
>
> When a Hadoop ObjectWritable is created during a Spark job, the instantiated 
> PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration 
> instance.
> This happens 
> [here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (PIG-5283) Configuration is not passed to SparkPigSplits on the backend

2017-08-02 Thread Adam Szita (JIRA) 
Adam Szita created PIG-5283:
---

 Summary: Configuration is not passed to SparkPigSplits on the 
backend
 Key: PIG-5283
 URL: https://issues.apache.org/jira/browse/PIG-5283
 Project: Pig
  Issue Type: Bug
  Components: spark
Reporter: Adam Szita
Assignee: Adam Szita


When a Hadoop ObjectWritable is created during a Spark job, the instantiated 
PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration 
instance.
This happens 
[here|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SerializableWritable.scala#L44]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5282) Upgade to Java 8

2017-08-02 Thread Nandor Kollar (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111004#comment-16111004
 ] 

Nandor Kollar commented on PIG-5282:


It seems that HBase 2.0 and Hadoop 3 requires Java 8, and Java 7 is close to 
EOL, we should upgrade to Java 8. [~rohini], [~daijy] what do you think?

> Upgade to Java 8
> 
>
> Key: PIG-5282
> URL: https://issues.apache.org/jira/browse/PIG-5282
> Project: Pig
>  Issue Type: Improvement
>Reporter: Nandor Kollar
> Fix For: 0.18.0
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (PIG-5282) Upgade to Java 8

2017-08-02 Thread Nandor Kollar (JIRA) 
Nandor Kollar created PIG-5282:
--

 Summary: Upgade to Java 8
 Key: PIG-5282
 URL: https://issues.apache.org/jira/browse/PIG-5282
 Project: Pig
  Issue Type: Improvement
Reporter: Nandor Kollar
 Fix For: 0.18.0






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Rohini Palaniswamy (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rohini Palaniswamy updated PIG-5278:

  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

+1. Committed to trunk.

> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5264_2.patch, PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5278:
---
Status: Patch Available  (was: Open)

> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5264_2.patch, PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Rohini Palaniswamy (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110779#comment-16110779
 ] 

Rohini Palaniswamy commented on PIG-5278:
-

bq.also what do we need to get the usual build working again?
 Fixed it. Changed JDK (dropdown in Jenkins Configure) to JDK 1.8 (latest) from 
OpenJDK 7 (on Ubuntu only) and removed export JAVA_HOME

{code}
echo "JAVA_HOME: ${JAVA_HOME}"
#export 
JAVA_HOME=/home/jenkins/jenkins-slave/workspace/Pig-trunk-commit/java-8-openjdk-amd64
{code} 

{code}
JAVA_HOME: /home/jenkins/tools/java/latest1.8
{code}

Also removed -Djava5.home=$JAVA5_HOME which is not defined in code anywhere.

> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5264_2.patch, PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110771#comment-16110771
 ] 

Nandor Kollar commented on PIG-5278:


[~rohini] thanks, added the tests to the excludes files, and created two 
separate Jira to implement auto local mode for Spark and Tez

> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5264_2.patch, PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5278:
---
Attachment: PIG-5264_2.patch

> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5264_2.patch, PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Build failed in Jenkins: Pig-trunk-commit #2522

2017-08-02 Thread Apache Jenkins Server 
See 

--
[...truncated 183.00 KB...]
A src/org/apache/pig/impl/util/TupleFormat.java
A src/org/apache/pig/impl/util/StorageUtil.java
A src/org/apache/pig/impl/util/BagFormat.java
A src/org/apache/pig/impl/util/LogUtils.java
A src/org/apache/pig/impl/util/orc
A src/org/apache/pig/impl/util/UDFContextSeparator.java
A src/org/apache/pig/impl/util/LineageTracer.java
A src/org/apache/pig/impl/util/Spillable.java
A src/org/apache/pig/impl/util/JarManager.java
A src/org/apache/pig/impl/PigImplConstants.java
A src/org/apache/pig/ExceptionalFunction.java
A src/org/apache/pig/LoadPredicatePushdown.java
A src/org/apache/pig/StaticDataCleanup.java
A src/org/apache/pig/data
A src/org/apache/pig/data/TupleMaker.java
A src/org/apache/pig/data/SchemaTuple.java
A src/org/apache/pig/data/InternalMap.java
A src/org/apache/pig/data/DataType.java
A src/org/apache/pig/data/TypeAwareTuple.java
A src/org/apache/pig/data/AbstractTuple.java
A src/org/apache/pig/data/InternalCachedBag.java
A src/org/apache/pig/data/utils
A src/org/apache/pig/data/utils/MethodHelper.java
A src/org/apache/pig/data/utils/SedesHelper.java
A src/org/apache/pig/data/utils/StructuresHelper.java
A src/org/apache/pig/data/utils/BytesHelper.java
A src/org/apache/pig/data/BagFactory.java
A src/org/apache/pig/data/TupleFactory.java
A src/org/apache/pig/data/AmendableTuple.java
A src/org/apache/pig/data/DistinctDataBag.java
A src/org/apache/pig/data/NonSpillableDataBag.java
A src/org/apache/pig/data/DefaultTupleFactory.java
A src/org/apache/pig/data/DefaultBagFactory.java
A src/org/apache/pig/data/TimestampedTuple.java
A src/org/apache/pig/data/InternalDistinctBag.java
A src/org/apache/pig/data/DefaultDataBag.java
A src/org/apache/pig/data/DataReaderWriter.java
A src/org/apache/pig/data/ReadOnceBag.java
A src/org/apache/pig/data/TupleRawComparator.java
A src/org/apache/pig/data/DataByteArray.java
A src/org/apache/pig/data/InterSedesFactory.java
A src/org/apache/pig/data/DefaultTuple.java
A src/org/apache/pig/data/SortedDataBag.java
A src/org/apache/pig/data/SchemaTupleClassGenerator.java
A src/org/apache/pig/data/InternalSortedBag.java
A src/org/apache/pig/data/SizeUtil.java
A src/org/apache/pig/data/TargetedTuple.java
A src/org/apache/pig/data/SchemaTupleFrontend.java
A src/org/apache/pig/data/FileList.java
A src/org/apache/pig/data/LimitedSortedDataBag.java
A src/org/apache/pig/data/package.html
A src/org/apache/pig/data/SortedSpillBag.java
A src/org/apache/pig/data/DefaultAbstractBag.java
A src/org/apache/pig/data/SchemaTupleBackend.java
A src/org/apache/pig/data/DataBag.java
A src/org/apache/pig/data/AppendableSchemaTuple.java
A src/org/apache/pig/data/Tuple.java
A src/org/apache/pig/data/FieldIsNullException.java
A src/org/apache/pig/data/WritableByteArray.java
A src/org/apache/pig/data/AccumulativeBag.java
A src/org/apache/pig/data/BinSedesTupleFactory.java
A src/org/apache/pig/data/BinInterSedes.java
A src/org/apache/pig/data/UnlimitedNullTuple.java
A src/org/apache/pig/data/SchemaTupleFactory.java
A src/org/apache/pig/data/InterSedes.java
A src/org/apache/pig/data/SingleTupleBag.java
A src/org/apache/pig/data/BinSedesTuple.java
A src/org/apache/pig/data/SelfSpillBag.java
A src/docs
A src/docs/forrest.properties.xml
A src/docs/forrest.properties
A src/docs/forrest.properties.dispatcher.properties
A src/docs/jdiff
A src/docs/jdiff/pig_0.17.0.xml
A src/docs/src
A src/docs/src/documentation
A src/docs/src/documentation/skinconf.xml
A src/docs/src/documentation/content
A src/docs/src/documentation/content/xdocs
A src/docs/src/documentation/content/xdocs/index.xml
A src/docs/src/documentation/content/xdocs/udf.xml
A src/docs/src/documentation/content/xdocs/pigunit.xml
A src/docs/src/documentation/content/xdocs/test.xml
A src/docs/src/documentation/content/xdocs/basic.xml
A src/docs/src/documentation/content/xdocs/pig-index.xml
A src/docs/src/documentation/content/xdocs/cmds.xml
A src/docs/src/documentation/content/xdocs/admin.xml
A src/docs/src/documentation/content/xdocs/tabs.xml
A src/docs/src/documentation/content/xdocs/func.xml
A src/docs/src/documentation/content/xdocs/perf.xml
A src/docs/src/documentation/content/xdocs/start.xml
A

[jira] [Created] (PIG-5281) Implement auto local mode for Spark

2017-08-02 Thread Nandor Kollar (JIRA) 
Nandor Kollar created PIG-5281:
--

 Summary: Implement auto local mode for Spark
 Key: PIG-5281
 URL: https://issues.apache.org/jira/browse/PIG-5281
 Project: Pig
  Issue Type: Improvement
  Components: spark
Reporter: Nandor Kollar
Priority: Minor
 Fix For: 0.18.0


Auto local mode is not yet supported for spark exec type.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Nandor Kollar (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nandor Kollar updated PIG-5278:
---
Fix Version/s: 0.18.0

> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (PIG-5280) Implement auto local mode for Tez

2017-08-02 Thread Nandor Kollar (JIRA) 
Nandor Kollar created PIG-5280:
--

 Summary: Implement auto local mode for Tez
 Key: PIG-5280
 URL: https://issues.apache.org/jira/browse/PIG-5280
 Project: Pig
  Issue Type: Improvement
  Components: tez
Reporter: Nandor Kollar
Priority: Minor
 Fix For: 0.18.0


Auto local mode is not implemented for Tez



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (PIG-5278) Unit test failures because of PIG-5264

2017-08-02 Thread Rohini Palaniswamy (JIRA) 

[ 
https://issues.apache.org/jira/browse/PIG-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110758#comment-16110758
 ] 

Rohini Palaniswamy commented on PIG-5278:
-

Could you add these tests test/excluded-tests-mr  and test/excluded-tests-spark 
as well.  

bq. As for the multiquery test case, I think this test is written for MR only.  
if we'd like to execute it in Tez mode too, then we have to rewrite it.
  Yes. It is MR specific as it tests MR plan. Not required to rewrite for Tez.

Auto local mode is not implemented in Tez or Spark. We should open separate 
jiras for that.


> Unit test failures because of PIG-5264
> --
>
> Key: PIG-5278
> URL: https://issues.apache.org/jira/browse/PIG-5278
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Nandor Kollar
> Attachments: PIG-5278_1.patch, 
> TEST-org.apache.pig.test.TestAutoLocalMode.txt, 
> TEST-org.apache.pig.test.TestMultiQueryCompiler.txt
>
>
> Following unit tests are failing after commit 
> cdd48d8c448221b2bde7f423dd26bbfc51102399
> PIG-5264 
> https://github.com/apache/pig/commit/cdd48d8c448221b2bde7f423dd26bbfc51102399
> # TestAutoLocalMode
> # TestMultiQueryCompiler



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] Subscription: PIG patch available

2017-08-02 Thread jira 
Issue Subscription
Filter: PIG patch available (31 issues)

Subscriber: pigdaily

Key Summary
PIG-5268Review of org.apache.pig.backend.hadoop.datastorage.HDataStorage
https://issues.apache.org/jira/browse/PIG-5268
PIG-5267Review of org.apache.pig.impl.io.BufferedPositionedInputStream
https://issues.apache.org/jira/browse/PIG-5267
PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer thrown 
NPE in multithread env
https://issues.apache.org/jira/browse/PIG-5160
PIG-5115Builtin AvroStorage generates incorrect avro schema when the same 
pig field name appears in the alias
https://issues.apache.org/jira/browse/PIG-5115
PIG-5106Optimize when mapreduce.input.fileinputformat.input.dir.recursive 
set to true
https://issues.apache.org/jira/browse/PIG-5106
PIG-5081Can not run pig on spark source code distribution
https://issues.apache.org/jira/browse/PIG-5081
PIG-5080Support store alias as spark table
https://issues.apache.org/jira/browse/PIG-5080
PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput
https://issues.apache.org/jira/browse/PIG-5057
PIG-5029Optimize sort case when data is skewed
https://issues.apache.org/jira/browse/PIG-5029
PIG-4926Modify the content of start.xml for spark mode
https://issues.apache.org/jira/browse/PIG-4926
PIG-4913Reduce jython function initiation during compilation
https://issues.apache.org/jira/browse/PIG-4913
PIG-4849pig on tez will cause tez-ui to crash,because the content from 
timeline server is too long. 
https://issues.apache.org/jira/browse/PIG-4849
PIG-4750REPLACE_MULTI should compile Pattern once and reuse it
https://issues.apache.org/jira/browse/PIG-4750
PIG-4684Exception should be changed to warning when job diagnostics cannot 
be fetched
https://issues.apache.org/jira/browse/PIG-4684
PIG-4656Improve String serialization and comparator performance in 
BinInterSedes
https://issues.apache.org/jira/browse/PIG-4656
PIG-4598Allow user defined plan optimizer rules
https://issues.apache.org/jira/browse/PIG-4598
PIG-4551Partition filter is not pushed down in case of SPLIT
https://issues.apache.org/jira/browse/PIG-4551
PIG-4539New PigUnit
https://issues.apache.org/jira/browse/PIG-4539
PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException
https://issues.apache.org/jira/browse/PIG-4515
PIG-4323PackageConverter hanging in Spark
https://issues.apache.org/jira/browse/PIG-4323
PIG-4313StackOverflowError in LIMIT operation on Spark
https://issues.apache.org/jira/browse/PIG-4313
PIG-4251Pig on Storm
https://issues.apache.org/jira/browse/PIG-4251
PIG-4002Disable combiner when map-side aggregation is used
https://issues.apache.org/jira/browse/PIG-4002
PIG-3952PigStorage accepts '-tagSplit' to return full split information
https://issues.apache.org/jira/browse/PIG-3952
PIG-3911Define unique fields with @OutputSchema
https://issues.apache.org/jira/browse/PIG-3911
PIG-3877Getting Geo Latitude/Longitude from Address Lines
https://issues.apache.org/jira/browse/PIG-3877
PIG-3873Geo distance calculation using Haversine
https://issues.apache.org/jira/browse/PIG-3873
PIG-3864ToDate(userstring, format, timezone) computes DateTime with strange 
handling of Daylight Saving Time with location based timezones
https://issues.apache.org/jira/browse/PIG-3864
PIG-3668COR built-in function when atleast one of the coefficient values is 
NaN
https://issues.apache.org/jira/browse/PIG-3668
PIG-3587add functionality for rolling over dates
https://issues.apache.org/jira/browse/PIG-3587
PIG-1804Alow Jython function to implement Algebraic and/or Accumulator 
interfaces
https://issues.apache.org/jira/browse/PIG-1804

You may edit this subscription at:
https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=16328=12322384

[jira] Subscription: PIG patch available

2017-08-02 Thread jira 
Issue Subscription
Filter: PIG patch available (35 issues)

Subscriber: pigdaily

Key Summary
PIG-5268Review of org.apache.pig.backend.hadoop.datastorage.HDataStorage
https://issues-test.apache.org/jira/browse/PIG-5268
PIG-5267Review of org.apache.pig.impl.io.BufferedPositionedInputStream
https://issues-test.apache.org/jira/browse/PIG-5267
PIG-5264Remove deprecated keys from PigConfiguration
https://issues-test.apache.org/jira/browse/PIG-5264
PIG-5246Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading 
spark to 2
https://issues-test.apache.org/jira/browse/PIG-5246
PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer thrown 
NPE in multithread env
https://issues-test.apache.org/jira/browse/PIG-5160
PIG-5157Upgrade to Spark 2.0
https://issues-test.apache.org/jira/browse/PIG-5157
PIG-5115Builtin AvroStorage generates incorrect avro schema when the same 
pig field name appears in the alias
https://issues-test.apache.org/jira/browse/PIG-5115
PIG-5106Optimize when mapreduce.input.fileinputformat.input.dir.recursive 
set to true
https://issues-test.apache.org/jira/browse/PIG-5106
PIG-5081Can not run pig on spark source code distribution
https://issues-test.apache.org/jira/browse/PIG-5081
PIG-5080Support store alias as spark table
https://issues-test.apache.org/jira/browse/PIG-5080
PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput
https://issues-test.apache.org/jira/browse/PIG-5057
PIG-5029Optimize sort case when data is skewed
https://issues-test.apache.org/jira/browse/PIG-5029
PIG-4926Modify the content of start.xml for spark mode
https://issues-test.apache.org/jira/browse/PIG-4926
PIG-4913Reduce jython function initiation during compilation
https://issues-test.apache.org/jira/browse/PIG-4913
PIG-4849pig on tez will cause tez-ui to crash,because the content from 
timeline server is too long. 
https://issues-test.apache.org/jira/browse/PIG-4849
PIG-4750REPLACE_MULTI should compile Pattern once and reuse it
https://issues-test.apache.org/jira/browse/PIG-4750
PIG-4684Exception should be changed to warning when job diagnostics cannot 
be fetched
https://issues-test.apache.org/jira/browse/PIG-4684
PIG-4656Improve String serialization and comparator performance in 
BinInterSedes
https://issues-test.apache.org/jira/browse/PIG-4656
PIG-4598Allow user defined plan optimizer rules
https://issues-test.apache.org/jira/browse/PIG-4598
PIG-4551Partition filter is not pushed down in case of SPLIT
https://issues-test.apache.org/jira/browse/PIG-4551
PIG-4539New PigUnit
https://issues-test.apache.org/jira/browse/PIG-4539
PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException
https://issues-test.apache.org/jira/browse/PIG-4515
PIG-4323PackageConverter hanging in Spark
https://issues-test.apache.org/jira/browse/PIG-4323
PIG-4313StackOverflowError in LIMIT operation on Spark
https://issues-test.apache.org/jira/browse/PIG-4313
PIG-4251Pig on Storm
https://issues-test.apache.org/jira/browse/PIG-4251
PIG-4002Disable combiner when map-side aggregation is used
https://issues-test.apache.org/jira/browse/PIG-4002
PIG-3952PigStorage accepts '-tagSplit' to return full split information
https://issues-test.apache.org/jira/browse/PIG-3952
PIG-3911Define unique fields with @OutputSchema
https://issues-test.apache.org/jira/browse/PIG-3911
PIG-3877Getting Geo Latitude/Longitude from Address Lines
https://issues-test.apache.org/jira/browse/PIG-3877
PIG-3873Geo distance calculation using Haversine
https://issues-test.apache.org/jira/browse/PIG-3873
PIG-3864ToDate(userstring, format, timezone) computes DateTime with strange 
handling of Daylight Saving Time with location based timezones
https://issues-test.apache.org/jira/browse/PIG-3864
PIG-3668COR built-in function when atleast one of the coefficient values is 
NaN
https://issues-test.apache.org/jira/browse/PIG-3668
PIG-3655BinStorage and InterStorage approach to record markers is broken
https://issues-test.apache.org/jira/browse/PIG-3655
PIG-3587add functionality for rolling over dates
https://issues-test.apache.org/jira/browse/PIG-3587
PIG-1804Alow Jython function to implement Algebraic and/or Accumulator 
interfaces
https://issues-test.apache.org/jira/browse/PIG-1804

You may edit this subscription at:
https://issues-test.apache.org/jira/secure/FilterSubscription!default.jspa?subId=16328=12322384