[jira] Subscription: PIG patch available

2019-01-08 Thread jira 
Issue Subscription
Filter: PIG patch available (36 issues)

Subscriber: pigdaily

Key Summary
PIG-5369Add llap-client dependency
https://issues.apache.org/jira/browse/PIG-5369
PIG-5360Pig sets working directory of input file systems causes exception 
thrown
https://issues.apache.org/jira/browse/PIG-5360
PIG-5338Prevent deep copy of DataBag into Jython List
https://issues.apache.org/jira/browse/PIG-5338
PIG-5323Implement LastInputStreamingOptimizer in Tez
https://issues.apache.org/jira/browse/PIG-5323
PIG-5273_SUCCESS file should be created at the end of the job
https://issues.apache.org/jira/browse/PIG-5273
PIG-5267Review of org.apache.pig.impl.io.BufferedPositionedInputStream
https://issues.apache.org/jira/browse/PIG-5267
PIG-5256Bytecode generation for POFilter and POForeach
https://issues.apache.org/jira/browse/PIG-5256
PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer thrown 
NPE in multithread env
https://issues.apache.org/jira/browse/PIG-5160
PIG-5115Builtin AvroStorage generates incorrect avro schema when the same 
pig field name appears in the alias
https://issues.apache.org/jira/browse/PIG-5115
PIG-5106Optimize when mapreduce.input.fileinputformat.input.dir.recursive 
set to true
https://issues.apache.org/jira/browse/PIG-5106
PIG-5081Can not run pig on spark source code distribution
https://issues.apache.org/jira/browse/PIG-5081
PIG-5080Support store alias as spark table
https://issues.apache.org/jira/browse/PIG-5080
PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput
https://issues.apache.org/jira/browse/PIG-5057
PIG-5029Optimize sort case when data is skewed
https://issues.apache.org/jira/browse/PIG-5029
PIG-4926Modify the content of start.xml for spark mode
https://issues.apache.org/jira/browse/PIG-4926
PIG-4913Reduce jython function initiation during compilation
https://issues.apache.org/jira/browse/PIG-4913
PIG-4849pig on tez will cause tez-ui to crash,because the content from 
timeline server is too long. 
https://issues.apache.org/jira/browse/PIG-4849
PIG-4750REPLACE_MULTI should compile Pattern once and reuse it
https://issues.apache.org/jira/browse/PIG-4750
PIG-4684Exception should be changed to warning when job diagnostics cannot 
be fetched
https://issues.apache.org/jira/browse/PIG-4684
PIG-4656Improve String serialization and comparator performance in 
BinInterSedes
https://issues.apache.org/jira/browse/PIG-4656
PIG-4598Allow user defined plan optimizer rules
https://issues.apache.org/jira/browse/PIG-4598
PIG-4551Partition filter is not pushed down in case of SPLIT
https://issues.apache.org/jira/browse/PIG-4551
PIG-4539New PigUnit
https://issues.apache.org/jira/browse/PIG-4539
PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException
https://issues.apache.org/jira/browse/PIG-4515
PIG-4373Implement PIG-3861 in Tez
https://issues.apache.org/jira/browse/PIG-4373
PIG-4323PackageConverter hanging in Spark
https://issues.apache.org/jira/browse/PIG-4323
PIG-4313StackOverflowError in LIMIT operation on Spark
https://issues.apache.org/jira/browse/PIG-4313
PIG-4251Pig on Storm
https://issues.apache.org/jira/browse/PIG-4251
PIG-4002Disable combiner when map-side aggregation is used
https://issues.apache.org/jira/browse/PIG-4002
PIG-3952PigStorage accepts '-tagSplit' to return full split information
https://issues.apache.org/jira/browse/PIG-3952
PIG-3911Define unique fields with @OutputSchema
https://issues.apache.org/jira/browse/PIG-3911
PIG-3877Getting Geo Latitude/Longitude from Address Lines
https://issues.apache.org/jira/browse/PIG-3877
PIG-3873Geo distance calculation using Haversine
https://issues.apache.org/jira/browse/PIG-3873
PIG-3668COR built-in function when atleast one of the coefficient values is 
NaN
https://issues.apache.org/jira/browse/PIG-3668
PIG-3587add functionality for rolling over dates
https://issues.apache.org/jira/browse/PIG-3587
PIG-1804Alow Jython function to implement Algebraic and/or Accumulator 
interfaces
https://issues.apache.org/jira/browse/PIG-1804

You may edit this subscription at:
https://issues.apache.org/jira/secure/EditSubscription!default.jspa?subId=16328&filterId=12322384

[jira] [Created] (PIG-5375) NullPointerException for multi-level self unions with Tez UnionOptimizer

2019-01-08 Thread Koji Noguchi (JIRA) 
Koji Noguchi created PIG-5375:
-

 Summary: NullPointerException for multi-level self unions with Tez 
UnionOptimizer
 Key: PIG-5375
 URL: https://issues.apache.org/jira/browse/PIG-5375
 Project: Pig
  Issue Type: Bug
Reporter: Koji Noguchi
Assignee: Koji Noguchi


{code}
A = load 'input.txt' as (a0:int, a1: chararray, a2:int);
B = load 'input.txt' as (a0:int, a1: chararray, a2:int);
C = load 'input.txt' as (a0:int, a1: chararray, a2:int);

A_and_B = UNION A, B;
SPLIT A_and_B INTO A_and_B2 IF a0 > 10, A_and_B3 OTHERWISE;

A_and_B_and_C = UNION ONSCHEMA C, A_and_B;

X = UNION ONSCHEMA A_and_B_and_C, A_and_B2, A_and_B3;

X2 = GROUP X ALL ;

dump X2;
{code}

This fails _on Tez_ with 
{noformat}
Pig Stack Trace
---
ERROR 1002: Unable to store alias X2

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open 
iterator for alias X2
at org.apache.pig.PigServer.openIterator(PigServer.java:1024)
at 
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:790)
at 
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:383)
at 
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:231)
at 
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:206)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
at org.apache.pig.Main.run(Main.java:630)
at org.apache.pig.Main.main(Main.java:175)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias X2
at org.apache.pig.PigServer.storeEx(PigServer.java:1127)
at org.apache.pig.PigServer.store(PigServer.java:1086)
at org.apache.pig.PigServer.openIterator(PigServer.java:999)
... 7 more
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: 
java.lang.NullPointerException
at 
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:296)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1479)
at 
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1464)
at org.apache.pig.PigServer.storeEx(PigServer.java:1123)
... 9 more
Caused by: java.lang.NullPointerException
at 
org.apache.pig.backend.hadoop.executionengine.tez.plan.TezPOPackageAnnotator.patchPackage(TezPOPackageAnnotator.java:97)
at 
org.apache.pig.backend.hadoop.executionengine.tez.plan.TezPOPackageAnnotator.handlePackage(TezPOPackageAnnotator.java:78)
at 
org.apache.pig.backend.hadoop.executionengine.tez.plan.TezPOPackageAnnotator.visitTezOp(TezPOPackageAnnotator.java:61)
at 
org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:265)
at 
org.apache.pig.backend.hadoop.executionengine.tez.plan.TezOperator.visit(TezOperator.java:56)
at 
org.apache.pig.impl.plan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:69)
at 
org.apache.pig.impl.plan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:71)
at 
org.apache.pig.impl.plan.DepthFirstWalker.depthFirst(DepthFirstWalker.java:71)
at 
org.apache.pig.impl.plan.DepthFirstWalker.walk(DepthFirstWalker.java:52)
at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:46)
at 
org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:197)
at 
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:290)
... 12 more
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Pig-trunk #2096

2019-01-08 Thread Apache Jenkins Server 
See 

Changes:

[szita] PIG-5374: Use CircularFifoBuffer in InterRecordReader (szita)

--
[...truncated 196.62 KB...]
[ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = 


ivy-resolve:
 [echo] *** Ivy resolve with Hadoop 2, Spark 1 and HBase 1 ***
[ivy:resolve] 
[ivy:resolve] :: problems summary ::
[ivy:resolve]  ERRORS
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver main
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver main
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver main
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve]   unknown resolver public
[ivy:resolve] 
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
[ivy:report] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' 
instead
[ivy:report] :: loading settings :: file = 

[ivy:report] Processing 
/home/jenkins/.ivy2/cache/org.apache.pig-pig-compile.xml to 

[ivy:report] Processing 
/home/jenkins/.ivy2/cache/org.apache.pig-pig-compile.xml to 


ivy-compile:
[ivy:retrieve] 
[ivy:retrieve] :: problems summary ::
[ivy:retrieve]  ERRORS
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver main
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver main
[ivy:retrieve]  unknown resolver public
[ivy:retrieve]  unknown resolver main
[ivy:retrieve] 
[ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
[ivy:cachepath] :: resolving dependencies :: org.apache.pig#pig;0.18.0-SNAPSHOT
[ivy:cachepath] confs: [compile]
[ivy:cachepath] found com.sun.jersey#jersey-bundle;1.8 in maven2
[ivy:cachepath] found com.sun.jersey#jersey-server;1.8 in maven2
[ivy:cachepath] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2
[ivy:cachepath] found commons-codec#commons-codec;1.4 in fs
[ivy:cachepath] found commons-configuration#commons-configuration;1.6 
in fs
[ivy:cachepath] found commons-collections#commons-collections;3.2.1 in 
fs
[ivy:cachepath] found javax.servlet#servlet-api;2.5 in fs
[ivy:cachepath] found javax.ws.rs#jsr311-api;1.1.1 in fs
[ivy:cachepath] found com.google.protobuf#protobuf-java;2.5.0 in fs
[ivy:cachepath] found javax.inject#javax.inject;1 in fs
[ivy:cachepath] found javax.xml.bind#jaxb-api;2.2.2 in fs
[ivy:cachepath] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in fs
[ivy:cachepath] found com.google.inject#guice;3.0 in fs
[ivy:cachepath] found com.google.inject.extensions#guice-servlet;3.0 in 
fs
[ivy:cachepath] found aopalliance#aopalliance;1.0 in fs
[ivy:cachepath] found org.glassfish#javax.el;3.0.1-b08 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-annotations;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-auth;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-common;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-hdfs;2.7.3 in maven2
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-core;2.7.3 in maven2
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.7.3 in maven2
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-server-tests;2

Build failed in Jenkins: Pig-trunk-commit #2589

2019-01-08 Thread Apache Jenkins Server 
See 


Changes:

[szita] PIG-5374: Use CircularFifoBuffer in InterRecordReader (szita)

--
[...truncated 195.78 KB...]
jar:
 [echo] Compiling against Spark 2
Trying to override old definition of task propertycopy
Trying to override old definition of task propertycopy

clean-deps:
Trying to override old definition of task propertycopy
Trying to override old definition of task propertycopy

ivy-download:
  [get] Getting: 
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar
  [get] To: 


ivy-init-dirs:
[mkdir] Created dir: 

[mkdir] Created dir: 

[mkdir] Created dir: 

[mkdir] Created dir: 


ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = 


ivy-resolve:
 [echo] *** Ivy resolve with Hadoop 2, Spark 2 and HBase 1 ***
[ivy:report] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' 
instead
[ivy:report] :: loading settings :: file = 

[ivy:report] Processing 
/home/jenkins/.ivy2/cache/org.apache.pig-pig-compile.xml to 

[ivy:report] Processing 
/home/jenkins/.ivy2/cache/org.apache.pig-pig-compile.xml to 


ivy-compile:
[ivy:cachepath] :: resolving dependencies :: org.apache.pig#pig;0.18.0-SNAPSHOT
[ivy:cachepath] confs: [compile]
[ivy:cachepath] found com.sun.jersey#jersey-bundle;1.8 in maven2
[ivy:cachepath] found com.sun.jersey#jersey-server;1.8 in fs
[ivy:cachepath] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2
[ivy:cachepath] found commons-codec#commons-codec;1.4 in fs
[ivy:cachepath] found commons-configuration#commons-configuration;1.6 
in fs
[ivy:cachepath] found commons-collections#commons-collections;3.2.1 in 
fs
[ivy:cachepath] found javax.servlet#servlet-api;2.5 in fs
[ivy:cachepath] found javax.ws.rs#jsr311-api;1.1.1 in fs
[ivy:cachepath] found com.google.protobuf#protobuf-java;2.5.0 in fs
[ivy:cachepath] found javax.inject#javax.inject;1 in fs
[ivy:cachepath] found javax.xml.bind#jaxb-api;2.2.2 in fs
[ivy:cachepath] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in fs
[ivy:cachepath] found com.google.inject#guice;3.0 in fs
[ivy:cachepath] found com.google.inject.extensions#guice-servlet;3.0 in 
fs
[ivy:cachepath] found aopalliance#aopalliance;1.0 in fs
[ivy:cachepath] found org.glassfish#javax.el;3.0.1-b08 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-annotations;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-auth;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-common;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-hdfs;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-core;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-server-tests;2.7.3 
in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-app;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-mapreduce-client-common;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-api;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-common;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-server;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-yarn-server-web-proxy;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-server-common;2.7.3 
in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-yarn-server-nodemanager;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.7.3 in fs
[ivy:cachepath] found org.apache.hadoop#hadoop-yarn-client;2.7.3 in fs
[ivy:cachepath] found 
org.apache.hadoop#hadoop-yarn-server-applicationhistoryservice;2.7.3 in fs
[ivy:cachepath] found

[jira] [Updated] (PIG-5374) Use CircularFifoBuffer in InterRecordReader

2019-01-08 Thread Adam Szita (JIRA) 


 [ 
https://issues.apache.org/jira/browse/PIG-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5374:

   Resolution: Fixed
Fix Version/s: 0.18.0
   Status: Resolved  (was: Patch Available)

> Use CircularFifoBuffer in InterRecordReader
> ---
>
> Key: PIG-5374
> URL: https://issues.apache.org/jira/browse/PIG-5374
> Project: Pig
>  Issue Type: Bug
>Reporter: Adam Szita
>Assignee: Adam Szita
>Priority: Major
> Fix For: 0.18.0
>
> Attachments: PIG-5374.0.patch
>
>
> We're currently using CircularFifoQueue in InterRecordReader, and it comes 
> from commons-collections4 dependency. Hadoop 2.8 installations do not have 
> this dependency by default, so for now we should switch to the older 
> CircularFifoBuffer instead (which comes from commons-collections and it's 
> present).
> We should open a separate ticket for investigating what libraries should we 
> update. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (PIG-5374) Use CircularFifoBuffer in InterRecordReader

2019-01-08 Thread Adam Szita (JIRA) 


[ 
https://issues.apache.org/jira/browse/PIG-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736987#comment-16736987
 ] 

Adam Szita commented on PIG-5374:
-

Thanks Nandor, committed to trunk.

> Use CircularFifoBuffer in InterRecordReader
> ---
>
> Key: PIG-5374
> URL: https://issues.apache.org/jira/browse/PIG-5374
> Project: Pig
>  Issue Type: Bug
>Reporter: Adam Szita
>Assignee: Adam Szita
>Priority: Major
> Attachments: PIG-5374.0.patch
>
>
> We're currently using CircularFifoQueue in InterRecordReader, and it comes 
> from commons-collections4 dependency. Hadoop 2.8 installations do not have 
> this dependency by default, so for now we should switch to the older 
> CircularFifoBuffer instead (which comes from commons-collections and it's 
> present).
> We should open a separate ticket for investigating what libraries should we 
> update. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (PIG-5374) Use CircularFifoBuffer in InterRecordReader

2019-01-08 Thread Nandor Kollar (JIRA) 


[ 
https://issues.apache.org/jira/browse/PIG-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736928#comment-16736928
 ] 

Nandor Kollar commented on PIG-5374:


+1

> Use CircularFifoBuffer in InterRecordReader
> ---
>
> Key: PIG-5374
> URL: https://issues.apache.org/jira/browse/PIG-5374
> Project: Pig
>  Issue Type: Bug
>Reporter: Adam Szita
>Assignee: Adam Szita
>Priority: Major
> Attachments: PIG-5374.0.patch
>
>
> We're currently using CircularFifoQueue in InterRecordReader, and it comes 
> from commons-collections4 dependency. Hadoop 2.8 installations do not have 
> this dependency by default, so for now we should switch to the older 
> CircularFifoBuffer instead (which comes from commons-collections and it's 
> present).
> We should open a separate ticket for investigating what libraries should we 
> update. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (PIG-5374) Use CircularFifoBuffer in InterRecordReader

2019-01-08 Thread Adam Szita (JIRA) 


 [ 
https://issues.apache.org/jira/browse/PIG-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5374:

Status: Patch Available  (was: Open)

> Use CircularFifoBuffer in InterRecordReader
> ---
>
> Key: PIG-5374
> URL: https://issues.apache.org/jira/browse/PIG-5374
> Project: Pig
>  Issue Type: Bug
>Reporter: Adam Szita
>Assignee: Adam Szita
>Priority: Major
> Attachments: PIG-5374.0.patch
>
>
> We're currently using CircularFifoQueue in InterRecordReader, and it comes 
> from commons-collections4 dependency. Hadoop 2.8 installations do not have 
> this dependency by default, so for now we should switch to the older 
> CircularFifoBuffer instead (which comes from commons-collections and it's 
> present).
> We should open a separate ticket for investigating what libraries should we 
> update. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (PIG-5374) Use CircularFifoBuffer in InterRecordReader

2019-01-08 Thread Adam Szita (JIRA) 


 [ 
https://issues.apache.org/jira/browse/PIG-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Szita updated PIG-5374:

Attachment: PIG-5374.0.patch

> Use CircularFifoBuffer in InterRecordReader
> ---
>
> Key: PIG-5374
> URL: https://issues.apache.org/jira/browse/PIG-5374
> Project: Pig
>  Issue Type: Bug
>Reporter: Adam Szita
>Assignee: Adam Szita
>Priority: Major
> Attachments: PIG-5374.0.patch
>
>
> We're currently using CircularFifoQueue in InterRecordReader, and it comes 
> from commons-collections4 dependency. Hadoop 2.8 installations do not have 
> this dependency by default, so for now we should switch to the older 
> CircularFifoBuffer instead (which comes from commons-collections and it's 
> present).
> We should open a separate ticket for investigating what libraries should we 
> update. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (PIG-5374) Use CircularFifoBuffer in InterRecordReader

2019-01-08 Thread Adam Szita (JIRA) 
Adam Szita created PIG-5374:
---

 Summary: Use CircularFifoBuffer in InterRecordReader
 Key: PIG-5374
 URL: https://issues.apache.org/jira/browse/PIG-5374
 Project: Pig
  Issue Type: Bug
Reporter: Adam Szita
Assignee: Adam Szita


We're currently using CircularFifoQueue in InterRecordReader, and it comes from 
commons-collections4 dependency. Hadoop 2.8 installations do not have this 
dependency by default, so for now we should switch to the older 
CircularFifoBuffer instead (which comes from commons-collections and it's 
present).

We should open a separate ticket for investigating what libraries should we 
update. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)