Re: Review Request 68799: [PIG-3038] Support for Credentials for UDF, Loader and Storer

2018-09-21 Thread Satish Saley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68799/
---

(Updated Sept. 21, 2018, 9:22 p.m.)


Review request for pig.


Repository: pig-git


Description
---

[PIG-3038] Support for Credentials for UDF,Loader and Storer


Diffs (updated)
-

  src/org/apache/pig/EvalFunc.java fd139a8b4 
  src/org/apache/pig/LoadFunc.java 83e89a34c 
  src/org/apache/pig/StoreFuncInterface.java c590084dc 
  
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
 4d3ab5086 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java
 2c8dea608 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java 
f292487f0 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/LoaderProcessor.java
 7a12df784 
  src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java 98040382f 
  test/org/apache/pig/test/TestCredentials.java PRE-CREATION 


Diff: https://reviews.apache.org/r/68799/diff/3/

Changes: https://reviews.apache.org/r/68799/diff/2-3/


Testing
---


Thanks,

Satish Saley



[jira] [Commented] (PIG-5355) Negative progress report by HBaseTableRecordReader

2018-09-21 Thread Rohini Palaniswamy (JIRA)


[ 
https://issues.apache.org/jira/browse/PIG-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624228#comment-16624228
 ] 

Rohini Palaniswamy commented on PIG-5355:
-

bq. Or, I'm fine committing as is.
 I think better to leave it at this. Logic seems to be taken from here - 
https://github.com/apache/hbase/blob/master/hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java#L1846-L1867

> Negative progress report by HBaseTableRecordReader
> --
>
> Key: PIG-5355
> URL: https://issues.apache.org/jira/browse/PIG-5355
> Project: Pig
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Satish Subhashrao Saley
>Priority: Major
> Attachments: PIG-5355-1.patch, PIG-5355-2.patch, PIG-5355-3.patch
>
>
> The logic for padding the current row does not consider the updated padded 
> row during the comparison. It ends up with different length then expected. 
> This results in negative value for {{processed}}.
> {code}
> byte[] lastPadded = currRow_;
> if (currRow_.length < endRow_.length) {
> lastPadded = Bytes.padTail(currRow_, endRow_.length - 
> currRow_.length);
> }
> if (currRow_.length < startRow_.length) {
> lastPadded = Bytes.padTail(currRow_, startRow_.length - 
> currRow_.length);
> }
> byte [] prependHeader = {1, 0};
> BigInteger bigLastRow = new BigInteger(Bytes.add(prependHeader, 
> lastPadded));
> if (bigLastRow.compareTo(bigEnd_) > 0) {
> return progressSoFar_;
> }
> BigDecimal processed = new 
> BigDecimal(bigLastRow.subtract(bigStart_));
> {code}
> The fix is to use {{lastPadded}} in the second {{if}} comparison and 
> {{Bytes.padTail}} call inside that {{if}}
> PIG-4700 added progress reporting. This enabled ProgressHelper in Tez. It 
> calls {{getProgress}} [here 
> |https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/common/ProgressHelper.java#L50]
>  on {{PigRecrodReader}} 
> https://github.com/apache/pig/blob/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigRecordReader.java#L159
>  . Since Pig is reporting negative progress, job is getting killed by AM.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 68799: [PIG-3038] Support for Credentials for UDF, Loader and Storer

2018-09-21 Thread Rohini Palaniswamy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68799/#review208885
---




test/org/apache/pig/test/TestCredentialsEvalFunc.java
Lines 42 (patched)


You need to run it in cluster mode


- Rohini Palaniswamy


On Sept. 21, 2018, 5:47 p.m., Satish Saley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68799/
> ---
> 
> (Updated Sept. 21, 2018, 5:47 p.m.)
> 
> 
> Review request for pig.
> 
> 
> Repository: pig-git
> 
> 
> Description
> ---
> 
> [PIG-3038] Support for Credentials for UDF,Loader and Storer
> 
> 
> Diffs
> -
> 
>   src/org/apache/pig/EvalFunc.java fd139a8b4 
>   src/org/apache/pig/LoadFunc.java 83e89a34c 
>   src/org/apache/pig/StoreFuncInterface.java c590084dc 
>   
> src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
>  4d3ab5086 
>   
> src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java
>  2c8dea608 
>   
> src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
>  033fff7c2 
>   src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java 
> f292487f0 
>   src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java 
> 6343c819a 
>   src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java 
> 4f9b75b14 
>   
> src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOUserFuncVisitor.java
>  47d75855f 
>   
> src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/LoaderProcessor.java
>  7a12df784 
>   src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java 98040382f 
>   test/org/apache/pig/test/TestCredentialsEvalFunc.java PRE-CREATION 
>   test/org/apache/pig/test/TestLoaderStorerShipCacheFiles.java 793e1277d 
>   test/org/apache/pig/test/TestLoaderStorerShipCacheFilesMR.java 42b36e517 
>   test/org/apache/pig/test/utils/CredAvroStorage.java PRE-CREATION 
>   test/org/apache/pig/test/utils/CredentialsEvalFunc.java PRE-CREATION 
>   test/org/apache/pig/tez/TestLoaderStorerShipCacheFilesTez.java 4ba8abb09 
> 
> 
> Diff: https://reviews.apache.org/r/68799/diff/2/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Satish Saley
> 
>



Re: Review Request 68799: [PIG-3038] Support for Credentials for UDF, Loader and Storer

2018-09-21 Thread Rohini Palaniswamy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68799/#review208875
---




src/org/apache/pig/EvalFunc.java
Lines 388 (patched)


Allows adding secrets or custom credentials that can be used to talk to 
external systems. For eg: keys to decrypt encrypted data, database passwords, 
hcatalog/hbase delegation tokens, etc. This will be called once on the front 
end before the job is submitted. The added credentials can be accessed in the 
backend



src/org/apache/pig/EvalFunc.java
Lines 390 (patched)


to which delegation tokens and secrets can be added



src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
Lines 562 (patched)


I think it would be cleaner to do similar thing for Tez as well in 
TezDAGBuilder instead of doing it in UDFShipCacheFilesVisitor. MR and Spark 
code also refer to that class.

Can remove these checks as they are redundant

if(userFuncs!=null && userFuncs.size()>0){
if(userFunc.getFunc() != null) {



src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
Lines 40 (patched)


not initialized



src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
Lines 44 (patched)


Initialize credentials from the plan. New constructor is not required



src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java
Line 132 (original), 133 (patched)


can be done in the visitor itself



src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java
Lines 832 (patched)


Just do jobConf.setCredentials(credentials) here and get rid of variable ret



test/org/apache/pig/test/TestCredentialsEvalFunc.java
Lines 38 (patched)


Have a TestCredentials class for all credential tests and have all the test 
EvalFunc and LoadFunc classes within it.


- Rohini Palaniswamy


On Sept. 21, 2018, 5:47 p.m., Satish Saley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/68799/
> ---
> 
> (Updated Sept. 21, 2018, 5:47 p.m.)
> 
> 
> Review request for pig.
> 
> 
> Repository: pig-git
> 
> 
> Description
> ---
> 
> [PIG-3038] Support for Credentials for UDF,Loader and Storer
> 
> 
> Diffs
> -
> 
>   src/org/apache/pig/EvalFunc.java fd139a8b4 
>   src/org/apache/pig/LoadFunc.java 83e89a34c 
>   src/org/apache/pig/StoreFuncInterface.java c590084dc 
>   
> src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
>  4d3ab5086 
>   
> src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java
>  2c8dea608 
>   
> src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
>  033fff7c2 
>   src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java 
> f292487f0 
>   src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java 
> 6343c819a 
>   src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java 
> 4f9b75b14 
>   
> src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOUserFuncVisitor.java
>  47d75855f 
>   
> src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/LoaderProcessor.java
>  7a12df784 
>   src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java 98040382f 
>   test/org/apache/pig/test/TestCredentialsEvalFunc.java PRE-CREATION 
>   test/org/apache/pig/test/TestLoaderStorerShipCacheFiles.java 793e1277d 
>   test/org/apache/pig/test/TestLoaderStorerShipCacheFilesMR.java 42b36e517 
>   test/org/apache/pig/test/utils/CredAvroStorage.java PRE-CREATION 
>   test/org/apache/pig/test/utils/CredentialsEvalFunc.java PRE-CREATION 
>   test/org/apache/pig/tez/TestLoaderStorerShipCacheFilesTez.java 4ba8abb09 
> 
> 
> Diff: https://reviews.apache.org/r/68799/diff/2/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Satish Saley
> 
>



[jira] [Updated] (PIG-3038) Support for Credentials for UDF,Loader and Storer

2018-09-21 Thread Satish Subhashrao Saley (JIRA)


 [ 
https://issues.apache.org/jira/browse/PIG-3038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Satish Subhashrao Saley updated PIG-3038:
-
Status: Patch Available  (was: Open)

> Support for Credentials for UDF,Loader and Storer
> -
>
> Key: PIG-3038
> URL: https://issues.apache.org/jira/browse/PIG-3038
> Project: Pig
>  Issue Type: New Feature
>Affects Versions: 0.10.0
>Reporter: Rohini Palaniswamy
>Assignee: Satish Subhashrao Saley
>Priority: Major
> Fix For: 0.18.0
>
>
>   Pig does not have a clean way (APIs) to support adding Credentials (hbase 
> token, hcat/hive metastore token) to Job and retrieving it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 68799: [PIG-3038] Support for Credentials for UDF, Loader and Storer

2018-09-21 Thread Satish Saley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68799/
---

(Updated Sept. 21, 2018, 10:47 a.m.)


Review request for pig.


Repository: pig-git


Description
---

[PIG-3038] Support for Credentials for UDF,Loader and Storer


Diffs (updated)
-

  src/org/apache/pig/EvalFunc.java fd139a8b4 
  src/org/apache/pig/LoadFunc.java 83e89a34c 
  src/org/apache/pig/StoreFuncInterface.java c590084dc 
  
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
 4d3ab5086 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java
 2c8dea608 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
 033fff7c2 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java 
f292487f0 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java 
6343c819a 
  src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java 
4f9b75b14 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOUserFuncVisitor.java
 47d75855f 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/LoaderProcessor.java
 7a12df784 
  src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java 98040382f 
  test/org/apache/pig/test/TestCredentialsEvalFunc.java PRE-CREATION 
  test/org/apache/pig/test/TestLoaderStorerShipCacheFiles.java 793e1277d 
  test/org/apache/pig/test/TestLoaderStorerShipCacheFilesMR.java 42b36e517 
  test/org/apache/pig/test/utils/CredAvroStorage.java PRE-CREATION 
  test/org/apache/pig/test/utils/CredentialsEvalFunc.java PRE-CREATION 
  test/org/apache/pig/tez/TestLoaderStorerShipCacheFilesTez.java 4ba8abb09 


Diff: https://reviews.apache.org/r/68799/diff/2/

Changes: https://reviews.apache.org/r/68799/diff/1-2/


Testing
---


Thanks,

Satish Saley



Review Request 68799: [PIG-3038] Support for Credentials for UDF, Loader and Storer

2018-09-21 Thread Satish Saley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68799/
---

Review request for pig.


Repository: pig-git


Description
---

[PIG-3038] Support for Credentials for UDF,Loader and Storer


Diffs
-

  src/org/apache/pig/EvalFunc.java fd139a8b4 
  src/org/apache/pig/LoadFunc.java 83e89a34c 
  src/org/apache/pig/StoreFuncInterface.java c590084dc 
  src/org/apache/pig/StoreResources.java 284990b44 
  
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
 4d3ab5086 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java
 2c8dea608 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
 033fff7c2 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java 
f292487f0 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java 
6343c819a 
  src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java 
4f9b75b14 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOUserFuncVisitor.java
 47d75855f 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/LoaderProcessor.java
 7a12df784 
  src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java 98040382f 
  test/org/apache/pig/test/TestCredentialsEvalFunc.java PRE-CREATION 
  test/org/apache/pig/test/TestLoaderStorerShipCacheFiles.java 793e1277d 
  test/org/apache/pig/test/TestLoaderStorerShipCacheFilesMR.java 42b36e517 
  test/org/apache/pig/test/utils/CredAvroStorage.java PRE-CREATION 
  test/org/apache/pig/test/utils/CredentialsEvalFunc.java PRE-CREATION 
  test/org/apache/pig/tez/TestLoaderStorerShipCacheFilesTez.java 4ba8abb09 


Diff: https://reviews.apache.org/r/68799/diff/1/


Testing
---


Thanks,

Satish Saley



Review Request 68798: [PIG-3038] Support for Credentials for UDF, Loader and Storer

2018-09-21 Thread Satish Saley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/68798/
---

Review request for pig.


Repository: pig-git


Description
---

[PIG-3038] Support for Credentials for UDF,Loader and Storer


Diffs
-

  src/org/apache/pig/EvalFunc.java fd139a8b4 
  src/org/apache/pig/LoadFunc.java 83e89a34c 
  src/org/apache/pig/StoreFuncInterface.java c590084dc 
  src/org/apache/pig/StoreResources.java 284990b44 
  
src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
 4d3ab5086 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java
 2c8dea608 
  
src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/UdfCacheShipFilesVisitor.java
 033fff7c2 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java 
f292487f0 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java 
6343c819a 
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezLauncher.java 
4b5da89f5 
  src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java 
4f9b75b14 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOUserFuncVisitor.java
 47d75855f 
  
src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/LoaderProcessor.java
 7a12df784 
  src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java 98040382f 
  test/org/apache/pig/test/TestCredentialsEvalFunc.java PRE-CREATION 
  test/org/apache/pig/test/TestLoaderStorerShipCacheFiles.java 793e1277d 
  test/org/apache/pig/test/TestLoaderStorerShipCacheFilesMR.java 42b36e517 
  test/org/apache/pig/test/utils/CredAvroStorage.java PRE-CREATION 
  test/org/apache/pig/test/utils/CredentialsEvalFunc.java PRE-CREATION 
  test/org/apache/pig/tez/TestLoaderStorerShipCacheFilesTez.java 4ba8abb09 


Diff: https://reviews.apache.org/r/68798/diff/1/


Testing
---


Thanks,

Satish Saley



[jira] Subscription: PIG patch available

2018-09-21 Thread jira
Issue Subscription
Filter: PIG patch available (39 issues)

Subscriber: pigdaily

Key Summary
PIG-5357BagFactory interface should support creating a distinct bag from a 
set
https://issues.apache.org/jira/browse/PIG-5357
PIG-5355Negative progress report by HBaseTableRecordReader
https://issues.apache.org/jira/browse/PIG-5355
PIG-5354Show fieldname and a line number for casting errors
https://issues.apache.org/jira/browse/PIG-5354
PIG-5342Add setting to turn off bloom join combiner
https://issues.apache.org/jira/browse/PIG-5342
PIG-5338Prevent deep copy of DataBag into Jython List
https://issues.apache.org/jira/browse/PIG-5338
PIG-5323Implement LastInputStreamingOptimizer in Tez
https://issues.apache.org/jira/browse/PIG-5323
PIG-5317Upgrade old dependencies: commons-lang, hsqldb, commons-logging
https://issues.apache.org/jira/browse/PIG-5317
PIG-5273_SUCCESS file should be created at the end of the job
https://issues.apache.org/jira/browse/PIG-5273
PIG-5267Review of org.apache.pig.impl.io.BufferedPositionedInputStream
https://issues.apache.org/jira/browse/PIG-5267
PIG-5256Bytecode generation for POFilter and POForeach
https://issues.apache.org/jira/browse/PIG-5256
PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer thrown 
NPE in multithread env
https://issues.apache.org/jira/browse/PIG-5160
PIG-5115Builtin AvroStorage generates incorrect avro schema when the same 
pig field name appears in the alias
https://issues.apache.org/jira/browse/PIG-5115
PIG-5106Optimize when mapreduce.input.fileinputformat.input.dir.recursive 
set to true
https://issues.apache.org/jira/browse/PIG-5106
PIG-5081Can not run pig on spark source code distribution
https://issues.apache.org/jira/browse/PIG-5081
PIG-5080Support store alias as spark table
https://issues.apache.org/jira/browse/PIG-5080
PIG-5057IndexOutOfBoundsException when pig reducer processOnePackageOutput
https://issues.apache.org/jira/browse/PIG-5057
PIG-5029Optimize sort case when data is skewed
https://issues.apache.org/jira/browse/PIG-5029
PIG-4926Modify the content of start.xml for spark mode
https://issues.apache.org/jira/browse/PIG-4926
PIG-4913Reduce jython function initiation during compilation
https://issues.apache.org/jira/browse/PIG-4913
PIG-4849pig on tez will cause tez-ui to crash,because the content from 
timeline server is too long. 
https://issues.apache.org/jira/browse/PIG-4849
PIG-4750REPLACE_MULTI should compile Pattern once and reuse it
https://issues.apache.org/jira/browse/PIG-4750
PIG-4684Exception should be changed to warning when job diagnostics cannot 
be fetched
https://issues.apache.org/jira/browse/PIG-4684
PIG-4656Improve String serialization and comparator performance in 
BinInterSedes
https://issues.apache.org/jira/browse/PIG-4656
PIG-4598Allow user defined plan optimizer rules
https://issues.apache.org/jira/browse/PIG-4598
PIG-4551Partition filter is not pushed down in case of SPLIT
https://issues.apache.org/jira/browse/PIG-4551
PIG-4539New PigUnit
https://issues.apache.org/jira/browse/PIG-4539
PIG-4515org.apache.pig.builtin.Distinct throws ClassCastException
https://issues.apache.org/jira/browse/PIG-4515
PIG-4373Implement PIG-3861 in Tez
https://issues.apache.org/jira/browse/PIG-4373
PIG-4323PackageConverter hanging in Spark
https://issues.apache.org/jira/browse/PIG-4323
PIG-4313StackOverflowError in LIMIT operation on Spark
https://issues.apache.org/jira/browse/PIG-4313
PIG-4251Pig on Storm
https://issues.apache.org/jira/browse/PIG-4251
PIG-4002Disable combiner when map-side aggregation is used
https://issues.apache.org/jira/browse/PIG-4002
PIG-3952PigStorage accepts '-tagSplit' to return full split information
https://issues.apache.org/jira/browse/PIG-3952
PIG-3911Define unique fields with @OutputSchema
https://issues.apache.org/jira/browse/PIG-3911
PIG-3877Getting Geo Latitude/Longitude from Address Lines
https://issues.apache.org/jira/browse/PIG-3877
PIG-3873Geo distance calculation using Haversine
https://issues.apache.org/jira/browse/PIG-3873
PIG-3668COR built-in function when atleast one of the coefficient values is 
NaN
https://issues.apache.org/jira/browse/PIG-3668
PIG-3587add functionality for rolling over dates
https://issues.apache.org/jira/browse/PIG-3587
PIG-1804Alow Jython function to implement Algebraic and/or Accumulator 
interfaces
https://issues.apache.org/jira/browse/PIG-1804

You