[jira] [Updated] (PIG-4728) Compilation against hbase 1.x fails with hbase-hadoop1-compat not found

2015-11-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4728: Issue Type: Improvement (was: Bug) There will be several dependency and test failures to fix to upgrade. So

[jira] [Resolved] (PIG-4727) Incorrect types table for AVG in docs

2015-11-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4727. - Resolution: Fixed Assignee: Nathan Smith Hadoop Flags: Reviewed Fix Version/s: 0.16.0

[jira] [Resolved] (PIG-4725) Typo in FrontendException messages "Incompatable"

2015-11-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4725. - Resolution: Fixed Assignee: Nathan Smith Hadoop Flags: Reviewed Fix Version/s: 0.16.0

[jira] [Commented] (PIG-4726) "Incompatable field schema" with MIN(datetime_field) and explicit output type

2015-11-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989056#comment-14989056 ] Daniel Dai commented on PIG-4726: - The walk around is not declare type in AS subclause. This might be some

[jira] [Comment Edited] (PIG-4726) "Incompatable field schema" with MIN(datetime_field) and explicit output type

2015-11-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989056#comment-14989056 ] Daniel Dai edited comment on PIG-4726 at 11/4/15 7:27 AM: -- The work around is not

[jira] [Updated] (PIG-4707) [Pig on Tez] Streaming job hangs with pig.exec.mapPartAgg=true

2015-11-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4707: Fix Version/s: 0.15.1 Backport to 0.15 branch. > [Pig on Tez] Streaming job hangs with

[jira] [Updated] (PIG-4712) [Pig on Tez] NPE in Bloom UDF after Union

2015-11-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4712: Fix Version/s: 0.15.1 Backport to 0.15 branch. > [Pig on Tez] NPE in Bloom UDF after Union >

[jira] [Updated] (PIG-4696) Empty map returned by a streaming_python udf wrongly contains a null key

2015-11-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4696: Fix Version/s: 0.15.1 Backport to 0.15 branch. > Empty map returned by a streaming_python udf wrongly

[jira] [Updated] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-11-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4679: Fix Version/s: 0.15.1 Backport to 0.15 branch. > Performance degradation due to InputSizeReducerEstimator

[jira] [Updated] (PIG-4644) PORelationToExprProject.clone() is broken

2015-11-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4644: Fix Version/s: 0.15.1 Backport the patch to 0.15 branch. > PORelationToExprProject.clone() is broken >

[jira] [Commented] (PIG-4713) Document Bloom UDF

2015-10-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983689#comment-14983689 ] Daniel Dai commented on PIG-4713: - It should be in Eval Functions section. > Document Bloom UDF >

[jira] [Updated] (PIG-4713) Document Bloom UDF

2015-10-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4713: Resolution: Fixed Assignee: Gabor Liptak Hadoop Flags: Reviewed Fix Version/s: 0.16.0

[jira] [Updated] (PIG-4721) IsEmpty documentation error

2015-10-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4721: Attachment: PIG-4721.patch > IsEmpty documentation error > --- > >

[jira] [Resolved] (PIG-4721) IsEmpty documentation error

2015-10-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4721. - Resolution: Fixed Assignee: Nathan Smith Fix Version/s: 0.16.0 Fixed. Thanks Nathan! >

[jira] [Resolved] (PIG-4704) Customizable Error Handling for Storers in Pig

2015-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4704. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.16.0 Patch committed to trunk. Thanks

[jira] [Created] (PIG-4719) Documentation for PIG-4704: Customizable Error Handling for Storers in Pig

2015-10-28 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4719: --- Summary: Documentation for PIG-4704: Customizable Error Handling for Storers in Pig Key: PIG-4719 URL: https://issues.apache.org/jira/browse/PIG-4719 Project: Pig

[jira] [Commented] (PIG-4704) Customizable Error Handling for Storers in Pig

2015-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979276#comment-14979276 ] Daniel Dai commented on PIG-4704: - The patch looks quite good. Some comments however: 1. I am thinking about

[jira] [Commented] (PIG-4704) Customizable Error Handling for Storers in Pig

2015-10-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979308#comment-14979308 ] Daniel Dai commented on PIG-4704: - bq. 2. The reason for having a config was to say even though the

[jira] [Commented] (PIG-4684) Exception should be changed to warning when job diagnostics cannot be fetched

2015-10-27 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976761#comment-14976761 ] Daniel Dai commented on PIG-4684: - I don't think so. It's not a user facing API. > Exception should be

[jira] [Updated] (PIG-4717) Update Apache HTTPD LogParser to latest version

2015-10-27 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4717: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1. Patch

[jira] [Commented] (PIG-4417) Pig's register command should support automatic fetching of jars from repo.

2015-10-27 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977083#comment-14977083 ] Daniel Dai commented on PIG-4417: - Ok, I am fine to add this. Several minor comments: 1. Config

[jira] [Commented] (PIG-4687) Trouble ordering bigdecimal data within a foreach

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973808#comment-14973808 ] Daniel Dai commented on PIG-4687: - The script posted apparently will not produce the result you mentioned. I

[jira] [Updated] (PIG-4705) Error Schema for data cannot be determined using HCatalog

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4705: Fix Version/s: 0.16.0 > Error Schema for data cannot be determined using HCatalog >

[jira] [Resolved] (PIG-4705) Error Schema for data cannot be determined using HCatalog

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4705. - Resolution: Duplicate This issue is the same as PIG-4703. As per the internal ticket in Hortonworks,

[jira] [Updated] (PIG-4468) Pig's jackson version conflicts with that of hadoop 2.6.0 or newer

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4468: Resolution: Fixed Assignee: Jeff Zhang Hadoop Flags: Reviewed Fix Version/s: 0.16.0

[jira] [Commented] (PIG-4689) CSV Writes incorrect header if two CSV files are created in one script

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975131#comment-14975131 ] Daniel Dai commented on PIG-4689: - Can you add your test case to TestCSVExcelStorage? > CSV Writes

[jira] [Updated] (PIG-4468) Pig's jackson version conflicts with that of hadoop 2.6.0 or newer

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4468: Attachment: PIG-4468-2.patch Fix TestRegisteredJarVisibility test failure. Also tested on Hadoop 1 and works.

[jira] [Commented] (PIG-4708) Upgrade joda-time to 2.8

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974998#comment-14974998 ] Daniel Dai commented on PIG-4708: - Upgrade to joda-time 2.8 should be totally doable. +1 on

[jira] [Updated] (PIG-4714) Improve logging across multiple components with callerId

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4714: Attachment: PIG-4714-1.patch Attach initial patch. > Improve logging across multiple components with

[jira] [Updated] (PIG-4714) Improve logging across multiple components with callerId

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4714: Attachment: PIG-4714-1.patch > Improve logging across multiple components with callerId >

[jira] [Updated] (PIG-4714) Improve logging across multiple components with callerId

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4714: Attachment: (was: PIG-4714-1.patch) > Improve logging across multiple components with callerId >

[jira] [Created] (PIG-4715) Pig 0.14 does not work with Tez 0.5.4

2015-10-26 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4715: --- Summary: Pig 0.14 does not work with Tez 0.5.4 Key: PIG-4715 URL: https://issues.apache.org/jira/browse/PIG-4715 Project: Pig Issue Type: Bug Components:

[jira] [Created] (PIG-4714) Improve logging across multiple components with callerId

2015-10-26 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4714: --- Summary: Improve logging across multiple components with callerId Key: PIG-4714 URL: https://issues.apache.org/jira/browse/PIG-4714 Project: Pig Issue Type:

[jira] [Updated] (PIG-4715) Pig 0.14 does not work with Tez 0.5.4

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4715: Attachment: PIG-4715-1.patch > Pig 0.14 does not work with Tez 0.5.4 > -

[jira] [Commented] (PIG-4697) Serialize relevant part of the udfcontext per vertex to reduce payload size

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974783#comment-14974783 ] Daniel Dai commented on PIG-4697: - Makes sense. +1. > Serialize relevant part of the udfcontext per vertex

[jira] [Commented] (PIG-4712) [Pig on Tez] NPE in Bloom UDF after Union

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974784#comment-14974784 ] Daniel Dai commented on PIG-4712: - +1 > [Pig on Tez] NPE in Bloom UDF after Union >

[jira] [Commented] (PIG-4697) Serialize relevant part of the udfcontext per vertex to reduce payload size

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974709#comment-14974709 ] Daniel Dai commented on PIG-4697: - Seems you fix it by decrease Loader instantiation of

[jira] [Commented] (PIG-4712) [Pig on Tez] NPE in Bloom UDF after Union

2015-10-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974703#comment-14974703 ] Daniel Dai commented on PIG-4712: - I am not sure if changing Bloom_1 is better or just adding a new test,

[jira] [Commented] (PIG-4704) Customizable Error Handling for Storers in Pig

2015-10-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973733#comment-14973733 ] Daniel Dai commented on PIG-4704: - [~siddhimehta], you are right about the hooks for storer. We need to hook

[jira] [Commented] (PIG-4707) [Pig on Tez] Streaming job hangs with pig.exec.mapPartAgg=true

2015-10-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972483#comment-14972483 ] Daniel Dai commented on PIG-4707: - This fix should be quite safe. Once Pig see a EOS (stream process

[jira] [Commented] (PIG-4707) [Pig on Tez] Streaming job hangs with pig.exec.mapPartAgg=true

2015-10-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969826#comment-14969826 ] Daniel Dai commented on PIG-4707: - Yes, it hangs without fix. I probably run with MR. I will review shortly.

[jira] [Commented] (PIG-4707) [Pig on Tez] Streaming job hangs with pig.exec.mapPartAgg=true

2015-10-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967841#comment-14967841 ] Daniel Dai commented on PIG-4707: - The test pass for me. However, the new test pass even before I apply the

[jira] [Updated] (PIG-4703) TezOperator.stores shall not ship to backend

2015-10-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4703: Patch committed to both trunk and 0.15 branch. Thanks Rohini for review! > TezOperator.stores shall not ship to

[jira] [Updated] (PIG-4703) TezOperator.stores shall not ship to backend

2015-10-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4703: Attachment: PIG-4703-2.patch Agree TezOperator.stores is not needed. UDFContext is not a concern now since

[jira] [Commented] (PIG-4697) Serialize relevant part of the udfcontext per vertex to reduce payload size

2015-10-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961449#comment-14961449 ] Daniel Dai commented on PIG-4697: - +1 > Serialize relevant part of the udfcontext per vertex to reduce

[jira] [Created] (PIG-4703) TezOperator.stores shall not ship to backend

2015-10-15 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4703: --- Summary: TezOperator.stores shall not ship to backend Key: PIG-4703 URL: https://issues.apache.org/jira/browse/PIG-4703 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-4702) Load once for sampling and partitioning in order by for certain LoadFuncs

2015-10-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959386#comment-14959386 ] Daniel Dai commented on PIG-4702: - +1. Why Native_2 failing by PIG-4574? > Load once for sampling and

[jira] [Updated] (PIG-4703) TezOperator.stores shall not ship to backend

2015-10-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4703: Attachment: PIG-4703-1.patch > TezOperator.stores shall not ship to backend >

[jira] [Updated] (PIG-4703) TezOperator.stores shall not ship to backend

2015-10-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4703: Status: Patch Available (was: Open) > TezOperator.stores shall not ship to backend >

[jira] [Commented] (PIG-4670) Embedded Python scripts still parse line by line

2015-10-12 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954095#comment-14954095 ] Daniel Dai commented on PIG-4670: - +1 > Embedded Python scripts still parse line by line >

[jira] [Commented] (PIG-4699) Print Job stats information in Tez like mapreduce

2015-10-12 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954124#comment-14954124 ] Daniel Dai commented on PIG-4699: - +1 > Print Job stats information in Tez like mapreduce >

[jira] [Commented] (PIG-4695) Using 'replicated' left join results in different result from regular left join.

2015-10-12 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954381#comment-14954381 ] Daniel Dai commented on PIG-4695: - I've tried 0.15.0 and also cannot reproduce. Can you provide more details

[jira] [Commented] (PIG-4673) Built In UDF - REPLACE_MULTI : For a given string, search and replace all occurrences of search keys with replacement values.

2015-10-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949663#comment-14949663 ] Daniel Dai commented on PIG-4673: - +1. Patch does not apply now, assume you will need to move the file first

[jira] [Commented] (PIG-4554) Compress pig.script before encoding

2015-10-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949664#comment-14949664 ] Daniel Dai commented on PIG-4554: - +1 > Compress pig.script before encoding >

[jira] [Commented] (PIG-4670) Embedded Python scripts still parse line by line

2015-10-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949668#comment-14949668 ] Daniel Dai commented on PIG-4670: - I see you disable illustrate tests for tez. What are other changes about?

[jira] [Commented] (PIG-3957) Refactor out resetting input key in TezDagBuilder

2015-10-06 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944614#comment-14944614 ] Daniel Dai commented on PIG-3957: - +1 > Refactor out resetting input key in TezDagBuilder >

[jira] [Commented] (PIG-4691) [Pig on Tez] Support for whitelisting storefuncs for union optimization

2015-10-06 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945808#comment-14945808 ] Daniel Dai commented on PIG-4691: - +1 > [Pig on Tez] Support for whitelisting storefuncs for union

[jira] [Commented] (PIG-4688) Limit followed by POPartialAgg can give empty or partial results in Tez

2015-10-05 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943753#comment-14943753 ] Daniel Dai commented on PIG-4688: - +1 > Limit followed by POPartialAgg can give empty or partial results in

[jira] [Commented] (PIG-4670) Embedded Python scripts still parse line by line

2015-10-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941868#comment-14941868 ] Daniel Dai commented on PIG-4670: - +1 > Embedded Python scripts still parse line by line >

[jira] [Commented] (PIG-4670) Embedded Python scripts still parse line by line

2015-09-30 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939035#comment-14939035 ] Daniel Dai commented on PIG-4670: - +1. Can you put an explanation why no test added? > Embedded Python

[jira] [Updated] (PIG-4635) NPE while running pig script in tez mode( pig 0.15 with tez 0.7)

2015-09-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4635: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-4635) NPE while running pig script in tez mode( pig 0.15 with tez 0.7)

2015-09-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4635: Attachment: PIG-4635-2.patch Yes, maintaining another variable is safer, I can do that. I do want the

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Commented] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905011#comment-14905011 ] Daniel Dai commented on PIG-4683: - New patch fixed unit test failures. > Nested order is broken after

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Attachment: PIG-4683-2.patch > Nested order is broken after PIG-3591 in some cases >

[jira] [Updated] (PIG-4635) NPE while running pig script in tez mode( pig 0.15 with tez 0.7)

2015-09-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4635: Status: Patch Available (was: Open) > NPE while running pig script in tez mode( pig 0.15 with tez 0.7) >

[jira] [Assigned] (PIG-4635) NPE while running pig script in tez mode( pig 0.15 with tez 0.7)

2015-09-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-4635: --- Assignee: Daniel Dai (was: Rohini Palaniswamy) > NPE while running pig script in tez mode( pig 0.15

[jira] [Updated] (PIG-4635) NPE while running pig script in tez mode( pig 0.15 with tez 0.7)

2015-09-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4635: Attachment: PIG-4635-1.patch Finally get a reproduction. The issue is caused by transient variable

[jira] [Updated] (PIG-4674) TOMAP should infer schema

2015-09-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4674: Attachment: PIG-4674-fixtest2.patch Another unit test failure patch. > TOMAP should infer schema >

[jira] [Updated] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-22 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4679: Attachment: PIG-4679-fixtest.patch Fix a unit test failure. > Performance degradation due to

[jira] [Commented] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901641#comment-14901641 ] Daniel Dai commented on PIG-4683: - [~rohini] 1) No, because currently SecondaryKeyOptimizerTez does not

[jira] [Updated] (PIG-3635) Fix e2e tests for Hadoop 2.X on Windows

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3635: Resolution: Not A Problem Status: Resolved (was: Patch Available) Yes, Windows tests has been fixed.

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Attachment: PIG-4683-1.patch > Nested order is broken after PIG-3591 in some cases >

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Status: Patch Available (was: Open) > Nested order is broken after PIG-3591 in some cases >

[jira] [Comment Edited] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901228#comment-14901228 ] Daniel Dai edited comment on PIG-4683 at 9/21/15 7:23 PM: -- The reason is

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Fix Version/s: 0.15.1 > Nested order is broken after PIG-3591 in some cases >

[jira] [Created] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4683: --- Summary: Nested order is broken after PIG-3591 in some cases Key: PIG-4683 URL: https://issues.apache.org/jira/browse/PIG-4683 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Description: The following script fail after > Nested order is broken after PIG-3591 in some cases >

[jira] [Updated] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4683: Description: The following script fail after PIG-3591. {code} a = load '1.txt' using PigStorage(',') as

[jira] [Commented] (PIG-4683) Nested order is broken after PIG-3591 in some cases

2015-09-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901228#comment-14901228 ] Daniel Dai commented on PIG-4683: - The reason is PigSecondaryKeyComparator doesn't sort on index. But

[jira] [Updated] (PIG-4674) TOMAP should infer schema

2015-09-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4674: Attachment: PIG-4674-fixtest.patch Commit PIG-4674-fixtest.patch to fix unit test failure. > TOMAP should

[jira] [Commented] (PIG-4673) Built In UDF - REPLACE_MULTI : For a given string, search and replace all occurrences of search keys with replacement values.

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14790701#comment-14790701 ] Daniel Dai commented on PIG-4673: - I cannot see the patch, can you attach to the Jira? > Built In UDF -

[jira] [Updated] (PIG-4676) Upgrade Hive to 1.2.1

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4676: Attachment: PIG-4676-fixtest.patch TestLoaderStorerShipCacheFiles is broken by the patch. Attach fix. >

[jira] [Updated] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4679: Attachment: PIG-4679-1.patch > Performance degradation due to InputSizeReducerEstimator since PIG-3754 >

[jira] [Updated] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4679: Status: Patch Available (was: Open) > Performance degradation due to InputSizeReducerEstimator since

[jira] [Updated] (PIG-4673) Built In UDF - REPLACE_MULTI : For a given string, search and replace all occurrences of search keys with replacement values.

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4673: Attachment: PIG-4673-1.patch Move the code to piggybank, adjust the format. Otherwise looks good. Will check

[jira] [Updated] (PIG-4674) TOMAP should infer schema

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4674: Attachment: PIG-4674-3.patch Yes, there is a hole. Apply suggested change. > TOMAP should infer schema >

[jira] [Updated] (PIG-4674) TOMAP should infer schema

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4674: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Comment Edited] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791485#comment-14791485 ] Daniel Dai edited comment on PIG-4679 at 9/17/15 2:39 AM: -- Patch committed to

[jira] [Commented] (PIG-4676) Upgrade Hive to 1.2.1

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791481#comment-14791481 ] Daniel Dai commented on PIG-4676: - PIG-4676-fixtest.patch committed. > Upgrade Hive to 1.2.1 >

[jira] [Updated] (PIG-4673) Built In UDF - REPLACE_MULTI : For a given string, search and replace all occurrences of search keys with replacement values.

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4673: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: (was: site) 0.16.0

[jira] [Updated] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4679: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4679: Attachment: PIG-4679-0.patch We don't estimate size for non-hdfs inputs before 0.12. However, we will use

[jira] [Created] (PIG-4679) Performance degradation due to InputSizeReducerEstimator since PIG-3754

2015-09-15 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4679: --- Summary: Performance degradation due to InputSizeReducerEstimator since PIG-3754 Key: PIG-4679 URL: https://issues.apache.org/jira/browse/PIG-4679 Project: Pig Issue

[jira] [Updated] (PIG-4676) Upgrade Hive to 1.2.1

2015-09-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4676: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch

[jira] [Updated] (PIG-4674) TOMAP should infer schema

2015-09-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4674: Attachment: PIG-4674-2.patch Yes, that is missing. Attach second patch. > TOMAP should infer schema >

[jira] [Updated] (PIG-1387) Syntactical Sugar for PIG-1385

2015-09-12 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1387: Assignee: Gianmarco De Francisci Morales (was: Daniel Dai) > Syntactical Sugar for PIG-1385 >

[jira] [Assigned] (PIG-1387) Syntactical Sugar for PIG-1385

2015-09-12 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1387: --- Assignee: Daniel Dai (was: Gianmarco De Francisci Morales) > Syntactical Sugar for PIG-1385 >

[jira] [Created] (PIG-4674) TOMAP should infer schema

2015-09-11 Thread Daniel Dai (JIRA)
Daniel Dai created PIG-4674: --- Summary: TOMAP should infer schema Key: PIG-4674 URL: https://issues.apache.org/jira/browse/PIG-4674 Project: Pig Issue Type: Bug Components: impl

[jira] [Updated] (PIG-4674) TOMAP should infer schema

2015-09-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4674: Attachment: PIG-4674-1.patch > TOMAP should infer schema > - > > Key:

<    3   4   5   6   7   8   9   10   11   12   >