[jira] [Updated] (PIG-2934) HBaseStorage filter optimizations

2012-11-19 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-2934: - Resolution: Fixed Release Note: HBaseStorage filter performance improvements Status: Resolve

[jira] [Created] (PIG-3059) Global configurable minimum 'bad record' thresholds

2012-11-19 Thread Russell Jurney (JIRA)
Russell Jurney created PIG-3059: --- Summary: Global configurable minimum 'bad record' thresholds Key: PIG-3059 URL: https://issues.apache.org/jira/browse/PIG-3059 Project: Pig Issue Type: New Fea

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2012-11-19 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500875#comment-13500875 ] Russell Jurney commented on PIG-3015: - Suggest to check out the work Jon did in PIG-2614

[jira] [Updated] (PIG-2934) HBaseStorage filter optimizations

2012-11-19 Thread Bill Graham (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Graham updated PIG-2934: - Fix Version/s: 0.11 > HBaseStorage filter optimizations > - > >

Re: Review Request: PIG-2978 TestLoadStoreFuncLifeCycle fails with hadoop-2.0.x

2012-11-19 Thread Rohini Palaniswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/8121/#review13603 --- Ship it! test/org/apache/pig/TestLoadStoreFuncLifeCycle.java

Re: Our release process

2012-11-19 Thread Santhosh M S
The push for an upgrade will work only if the higher release is backward compatible with the lower release. If not, folks will tend to use private branches. Having a stable branch on a large deployment is a good indicator of stability. However, please note that there have been instances where so

Build failed in Jenkins: Pig-trunk #1364

2012-11-19 Thread Apache Jenkins Server
See Changes: [cheolsoo] PIG-2924 PigStats should not be assuming all Storage classes to be file-based storage [rohini] PIG-3039: Not possible to use custom version of jackson jars (rohini) -- [...tru

Re: Pig 0.11

2012-11-19 Thread Julien Le Dem
the link: https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+PIG+AND+fixVersion+%3D+%220.11%22+AND+resolution+%3D+Unresolved+ORDER+BY+updated+DESC%2C+due+ASC%2C+priority+DESC On Mon, Nov 19, 2012 at 12:27 PM, Julien Le Dem wrote: > I took a pass at this, > I

Re: Pig 0.11

2012-11-19 Thread Julien Le Dem
I took a pass at this, I unlinked a bunch of tickets and we're down to 19 I removed new features and things that had not been touched in a while and seemed stalled. See query: project = PIG AND fixVersion = "0.11" AND resolution = Unresolved ORDER BY updated DESC, due ASC, priority DESC Some of th

[jira] [Updated] (PIG-2407) Clean up warning messages for hadoop 23

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2407: --- Fix Version/s: (was: 0.11) any progress on this? > Clean up warning messages for h

[jira] [Updated] (PIG-2416) 23 local mode enter into infinite loop if mapred-site.xml in classpath

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2416: --- Fix Version/s: (was: 0.11) any progress on this? > 23 local mode enter into infini

[jira] [Updated] (PIG-2446) Fix map input bytes for hadoop 20.203+

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2446: --- Fix Version/s: (was: 0.11) 0.12 this will be in a future release

[jira] [Updated] (PIG-2537) Output from flatten with a null tuple input generating data inconsistent with the schema

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2537: --- Fix Version/s: (was: 0.11) 0.12 It does not seem it will be in 0.11 either

[jira] [Updated] (PIG-2633) Create a SchemaBag which generates a Bag with a known Schema via code gen

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2633: --- Fix Version/s: (was: 0.11) 0.12 This will go in a future release

[jira] [Commented] (PIG-2493) UNION causes casting issues

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500607#comment-13500607 ] Julien Le Dem commented on PIG-2493: please resolve this ticket and open a separate one

[jira] [Updated] (PIG-2978) TestLoadStoreFuncLifeCycle fails with hadoop-2.0.x

2012-11-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2978: --- Status: Open (was: Patch Available) Thanks Julien for your comment. I will take a further look at this

[jira] [Updated] (PIG-2674) Document how parameter values that contain spaces can be passed to Pig

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2674: --- Fix Version/s: (was: 0.10.1) (was: 0.11) this will be fixed in a future rele

[jira] [Updated] (PIG-2767) Pig creates wrong schema after dereferencing nested tuple fields

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2767: --- Fix Version/s: (was: 0.11) This will be fixed in a future release > Pig creates wr

[jira] [Updated] (PIG-2522) deprecated hdfs pig commands do not work well with client side tables

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2522: --- Fix Version/s: (was: 0.11) > deprecated hdfs pig commands do not work well with client side tab

[jira] [Updated] (PIG-2643) Use bytecode generation to make a performance replacement for InvokeForLong, InvokeForString, etc

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2643: --- Fix Version/s: (was: 0.10.1) (was: 0.11) this will go in a future version

[jira] [Commented] (PIG-2583) Add Grunt command to list the statements in cache

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500589#comment-13500589 ] Julien Le Dem commented on PIG-2583: Please open a new ticket for this and resolve this

[jira] [Updated] (PIG-2348) Bloom should be able to take a relation or a file

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2348: --- Fix Version/s: (was: 0.11) This will go in a future version > Bloom should be able

[jira] [Commented] (PIG-2982) add unit tests for DateTime type that test setting timezone

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500587#comment-13500587 ] Julien Le Dem commented on PIG-2982: If this is committed, can you resolve the ticket?

[jira] [Commented] (PIG-2978) TestLoadStoreFuncLifeCycle fails with hadoop-2.0.x

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500586#comment-13500586 ] Julien Le Dem commented on PIG-2978: Thanks Cheolsoo for investigating this. Yes the goa

[jira] [Updated] (PIG-2657) Print warning if using wrong jython version

2012-11-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2657: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Closing it as a 'won't fix'.

[jira] [Updated] (PIG-2924) PigStats should not be assuming all Storage classes to be file-based storage

2012-11-19 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2924: --- Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Available) Bill g

[jira] [Commented] (PIG-2956) Invalid cache specification for some streaming statement

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500580#comment-13500580 ] Julien Le Dem commented on PIG-2956: you should still catch exceptions that come out of

[jira] [Updated] (PIG-2939) Pig macros need namespaces to avoid namespace collisions facilitate macro sharing

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2939: --- Fix Version/s: (was: 0.11) This will go in a future release > Pig macros need name

[jira] [Commented] (PIG-2907) Publish pig 0.23 jars to maven

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500572#comment-13500572 ] Julien Le Dem commented on PIG-2907: Unless there is a patch soon available, we should m

[jira] [Updated] (PIG-2889) HBaseAvroStorage UDF

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2889: --- Fix Version/s: (was: 0.11) This will go in a future release > HBaseAvroStorage UDF

[jira] [Commented] (PIG-2815) class loader management in PigContext

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500567#comment-13500567 ] Julien Le Dem commented on PIG-2815: It sounds like this has been committed. Can you res

[jira] [Updated] (PIG-2746) Pig doesn't detect all forms of compression extensions properly

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2746: --- Fix Version/s: (was: 0.11) Will go in a future release > Pig doesn't detect all fo

[jira] [Updated] (PIG-2552) Better Property handling to deal with deprecation and variable substitution of Hadoop config

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2552: --- Fix Version/s: (was: 0.11) This will go in a future release > Better Property hand

[jira] [Updated] (PIG-2424) Add OUTER_FLATTEN operator which, on an empty bag, returns null instead of throwing away the row

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2424: --- Fix Version/s: (was: 0.11) This will go in a future release > Add OUTER_FLATTEN op

[jira] [Updated] (PIG-2423) document use case where co-group is better choice than join

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2423: --- Fix Version/s: (was: 0.11) This will go in a future release > document use case wh

[jira] [Updated] (PIG-2343) QueryParserUtils.getRemoteHosts die for some URL

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2343: --- Fix Version/s: (was: 0.11) This will go in a future release > QueryParserUtils.get

[jira] [Updated] (PIG-2312) NPE when relation and column share the same name and used in Nested Foreach

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2312: --- Fix Version/s: (was: 0.11) Release Note: Unlinking from 0.11 for the same reason > NPE whe

[jira] [Updated] (PIG-1967) deprecate current syntax for casting relation as scalar, to use explicit cast to tuple

2012-11-19 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-1967: --- Fix Version/s: (was: 0.11) 0.12 This will go in a future release

Re: Pig 0.11

2012-11-19 Thread Julien Le Dem
We should start unlinking all the tickets that are not bug fixes. I will take a first pass at this. Julien On Sun, Nov 4, 2012 at 8:19 PM, Olga Natkovich wrote: > We are still at 43 open tickets. How do you guys like to proceed? > > Olga > > > > - Original Message - > From: Olga Natkovic

include HBaseStorage patch in Pig 0.11

2012-11-19 Thread Bill Graham
Hi, We found a P1 performance blocker in how HBase column filters were implemented in HBaseStorage that effects Pig 0.11: https://issues.apache.org/jira/browse/PIG-2934 We've been running this code in production for a week now and are confident in the fix. I'd like to commit this to the Pig 0.11

[jira] [Commented] (PIG-2127) PigStorageSchema need to deal with missing field

2012-11-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500468#comment-13500468 ] Koji Noguchi commented on PIG-2127: --- bq. Vivek, bq. Please open a new jira linked to this

[jira] [Updated] (PIG-3056) CLONE - PigStorageSchema need to deal with missing field

2012-11-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3056: -- Fix Version/s: (was: 0.10.0) > CLONE - PigStorageSchema need to deal with missing field > ---

[jira] [Created] (PIG-3056) CLONE - PigStorageSchema need to deal with missing field

2012-11-19 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3056: - Summary: CLONE - PigStorageSchema need to deal with missing field Key: PIG-3056 URL: https://issues.apache.org/jira/browse/PIG-3056 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-3014) CurrentTime() UDF has undesirable characteristics

2012-11-19 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500450#comment-13500450 ] Jonathan Coveney commented on PIG-3014: --- Thanks for fixing my patch over the weekend,

[jira] [Updated] (PIG-3039) Not possible to use custom version of jackson jars

2012-11-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3039: Resolution: Fixed Fix Version/s: 0.11 Status: Resolved (was: Patch Availabl

[jira] [Commented] (PIG-3014) CurrentTime() UDF has undesirable characteristics

2012-11-19 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500155#comment-13500155 ] Rohini Palaniswamy commented on PIG-3014: - bq. Apparently, job.getJobConf() returns

[jira] [Resolved] (PIG-2281) pig-0.8.1: some unit test case failed with open source JDK

2012-11-19 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang fang chen resolved PIG-2281. - Resolution: Fixed Fix Version/s: 0.11 Duplicated with PIG-2405 > pig-0.8.1:

[jira] [Updated] (PIG-2281) pig-0.8.1: some unit test case failed with open source JDK

2012-11-19 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang fang chen updated PIG-2281: Assignee: fang fang chen > pig-0.8.1: some unit test case failed with open source JDK > -