Re: [DISCUSS] Release Plan for 2.7

2017-09-05 Thread Raju Bairishetti 
Hi Divakar,
   How is the release testing going on?

On Fri, Aug 25, 2017 at 11:53 PM, archana h  wrote:

> Hi Raju,
> Around 60% testing is been complete. A new person (Divakar) from our team
> is working on the verification of this release.
> One more week effort is pending which will tentatively be completed by this
> month end.
>
>
> On Thu, Aug 10, 2017 at 1:11 PM, Raju Bairishetti  wrote:
>
> > Hi Archana,
> > Can you please let us know the status of release verification?
> >
> > On Tue, Jul 11, 2017 at 3:12 PM, archana h 
> wrote:
> >
> > > Yes planning to complete by july end.
> > >
> > > On Tue, Jul 11, 2017 at 5:02 AM, Raju Bairishetti 
> > wrote:
> > >
> > > > Release verification is still in progress. Expecting the verification
> > of
> > > > release to be completed by end of July.
> > > >
> > > >  @Archana, Can you please confirm from your side?
> > > >
> > > > On Mon, Jul 10, 2017 at 7:49 PM, amareshwarisr . <
> > amareshw...@gmail.com>
> > > > wrote:
> > > >
> > > > > Do we have any realistic dates now for the release? Raju and
> Archana,
> > > Can
> > > > > you help?
> > > > >
> > > > > On Mon, Jun 5, 2017 at 7:01 AM, Raju Bairishetti 
> > > > wrote:
> > > > >
> > > > > > Hi All,
> > > > > > I am adjusting the release dates as we found a few bugs in
> the
> > > > > feature
> > > > > > tasks verification.
> > > > > >
> > > > > > Updated release calendar https://cwiki.apache.org/
> > > > > confluence/display/LENS/
> > > > > > Release+Calendar with new release dates.
> > > > > >
> > > > > > On Mon, May 22, 2017 at 1:40 PM, Raju Bairishetti <
> r...@apache.org
> > >
> > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > On Mon, May 22, 2017 at 12:30 PM, amareshwarisr . <
> > > > > amareshw...@gmail.com
> > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Raju,
> > > > > > >>
> > > > > > >> We would like to get LENS-1412, LENS-981 in 2.7, both of them
> > are
> > > in
> > > > > > under
> > > > > > >> review.
> > > > > > >>
> > > > > > >
> > > > > > > Sure, We can include both LENS-1412 and LENS-981 in 2.7.
> > > > > > >
> > > > > > >
> > > > > > >> Can you wait for them to bump up version?
> > > > > > >>
> > > > > > >> I have already updated master to 2.8.  But, we can commit
> those
> > > > > patches
> > > > > > > to both master and current-release-line branch.
> > > > > > >
> > > > > > >
> > > > > > >> Thanks
> > > > > > >>
> > > > > > >> On Sun, May 21, 2017 at 5:47 PM, Raju Bairishetti <
> > > r...@apache.org>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > Hi All,
> > > > > > >> >  I have done branching for 2.7 release. Moved out a
> couple
> > > of
> > > > > > >> > unresolved issues from 2.7.
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > https://git-wip-us.apache.org/
> repos/asf?p=lens.git;a=shortlo
> > > > > > >> > g;h=refs/heads/current-release-line
> > > > > > >> >
> > > > > > >> > On Wed, May 17, 2017 at 8:04 AM, Raju Bairishetti <
> > > > r...@apache.org>
> > > > > > >> wrote:
> > > > > > >> >
> > > > > > >> > > Hi All,
> > > > > > >> > >Just a reminder, we are targeting branching for 2.7
> > release
> > > > on
> > > > > > 20th
> > > > > > >> > May.
> > > > > > >> > >
> > > > > > >> > > On Thu, May 11, 2017 at 2:06 PM, Raju Bairishetti <
> > > > > r...@apache.org>
> > > > > > >> > wrote:
> > > > > > >> > >
> > > > > > >> > >>
> > > > > > >> > >> On Thu, May 11, 2017 at 1:15 PM, amareshwarisr . <
> > > > > > >> amareshw...@gmail.com
> > > > > > >> > >
> > > > > > >> > >> wrote:
> > > > > > >> > >>
> > > > > > >> > >>> Thanks Raju for the plan. Looks good to me.
> > > > > > >> > >>>
> > > > > > >> > >>> Have moved out few issues from 2.7. Also I see next
> > release
> > > as
> > > > > > still
> > > > > > >> > 2.8,
> > > > > > >> > >>> not 3.0.
> > > > > > >> > >>>
> > > > > > >> > >> Noted.  Thanks for the correction :)
> > > > > > >> > >>
> > > > > > >> > >>>
> > > > > > >> > >>> Thanks
> > > > > > >> > >>> Amareshwari
> > > > > > >> > >>>
> > > > > > >> > >>>
> > > > > > >> > >>>
> > > > > > >> > >>> On Thu, May 11, 2017 at 7:15 AM, Raju Bairishetti <
> > > > > > r...@apache.org>
> > > > > > >> > >>> wrote:
> > > > > > >> > >>>
> > > > > > >> > >>> > Hi,
> > > > > > >> > >>> >
> > > > > > >> > >>> >I am volunteering for managing the next release.
> > > > > > >> > >>> >
> > > > > > >> > >>> > We have added some major features and improvements
> after
> > > 2.6
> > > > > > >> release.
> > > > > > >> > >>> We
> > > > > > >> > >>> > have resolved 92 issues after the 2.6.0 release.
> > > > > > >> > >>> >
> > > > > > >> > >>> > *Major Features & Improvements:*
> > > > > > >> > >>> > * Cube segmentation for Base cube
> > > > > > >> > >>> > * Support for fact to fact union (Unioning data across
> > > > facts)
> > > > > > >> > >>> > * Added a Data completeness checker to know whether
> the
> > > > > > registered
> > > > > > >> > >>> > partition has

[jira] [Commented] (LENS-1472) Populate sample metastore on example db is failing

2017-09-05 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/LENS-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154100#comment-16154100
 ] 

Hudson commented on LENS-1472:
--

UNSTABLE: Integrated in Jenkins build Lens-Commit #1440 (See 
[https://builds.apache.org/job/Lens-Commit/1440/])
LENS-1472: Populate sample metastore on example db is failing (rajatgupta59: 
rev 2b86ac2b83608efb95d9c89c10445c4a30f5)
* (edit) 
lens-examples/src/main/java/org/apache/lens/examples/PopulateSampleMetastore.java
* (edit) 
lens-examples/src/main/java/org/apache/lens/examples/SampleMetastore.java
* (add) lens-examples/src/main/resources/sales-aggr-fact2-local4.data
* (edit) lens-dist/src/main/assembly/bin-dist.xml


> Populate sample metastore on example db is failing
> --
>
> Key: LENS-1472
> URL: https://issues.apache.org/jira/browse/LENS-1472
> Project: Apache Lens
>  Issue Type: Bug
>  Components: examples
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1472.01.patch, LENS-1472.02.patch
>
>
> {noformat}
> Error Message: Internal Server Error.: 
> MetaException(message:file:/usr/local/lens/client/examples/data/sales_aggr_fact2_local4
>  is not a directory or unable to create one)
>   at 
> org.apache.lens.client.LensMetadataClient.translate(LensMetadataClient.java:73)
>   at 
> org.apache.lens.client.LensMetadataClient.addPartitionsToFactTable(LensMetadataClient.java:875)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.createFactPartitions(PopulateSampleMetastore.java:172)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateFactTables(PopulateSampleMetastore.java:196)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateAll(PopulateSampleMetastore.java:84)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.main(PopulateSampleMetastore.java:71)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (LENS-1472) Populate sample metastore on example db is failing

2017-09-05 Thread Rajat Khandelwal (JIRA) 

[ 
https://issues.apache.org/jira/browse/LENS-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154014#comment-16154014
 ] 

Rajat Khandelwal commented on LENS-1472:


Committed myself.

> Populate sample metastore on example db is failing
> --
>
> Key: LENS-1472
> URL: https://issues.apache.org/jira/browse/LENS-1472
> Project: Apache Lens
>  Issue Type: Bug
>  Components: examples
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1472.01.patch, LENS-1472.02.patch
>
>
> {noformat}
> Error Message: Internal Server Error.: 
> MetaException(message:file:/usr/local/lens/client/examples/data/sales_aggr_fact2_local4
>  is not a directory or unable to create one)
>   at 
> org.apache.lens.client.LensMetadataClient.translate(LensMetadataClient.java:73)
>   at 
> org.apache.lens.client.LensMetadataClient.addPartitionsToFactTable(LensMetadataClient.java:875)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.createFactPartitions(PopulateSampleMetastore.java:172)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateFactTables(PopulateSampleMetastore.java:196)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateAll(PopulateSampleMetastore.java:84)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.main(PopulateSampleMetastore.java:71)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (LENS-1472) Populate sample metastore on example db is failing

2017-09-05 Thread Rajat Khandelwal (JIRA) 

 [ 
https://issues.apache.org/jira/browse/LENS-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajat Khandelwal updated LENS-1472:
---
Fix Version/s: 2.8

> Populate sample metastore on example db is failing
> --
>
> Key: LENS-1472
> URL: https://issues.apache.org/jira/browse/LENS-1472
> Project: Apache Lens
>  Issue Type: Bug
>  Components: examples
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1472.01.patch, LENS-1472.02.patch
>
>
> {noformat}
> Error Message: Internal Server Error.: 
> MetaException(message:file:/usr/local/lens/client/examples/data/sales_aggr_fact2_local4
>  is not a directory or unable to create one)
>   at 
> org.apache.lens.client.LensMetadataClient.translate(LensMetadataClient.java:73)
>   at 
> org.apache.lens.client.LensMetadataClient.addPartitionsToFactTable(LensMetadataClient.java:875)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.createFactPartitions(PopulateSampleMetastore.java:172)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateFactTables(PopulateSampleMetastore.java:196)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateAll(PopulateSampleMetastore.java:84)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.main(PopulateSampleMetastore.java:71)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (LENS-1472) Populate sample metastore on example db is failing

2017-09-05 Thread Rajat Khandelwal (JIRA) 

 [ 
https://issues.apache.org/jira/browse/LENS-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajat Khandelwal updated LENS-1472:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Populate sample metastore on example db is failing
> --
>
> Key: LENS-1472
> URL: https://issues.apache.org/jira/browse/LENS-1472
> Project: Apache Lens
>  Issue Type: Bug
>  Components: examples
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1472.01.patch, LENS-1472.02.patch
>
>
> {noformat}
> Error Message: Internal Server Error.: 
> MetaException(message:file:/usr/local/lens/client/examples/data/sales_aggr_fact2_local4
>  is not a directory or unable to create one)
>   at 
> org.apache.lens.client.LensMetadataClient.translate(LensMetadataClient.java:73)
>   at 
> org.apache.lens.client.LensMetadataClient.addPartitionsToFactTable(LensMetadataClient.java:875)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.createFactPartitions(PopulateSampleMetastore.java:172)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateFactTables(PopulateSampleMetastore.java:196)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.populateAll(PopulateSampleMetastore.java:84)
>   at 
> org.apache.lens.examples.PopulateSampleMetastore.main(PopulateSampleMetastore.java:71)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (LENS-1471) JoinCandidate's children should not share same instance of a storage candidate

2017-09-05 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/LENS-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153476#comment-16153476
 ] 

Hudson commented on LENS-1471:
--

SUCCESS: Integrated in Jenkins build Lens-Commit #1439 (See 
[https://builds.apache.org/job/Lens-Commit/1439/])
LENS-1471: JoinCandidate's children should not share same storage 
(rajatgupta59: rev caf7a2c0b045ce409d254c1ff26ffd79d01fee52)
* (edit) 
lens-cube/src/main/java/org/apache/lens/cube/parse/CandidateCoveringSetsResolver.java
* (edit) 
lens-cube/src/main/java/org/apache/lens/cube/parse/StorageCandidate.java
* (edit) lens-cube/src/main/java/org/apache/lens/cube/parse/UnionCandidate.java


> JoinCandidate's children should not share same instance of a storage 
> candidate 
> ---
>
> Key: LENS-1471
> URL: https://issues.apache.org/jira/browse/LENS-1471
> Project: Apache Lens
>  Issue Type: Bug
>  Components: cube
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1471.01.patch, LENS-1471.02.patch, 
> LENS-1471.03.patch
>
>
> The issue is in Join candidates of the kind {{Join\[Union\[a,b\]; 
> Union\[a,c\]\]}}. If the instance of {{a}} is shared in different trees of a 
> JoinCandidate, the rewritten query will be wrong. JoinCandidate's children 
> set exclusive measure phrase indices, and that is done via {{retain}} method 
> of list. So let's say union1 is answering {{\[0,1\]}} measures and union2 is 
> answering {{\[2,3\]}} measures, and since 
> {{\[0,1,2,3\].retain(\[0,1\]).retain(\[2,3\]) == \[\]}}, it ends up answering 
> no measures at all



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (LENS-1471) JoinCandidate's children should not share same instance of a storage candidate

2017-09-05 Thread Rajat Khandelwal (JIRA) 

[ 
https://issues.apache.org/jira/browse/LENS-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153425#comment-16153425
 ] 

Rajat Khandelwal commented on LENS-1471:


Committed myself.

> JoinCandidate's children should not share same instance of a storage 
> candidate 
> ---
>
> Key: LENS-1471
> URL: https://issues.apache.org/jira/browse/LENS-1471
> Project: Apache Lens
>  Issue Type: Bug
>  Components: cube
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1471.01.patch, LENS-1471.02.patch, 
> LENS-1471.03.patch
>
>
> The issue is in Join candidates of the kind {{Join\[Union\[a,b\]; 
> Union\[a,c\]\]}}. If the instance of {{a}} is shared in different trees of a 
> JoinCandidate, the rewritten query will be wrong. JoinCandidate's children 
> set exclusive measure phrase indices, and that is done via {{retain}} method 
> of list. So let's say union1 is answering {{\[0,1\]}} measures and union2 is 
> answering {{\[2,3\]}} measures, and since 
> {{\[0,1,2,3\].retain(\[0,1\]).retain(\[2,3\]) == \[\]}}, it ends up answering 
> no measures at all



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (LENS-1471) JoinCandidate's children should not share same instance of a storage candidate

2017-09-05 Thread Rajat Khandelwal (JIRA) 

 [ 
https://issues.apache.org/jira/browse/LENS-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajat Khandelwal updated LENS-1471:
---
Fix Version/s: 2.8

> JoinCandidate's children should not share same instance of a storage 
> candidate 
> ---
>
> Key: LENS-1471
> URL: https://issues.apache.org/jira/browse/LENS-1471
> Project: Apache Lens
>  Issue Type: Bug
>  Components: cube
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1471.01.patch, LENS-1471.02.patch, 
> LENS-1471.03.patch
>
>
> The issue is in Join candidates of the kind {{Join\[Union\[a,b\]; 
> Union\[a,c\]\]}}. If the instance of {{a}} is shared in different trees of a 
> JoinCandidate, the rewritten query will be wrong. JoinCandidate's children 
> set exclusive measure phrase indices, and that is done via {{retain}} method 
> of list. So let's say union1 is answering {{\[0,1\]}} measures and union2 is 
> answering {{\[2,3\]}} measures, and since 
> {{\[0,1,2,3\].retain(\[0,1\]).retain(\[2,3\]) == \[\]}}, it ends up answering 
> no measures at all



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (LENS-1471) JoinCandidate's children should not share same instance of a storage candidate

2017-09-05 Thread Rajat Khandelwal (JIRA) 

 [ 
https://issues.apache.org/jira/browse/LENS-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajat Khandelwal updated LENS-1471:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> JoinCandidate's children should not share same instance of a storage 
> candidate 
> ---
>
> Key: LENS-1471
> URL: https://issues.apache.org/jira/browse/LENS-1471
> Project: Apache Lens
>  Issue Type: Bug
>  Components: cube
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.8
>
> Attachments: LENS-1471.01.patch, LENS-1471.02.patch, 
> LENS-1471.03.patch
>
>
> The issue is in Join candidates of the kind {{Join\[Union\[a,b\]; 
> Union\[a,c\]\]}}. If the instance of {{a}} is shared in different trees of a 
> JoinCandidate, the rewritten query will be wrong. JoinCandidate's children 
> set exclusive measure phrase indices, and that is done via {{retain}} method 
> of list. So let's say union1 is answering {{\[0,1\]}} measures and union2 is 
> answering {{\[2,3\]}} measures, and since 
> {{\[0,1,2,3\].retain(\[0,1\]).retain(\[2,3\]) == \[\]}}, it ends up answering 
> no measures at all



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Review Request 62060: LENS-1471: JoinCandidate's children should not share same storage candidate

2017-09-05 Thread Puneet Gupta 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62060/#review184519
---


Ship it!




Ship It!

- Puneet Gupta


On Sept. 4, 2017, 12:50 p.m., Rajat Khandelwal wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62060/
> ---
> 
> (Updated Sept. 4, 2017, 12:50 p.m.)
> 
> 
> Review request for lens.
> 
> 
> Bugs: LENS-1471
> https://issues.apache.org/jira/browse/LENS-1471
> 
> 
> Repository: lens
> 
> 
> Description
> ---
> 
> The issue is in Join candidates of the kind {{Join\[Union\[a,b\]; 
> Union\[a,c\]\]}}. If the instance of {{a}} is shared in different trees of a 
> JoinCandidate, the rewritten query will be wrong. JoinCandidate's children 
> set exclusive measure phrase indices, and that is done via truncate method of 
> list. So let's say union1 is answering {{\[0,1\]}} measures and union2 is 
> answering {{\[2,3\]}} measures, and since 
> {{\[0,1,2,3\].retain(\[0,1\]).retain(\[2,3\]) == \[\]}}, it ends up answering 
> no measures at all
> 
> 
> Diffs
> -
> 
>   
> lens-cube/src/main/java/org/apache/lens/cube/parse/CandidateCoveringSetsResolver.java
>  1cff4a424fddb7e124531837ce29a5d8ed97d49c 
>   lens-cube/src/main/java/org/apache/lens/cube/parse/StorageCandidate.java 
> 27835b371c51579ae35d526fc6245f6cf5c7ffb4 
>   lens-cube/src/main/java/org/apache/lens/cube/parse/UnionCandidate.java 
> 510ea0c5b1edf1dd60b5380ba3b2a47844ed2219 
> 
> 
> Diff: https://reviews.apache.org/r/62060/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Rajat Khandelwal
> 
>