[jira] [Updated] (LENS-289) Add doc/ run book for debugging query failures

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti updated LENS-289:
--
Fix Version/s: (was: 2.4)
   2.5

> Add doc/ run book for debugging query failures
> --
>
> Key: LENS-289
> URL: https://issues.apache.org/jira/browse/LENS-289
> Project: Apache Lens
>  Issue Type: Task
>  Components: docs, operations
>Reporter: Amareshwari Sriramadasu
> Fix For: 2.5
>
>
> This doc should capture the various query failure reasons and a way for user 
> to take next step.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (LENS-290) Add doc/run book for failures of lens REST api

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti updated LENS-290:
--
Fix Version/s: (was: 2.4)
   2.5

> Add doc/run book for failures of lens REST api
> --
>
> Key: LENS-290
> URL: https://issues.apache.org/jira/browse/LENS-290
> Project: Apache Lens
>  Issue Type: Task
>  Components: docs, operations
>Reporter: Amareshwari Sriramadasu
> Fix For: 2.5
>
>
> This doc should capture various responses that could be returned from REST 
> api and debugging steps.
> We can add them in java doc itself, they by goes in REST api generated doc. 
> Thoughts?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (LENS-826) lens.client.query.poll.interval needs doc update

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti updated LENS-826:
--
Attachment: LENS-826.patch

Trivial change. Attaching directly.

> lens.client.query.poll.interval needs doc update
> 
>
> Key: LENS-826
> URL: https://issues.apache.org/jira/browse/LENS-826
> Project: Apache Lens
>  Issue Type: Bug
>  Components: docs
>Reporter: Amareshwari Sriramadasu
>Priority: Minor
> Fix For: 2.4
>
> Attachments: LENS-826.patch
>
>
> lens.client.query.poll.interval is missing in lens-client-default.xml and the 
> apt file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (LENS-291) Add doc for lens administrator to debug lens server issues

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti updated LENS-291:
--
Fix Version/s: (was: 2.4)
   2.5

> Add doc for lens administrator to debug lens server issues 
> ---
>
> Key: LENS-291
> URL: https://issues.apache.org/jira/browse/LENS-291
> Project: Apache Lens
>  Issue Type: Task
>  Components: docs, operations
>Reporter: Amareshwari Sriramadasu
> Fix For: 2.5
>
>
> This doc should capture various system errors that lens server could face in 
> production and a guide to administrator to take next steps.
> For example : Email notification failure can say check for smtp host and 
> port, and how to go about the error seen.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Review Request 40383: Updating release doc information

2015-11-17 Thread Raju Bairishetti

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40383/
---

Review request for lens, Amareshwari Sriramadasu and Rajat Khandelwal.


Bugs: LENS-805
https://issues.apache.org/jira/browse/LENS-805


Repository: lens


Description
---

added tasks info in release doc


Diffs
-

  src/site/apt/releases/release-history.apt b683360 

Diff: https://reviews.apache.org/r/40383/diff/


Testing
---

Tested on local


Thanks,

Raju Bairishetti



[jira] [Work started] (LENS-801) Release Lens 2.4.0-beta

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on LENS-801 started by Raju Bairishetti.
-
> Release Lens 2.4.0-beta
> ---
>
> Key: LENS-801
> URL: https://issues.apache.org/jira/browse/LENS-801
> Project: Apache Lens
>  Issue Type: Task
>  Components: build
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
> Fix For: 2.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-806) Update gpg keys in dist repo

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-806.
-

> Update gpg keys in dist repo
> 
>
> Key: LENS-806
> URL: https://issues.apache.org/jira/browse/LENS-806
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: build
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
> Fix For: 2.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-790) UI Module failing if maven version is < 3.1

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-790.
-

> UI Module failing if maven version is < 3.1
> ---
>
> Key: LENS-790
> URL: https://issues.apache.org/jira/browse/LENS-790
> Project: Apache Lens
>  Issue Type: Sub-task
>Reporter: Rajat Khandelwal
>Assignee: Ankeet Maini
> Fix For: 2.4
>
> Attachments: LENS-790.2015-09-28_11:57:48.patch, 
> LENS-790.2015-09-28_14:57:39.patch, LENS-790.patch, LENS-790.patch, 
> pom.patch, pom.patch, pom.patch, pom.patch, pom.patch
>
>
> UI module uses plugins which require maven version  >= 3.1.0
> Right now, sometimes the build job runs almost completely and in the last 
> module(ui module), it fails the build stating the version requirement. 
> error is:
> {noformat}
> [INFO] [ERROR] Failed to execute goal 
> com.github.eirslett:frontend-maven-plugin:0.0.23:install-node-and-npm 
> (install node and npm) on project lens-ui: The plugin 
> com.github.eirslett:frontend-maven-plugin:0.0.23 requires Maven version 3.1.0 
> -> [Help 1]
> {noformat}
> So preferrably we should depend on an older version of frontend plugin which 
> doesn't require maven 3.1. 
> If not, we'll at least enable fail early policy on the parent pom. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-757) Examples should continue to run in case submission failures

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-757.
-

> Examples should continue to run in case submission failures
> ---
>
> Key: LENS-757
> URL: https://issues.apache.org/jira/browse/LENS-757
> Project: Apache Lens
>  Issue Type: Improvement
>  Components: examples
>Affects Versions: 2.3
>Reporter: Amareshwari Sriramadasu
>Assignee: Amareshwari Sriramadasu
> Fix For: 2.4
>
> Attachments: LENS-757.patch
>
>
> Query submission fails in case of syntax and semantic errors, it should not 
> stop running more queries in examples.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-782) UI support for the saved, parametrized query feature.

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-782.
-

> UI support for the saved, parametrized query feature.
> -
>
> Key: LENS-782
> URL: https://issues.apache.org/jira/browse/LENS-782
> Project: Apache Lens
>  Issue Type: Improvement
>Reporter: Ankeet Maini
>Assignee: Ankeet Maini
> Fix For: 2.4
>
> Attachments: 782-origin-master.patch, Screen Shot 2015-09-25 at 
> 11.38.13 am.png, Screen Shot 2015-09-25 at 11.44.32 am.png, Screen Shot 
> 2015-09-25 at 11.55.34 am.png, Screen Shot 2015-09-25 at 11.56.28 am.png, 
> Screen Shot 2015-09-25 at 11.57.41 am.png, Screen Shot 2015-09-25 at 11.59.34 
> am.png
>
>
> 1. Provision for the user to view all the saved queries
> 2. Edit a saved query
> 3. Run a saved query
> 4. Parametrized queries (as saved queries)
> The modifications are enumerated as follows:-
> 1. While trying to run a query, the app first checks if there are any 
> parameters or not, if yes then execution is stopped and the user is prompted 
> to Save the query first.
> 2. If the user is trying to Save a query, the app checks if there are any 
> parameters, if yes then the user is shown a non-obtrusive box to fill out the 
> meta about the params and a value for it, else the Query is saved and the 
> result either success or failure is shown to the user.
> 3. The app has been modified to keep up with the LENS server development 
> which now in case of failed/bad-formed queries doesn't return a handle and 
> throws an exception, which is propagated to the user immediately.
> 4. On clicking Saved queries link from the top left operation box, it lists 
> all the Saved Queries present in a paginated manner with the total pages and 
> current page shown cutely at the top right corner of Saved Queries section.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-758) Remove feather logo from the repository, use already existing image to display on website

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-758.
-

> Remove feather logo from the repository, use already existing image to 
> display on website
> -
>
> Key: LENS-758
> URL: https://issues.apache.org/jira/browse/LENS-758
> Project: Apache Lens
>  Issue Type: Task
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.4
>
> Attachments: LENS-758.2015-08-26_12:17:42.patch, screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-796) Slow response times for /metastore/nativetables API

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-796.
-

> Slow response times for /metastore/nativetables API
> ---
>
> Key: LENS-796
> URL: https://issues.apache.org/jira/browse/LENS-796
> Project: Apache Lens
>  Issue Type: Improvement
>Reporter: Deepak Barr
>Assignee: Deepak Barr
> Fix For: 2.4
>
> Attachments: LENS-796.patch
>
>
> To obtain list of native tables, CubeMetastoreService does the following -
> 1. Fetches the list of tables ( one MetastoreClient call)
> 2. Filters out the cube tables from the list. The filtering happens by 
> looking at the table properties from the Table object. This table object is 
> obtained with another Metastore call. So, If there are 'n' tables, there will 
> be 'n' metastore calls.
> Here is the code snippet :
>   private List getTablesFromDB(LensSessionHandle sessionid,
> String dbName, boolean prependDbName)
> throws MetaException, UnknownDBException, HiveSQLException, TException, 
> LensException {
> List tables = 
> getSession(sessionid).getMetaStoreClient().getAllTables(
>   dbName);
> List result = new ArrayList();
> if (tables != null && !tables.isEmpty()) {
>   Iterator it = tables.iterator();
>   while (it.hasNext()) {
> String tblName = it.next();
> org.apache.hadoop.hive.metastore.api.Table tbl =
>   getSession(sessionid).getMetaStoreClient().getTable(dbName, 
> tblName);
> if (tbl.getParameters().get(MetastoreConstants.TABLE_TYPE_KEY) == 
> null) {
>   if (prependDbName) {
> result.add(dbName + "." + tblName);
>   } else {
> result.add(tblName);
>   }
> }
>   }
> }
> return result;
>   }
> Instead of this, we can directly fetch the list of table objects for our list 
> of table names in a single API call using 
> getMetaStoreClient().getTableObjectsByName() method.
> Currently, one of our databases contain 8000+ tables which leads to very very 
> long response times.
>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-710) Allow column name mapping for few/all columns in underlying storage tables

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-710.
-

> Allow column name mapping for few/all columns in underlying storage tables
> --
>
> Key: LENS-710
> URL: https://issues.apache.org/jira/browse/LENS-710
> Project: Apache Lens
>  Issue Type: Improvement
>  Components: driver-jdbc
>Reporter: Amareshwari Sriramadasu
>Assignee: Amareshwari Sriramadasu
> Fix For: 2.4
>
> Attachments: LENS-710.2.patch
>
>
> This improvement proposed is to accept column mapping for few or all columns 
> in underlying storage tables - which allows column to be different in 
> underlying storage than column in fact/dimtable
> For example:
> Fact1 has col1
> S1_Fact1 has col1
> S2_Fact2 has col1_variant
> S2_Fact2 can have column mapping property specified as col1:col1_variant. If 
> S2_Fact2 becomes the eligible storage table, then query should be written 
> with col1_variant if col1 is queried.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 39390: LENS-828: Add derived cube validation

2015-11-17 Thread Amareshwari Sriramadasu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39390/#review106843
---



lens-api/src/main/resources/lens-errors.conf (line 287)


Let us start the numbers from 3100 or 3500, sothat query errors can be 
separated from metastore errors?


- Amareshwari Sriramadasu


On Nov. 10, 2015, 6:54 a.m., Rajat Khandelwal wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/39390/
> ---
> 
> (Updated Nov. 10, 2015, 6:54 a.m.)
> 
> 
> Review request for lens.
> 
> 
> Bugs: LENS-828
> https://issues.apache.org/jira/browse/LENS-828
> 
> 
> Repository: lens
> 
> 
> Description
> ---
> 
> All fields should be present in parent cube. 
> 
> Otherwise, we're seeing NPE at runtime.
> 
> 
> Diffs
> -
> 
>   lens-api/src/main/resources/lens-errors.conf 
> a582dc266ae98c240489d2fe78fde0887601545e 
>   lens-cube/src/main/java/org/apache/lens/cube/error/LensCubeErrorCode.java 
> 73a584f507444ceceb265e8439fab45d0de7a1b3 
>   lens-cube/src/main/java/org/apache/lens/cube/metadata/Cube.java 
> 98fb92e6f87773ff658fab501b164553e9d4d58d 
>   
> lens-cube/src/main/java/org/apache/lens/cube/metadata/CubeMetastoreClient.java
>  daf7434c02f489ea31e31c2a35bad79a290fc527 
>   lens-cube/src/main/java/org/apache/lens/cube/metadata/DerivedCube.java 
> e7012f7fab56cb2067c1c6a36cd566fb4dc0cae9 
>   
> lens-cube/src/test/java/org/apache/lens/cube/metadata/TestCubeMetastoreClient.java
>  7d5ed0f94f946716f10e22bacf2bbaf6f30cb145 
>   lens-cube/src/test/java/org/apache/lens/cube/parse/CubeTestSetup.java 
> dc11b4ce4598bf6d1dc2dc7ad814bd8757ee34fd 
>   
> lens-server/src/main/java/org/apache/lens/server/metastore/CubeMetastoreServiceImpl.java
>  4c8b525b118c280fe81e7e8ae3c6e98aab312a32 
>   lens-server/src/main/java/org/apache/lens/server/metastore/JAXBUtils.java 
> 1ed81ebb6a0c907106951f73b6ca40f1a2f8e303 
>   
> lens-server/src/test/java/org/apache/lens/server/metastore/TestMetastoreService.java
>  ca0fe56876302ac6790f9369a595d3cc97c8da39 
> 
> Diff: https://reviews.apache.org/r/39390/diff/
> 
> 
> Testing
> ---
> 
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Lens Checkstyle Rules . SUCCESS [1.900s]
> [INFO] Lens .. SUCCESS [2.773s]
> [INFO] Lens API .. SUCCESS [20.629s]
> [INFO] Lens API for server and extensions  SUCCESS [21.576s]
> [INFO] Lens Cube . SUCCESS [5:09.811s]
> [INFO] Lens DB storage ... SUCCESS [20.171s]
> [INFO] Lens Query Library  SUCCESS [17.719s]
> [INFO] Lens Hive Driver .. SUCCESS [3:10.593s]
> [INFO] Lens Driver for JDBC .. SUCCESS [38.401s]
> [INFO] Lens Elastic Search Driver  SUCCESS [18.199s]
> [INFO] Lens Server ... SUCCESS [8:17.249s]
> [INFO] Lens client ... SUCCESS [37.602s]
> [INFO] Lens CLI .. SUCCESS [2:34.233s]
> [INFO] Lens Examples . SUCCESS [8.640s]
> [INFO] Lens Distribution . SUCCESS [8.454s]
> [INFO] Lens ML Lib ... SUCCESS [1:20.825s]
> [INFO] Lens ML Ext Distribution .. SUCCESS [2.091s]
> [INFO] Lens Regression ... SUCCESS [15.420s]
> [INFO] Lens UI ... SUCCESS [25.177s]
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 24:32.375s
> [INFO] Finished at: Fri Oct 16 11:15:05 UTC 2015
> [INFO] Final Memory: 194M/2045M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Rajat Khandelwal
> 
>



Re: Review Request 40383: Updating release doc information

2015-11-17 Thread Raju Bairishetti

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40383/
---

(Updated Nov. 17, 2015, 11:21 a.m.)


Review request for lens, Amareshwari Sriramadasu and Rajat Khandelwal.


Bugs: LENS-805
https://issues.apache.org/jira/browse/LENS-805


Repository: lens


Description
---

added tasks info in release doc


Diffs
-

  src/site/apt/releases/release-history.apt b683360 

Diff: https://reviews.apache.org/r/40383/diff/


Testing (updated)
---

Tested on local.

Download links are not valid at this moment.


Thanks,

Raju Bairishetti



[jira] [Commented] (LENS-805) Update 2.4 release documentation

2015-11-17 Thread Raju Bairishetti (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008510#comment-15008510
 ] 

Raju Bairishetti commented on LENS-805:
---

Rb entry: https://reviews.apache.org/r/40383/

Download links are not valid at this moment. 

> Update 2.4 release documentation
> 
>
> Key: LENS-805
> URL: https://issues.apache.org/jira/browse/LENS-805
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: build
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
> Fix For: 2.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 39895: LENS-851: queries where results of two storage tables of same fact are unioned, the rows should be aggregated

2015-11-17 Thread Rajat Khandelwal


> On Nov. 17, 2015, 5:27 p.m., Amareshwari Sriramadasu wrote:
> > lens-cube/src/main/java/org/apache/lens/cube/parse/SingleFactMultiStorageHQLContext.java,
> >  line 98
> > 
> >
> > Why does it required copyAST followed by new ASTNode() ?

new ASTNode is shortcut for creating just a single node(not the entire tree) 
based on the root of the constructor argument. This is just creating an 
`ASTNode(CommonToken(TOK_SELECT))`


> On Nov. 17, 2015, 5:27 p.m., Amareshwari Sriramadasu wrote:
> > lens-cube/src/main/java/org/apache/lens/cube/parse/SingleFactMultiStorageHQLContext.java,
> >  line 181
> > 
> >
> > Is intelligence required? :)

No. :)


> On Nov. 17, 2015, 5:27 p.m., Amareshwari Sriramadasu wrote:
> > lens-cube/src/test/java/org/apache/lens/cube/parse/TestCubeRewriter.java, 
> > line 441
> > 
> >
> > Can you share cube query and expected union query in a comment, cannot 
> > make much from looking at testcase.

Signature should be intuitive to understand: 

```
public static String getExpectedUnionQuery(String cubeName, List 
storages, StoragePartitionProvider provider,
String outerSelectPart, String outerWhere, String outerPostWhere, String 
innerQuerySelectPart,
String innerWhere, String innerPostWhere) {
```

Wherever used, the query is supposed to be like: `outerselectpart from 
(innerselectpart from table1 where partitions and innerWhere innerPostWhere 
union all innerselectpart from table2 where partitions and innerWhere 
innerPostWhere) cubeName where outerWhere outerPostWhere`

postwhere is things like `group by`, `order by`, `having`, `limit` etc. 

Mentioning some complex queries here:

```
SELECT ( testcube . alias0 ) as `City ID` , (sum(( testcube . alias1 )) + max(( 
testcube . alias2 ))),  case  when (sum(( testcube . alias1 )) =  0 ) then  0  
else (sum(( testcube . alias3 )) / sum(( testcube . alias1 ))) end  as `Third 
measure`  FROM (SELECT ( testcube . cityid ) as `alias0` , sum(( testcube . 
msr2 )) as `alias1` , max(( testcube . msr3 )) as `alias2` , sum( case  when (( 
testcube . cityid ) =  'x' ) then ( testcube . msr21 ) else ( testcube . msr22 
) end ) as `alias3`  FROM TestQueryRewrite.c1_testfact testcube WHERE 
 testcube . dt ) =  
'2015-09-17-19' ) or (( testcube . dt ) =  '2015-09-17-20' )) or (( testcube . 
dt ) =  '2015-09-17-21' )) or (( testcube . dt ) =  '2015-09-17-22' )) or (( 
testcube . dt ) =  '2015-09-17-23' )) or (( testcube . dt ) =  '2015-09-18' )) 
or (( testcube . dt ) =  '2015-09-19' )) or (( testcube . dt ) =  '2015-09-20' 
)) or (( testcube . dt ) =  '2015-09-21' )) or (( testcube . dt ) 
 =  '2015-09-22' )) or (( testcube . dt ) =  '2015-09-23' )) or (( testcube . 
dt ) =  '2015-09-24' )) or (( testcube . dt ) =  '2015-09-25' )) or (( testcube 
. dt ) =  '2015-09-26' )) or (( testcube . dt ) =  '2015-09-27' )) or (( 
testcube . dt ) =  '2015-09-28' )) or (( testcube . dt ) =  '2015-09-29' )) or 
(( testcube . dt ) =  '2015-09-30' )) or (( testcube . dt ) =  '2015-11-01' )) 
or (( testcube . dt ) =  '2015-11-02' )) or (( testcube . dt ) =  '2015-11-03' 
)) or (( testcube . dt ) =  '2015-11-04' )) or (( testcube . dt ) =  
'2015-11-05' )) or (( testcube . dt ) =  '2015-11-06' )) or (( testcube . dt ) 
=  '2015-11-07' )) or (( testcube . dt ) =  '2015-11-08' )) or (( testcube . dt 
) =  '2015-11-09' )) or (( testcube . dt ) =  '2015-11-10' )) or (( testcube . 
dt ) =  '2015-11-11' )) or (( testcube . dt ) =  '2015-11-12' )) or (( testcube 
. dt ) =  '2015-11-13' )) or (( testcube . dt ) =  '2015-11-14' )) or (( 
testcube . dt ) =  '2015-11-15' )) or (( testcube . dt ) =  '2015-11-1
 6' )) or (( testcube . dt ) =  '2015-11-17-00' )) or (( testcube . dt ) =  
'2015-11-17-01' )) or (( testcube . dt ) =  '2015-11-17-02' )) or (( testcube . 
dt ) =  '2015-11-17-03' )) or (( testcube . dt ) =  '2015-11-17-04' )) or (( 
testcube . dt ) =  '2015-11-17-05' )) or (( testcube . dt ) =  '2015-11-17-06' 
)) or (( testcube . dt ) =  '2015-11-17-07' )) or (( testcube . dt ) =  
'2015-11-17-08' )) or (( testcube . dt ) =  '2015-11-17-09' )) or (( testcube . 
dt ) =  '2015-11-17-10' )) or (( testcube . dt ) =  '2015-11-17-11' )) or (( 
testcube . dt ) =  '2015-11-17-12' )) or (( testcube . dt ) =  '2015-11-17-13' 
)) or (( testcube . dt ) =  '2015-11-17-14' )) or (( testcube . dt ) =  
'2015-11-17-15' )) or (( testcube . dt ) =  '2015-11-17-16' )) or (( testcube . 
dt ) =  '2015-11-17-17' )) or (( testcube . dt ) =  '2015-11-17-18'  GROUP 
BY ( testcube . cityid ) UNION ALL SELECT ( testcube . cityid ) as `alias0` , 
sum(( testcube . msr2 )) as `alias1` , max(( testcube . msr3 )) as `a
 lias2` , sum( case  when (( testcube . cityid ) =  'x' ) then ( testcube . 
msr21 

Re: Review Request 39895: LENS-851: queries where results of two storage tables of same fact are unioned, the rows should be aggregated

2015-11-17 Thread Rajat Khandelwal

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39895/
---

(Updated Nov. 17, 2015, 8 p.m.)


Review request for lens.


Bugs: LENS-851
https://issues.apache.org/jira/browse/LENS-851


Repository: lens


Description
---

Will do further cleanup and refactoring. Putting this up for an early review.


Diffs
-

  lens-cube/src/main/java/org/apache/lens/cube/parse/CubeQueryContext.java 
450d17202d7a06214ecd997d4bab68fe8351ab3e 
  lens-cube/src/main/java/org/apache/lens/cube/parse/HQLParser.java 
16e1aa3f3288426e1bc9b823ac8c3d805d54c42f 
  lens-cube/src/main/java/org/apache/lens/cube/parse/SimpleHQLContext.java 
067a37a29b536a9ff03aae12a396e7bb99f9ba0f 
  
lens-cube/src/main/java/org/apache/lens/cube/parse/SingleFactMultiStorageHQLContext.java
 15a98dd941bd7b4cb68369fb553d6722956430d6 
  lens-cube/src/main/java/org/apache/lens/cube/parse/UnionHQLContext.java 
90058260b36879bbc149c3c33198d3daf1179b36 
  lens-cube/src/test/java/org/apache/lens/cube/parse/CubeTestSetup.java 
826f6b63cb4b2c3c3be7846bfbd8d0744d1069ad 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestAggregateResolver.java 
8da52635c72dfc5f669002f1c8dd1da1b9712b40 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestCubeRewriter.java 
4acd063f4746044afa0e0345faf81adbdda18e0c 
  
lens-cube/src/test/java/org/apache/lens/cube/parse/TestDenormalizationResolver.java
 64b1ac66566239f3a16e55fb5174467940fa0818 
  
lens-cube/src/test/java/org/apache/lens/cube/parse/TestExpressionResolver.java 
9dcced06b533461c0f2e087709546fe7b66e89c2 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestQuery.java 
8e35ea9bd9cd727cc25ff011a03d6a38a6f0229f 

Diff: https://reviews.apache.org/r/39895/diff/


Testing (updated)
---

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Lens Checkstyle Rules . SUCCESS [2.062s]
[INFO] Lens .. SUCCESS [3.128s]
[INFO] Lens API .. SUCCESS [29.618s]
[INFO] Lens API for server and extensions  SUCCESS [23.581s]
[INFO] Lens Cube . SUCCESS [5:44.708s]
[INFO] Lens DB storage ... SUCCESS [20.474s]
[INFO] Lens Query Library  SUCCESS [16.973s]
[INFO] Lens Hive Driver .. SUCCESS [2:53.401s]
[INFO] Lens Driver for JDBC .. SUCCESS [37.230s]
[INFO] Lens Elastic Search Driver  SUCCESS [17.677s]
[INFO] Lens Server ... SUCCESS [8:16.106s]
[INFO] Lens client ... SUCCESS [38.470s]
[INFO] Lens CLI .. SUCCESS [51.862s]
[INFO] Lens Examples . SUCCESS [9.145s]
[INFO] Lens Ship Jars to Distributed Cache ... SUCCESS [1.612s]
[INFO] Lens Distribution . SUCCESS [9.499s]
[INFO] Lens ML Lib ... SUCCESS [1:20.974s]
[INFO] Lens ML Ext Distribution .. SUCCESS [2.216s]
[INFO] Lens Regression ... SUCCESS [14.834s]
[INFO] Lens UI ... SUCCESS [27.308s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 23:21.839s
[INFO] Finished at: Tue Nov 17 14:25:05 UTC 2015
[INFO] Final Memory: 202M/2273M
[INFO] 


Thanks,

Rajat Khandelwal



Re: Review Request 39895: LENS-851: queries where results of two storage tables of same fact are unioned, the rows should be aggregated

2015-11-17 Thread Rajat Khandelwal

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39895/
---

(Updated Nov. 17, 2015, 7:31 p.m.)


Review request for lens.


Bugs: LENS-851
https://issues.apache.org/jira/browse/LENS-851


Repository: lens


Description
---

Will do further cleanup and refactoring. Putting this up for an early review.


Diffs (updated)
-

  lens-cube/src/main/java/org/apache/lens/cube/parse/CubeQueryContext.java 
450d17202d7a06214ecd997d4bab68fe8351ab3e 
  lens-cube/src/main/java/org/apache/lens/cube/parse/HQLParser.java 
16e1aa3f3288426e1bc9b823ac8c3d805d54c42f 
  lens-cube/src/main/java/org/apache/lens/cube/parse/SimpleHQLContext.java 
067a37a29b536a9ff03aae12a396e7bb99f9ba0f 
  
lens-cube/src/main/java/org/apache/lens/cube/parse/SingleFactMultiStorageHQLContext.java
 15a98dd941bd7b4cb68369fb553d6722956430d6 
  lens-cube/src/main/java/org/apache/lens/cube/parse/UnionHQLContext.java 
90058260b36879bbc149c3c33198d3daf1179b36 
  lens-cube/src/test/java/org/apache/lens/cube/parse/CubeTestSetup.java 
826f6b63cb4b2c3c3be7846bfbd8d0744d1069ad 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestAggregateResolver.java 
8da52635c72dfc5f669002f1c8dd1da1b9712b40 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestCubeRewriter.java 
4acd063f4746044afa0e0345faf81adbdda18e0c 
  
lens-cube/src/test/java/org/apache/lens/cube/parse/TestDenormalizationResolver.java
 64b1ac66566239f3a16e55fb5174467940fa0818 
  
lens-cube/src/test/java/org/apache/lens/cube/parse/TestExpressionResolver.java 
9dcced06b533461c0f2e087709546fe7b66e89c2 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestQuery.java 
8e35ea9bd9cd727cc25ff011a03d6a38a6f0229f 

Diff: https://reviews.apache.org/r/39895/diff/


Testing
---

Tested for some queries in the test cases themselves. Need to add proper 
asserts.


Thanks,

Rajat Khandelwal



Re: Review Request 40383: Updating release doc information

2015-11-17 Thread Rajat Khandelwal


> On Nov. 17, 2015, 7:25 p.m., Rajat Khandelwal wrote:
> > src/site/apt/releases/release-history.apt, line 53
> > 
> >
> > No need to mention review request here. jira should be enough to point 
> > the readers.
> 
> Raju Bairishetti wrote:
> I felt like LENS-693 jira does not have much information. I found more 
> info in review request :).

The reviewboard link is mentioned there.


- Rajat


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40383/#review106855
---


On Nov. 17, 2015, 4:51 p.m., Raju Bairishetti wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/40383/
> ---
> 
> (Updated Nov. 17, 2015, 4:51 p.m.)
> 
> 
> Review request for lens, Amareshwari Sriramadasu and Rajat Khandelwal.
> 
> 
> Bugs: LENS-805
> https://issues.apache.org/jira/browse/LENS-805
> 
> 
> Repository: lens
> 
> 
> Description
> ---
> 
> added tasks info in release doc
> 
> 
> Diffs
> -
> 
>   src/site/apt/releases/release-history.apt b683360 
> 
> Diff: https://reviews.apache.org/r/40383/diff/
> 
> 
> Testing
> ---
> 
> Tested on local.
> 
> Download links are not valid at this moment.
> 
> 
> Thanks,
> 
> Raju Bairishetti
> 
>



[jira] [Commented] (LENS-826) lens.client.query.poll.interval needs doc update

2015-11-17 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009079#comment-15009079
 ] 

Hadoop QA commented on LENS-826:


Applied patch: 
[LENS-826.patch|https://issues.apache.org/jira/secure/attachment/12772724/LENS-826.patch]
 and ran command: mvn clean install -fae. Result: Success. Build Job: 
https://builds.apache.org/job/PreCommit-Lens-Build/174/

> lens.client.query.poll.interval needs doc update
> 
>
> Key: LENS-826
> URL: https://issues.apache.org/jira/browse/LENS-826
> Project: Apache Lens
>  Issue Type: Bug
>  Components: docs
>Reporter: Amareshwari Sriramadasu
>Assignee: Raju Bairishetti
>Priority: Minor
> Fix For: 2.4
>
> Attachments: LENS-826.patch
>
>
> lens.client.query.poll.interval is missing in lens-client-default.xml and the 
> apt file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 39390: LENS-828: Add derived cube validation

2015-11-17 Thread Rajat Khandelwal

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39390/
---

(Updated Nov. 17, 2015, 10:57 p.m.)


Review request for lens.


Bugs: LENS-828
https://issues.apache.org/jira/browse/LENS-828


Repository: lens


Description
---

All fields should be present in parent cube. 

Otherwise, we're seeing NPE at runtime.


Diffs (updated)
-

  lens-api/src/main/resources/lens-errors.conf 
a582dc266ae98c240489d2fe78fde0887601545e 
  lens-cube/src/main/java/org/apache/lens/cube/error/LensCubeErrorCode.java 
73a584f507444ceceb265e8439fab45d0de7a1b3 
  lens-cube/src/main/java/org/apache/lens/cube/metadata/Cube.java 
98fb92e6f87773ff658fab501b164553e9d4d58d 
  
lens-cube/src/main/java/org/apache/lens/cube/metadata/CubeMetastoreClient.java 
daf7434c02f489ea31e31c2a35bad79a290fc527 
  lens-cube/src/main/java/org/apache/lens/cube/metadata/DerivedCube.java 
e7012f7fab56cb2067c1c6a36cd566fb4dc0cae9 
  
lens-cube/src/test/java/org/apache/lens/cube/metadata/TestCubeMetastoreClient.java
 7d5ed0f94f946716f10e22bacf2bbaf6f30cb145 
  lens-cube/src/test/java/org/apache/lens/cube/parse/CubeTestSetup.java 
826f6b63cb4b2c3c3be7846bfbd8d0744d1069ad 
  
lens-server/src/main/java/org/apache/lens/server/metastore/CubeMetastoreServiceImpl.java
 ea913adf6ce6bbd3086031289a64e91a26fc4dc4 
  lens-server/src/main/java/org/apache/lens/server/metastore/JAXBUtils.java 
1ed81ebb6a0c907106951f73b6ca40f1a2f8e303 
  
lens-server/src/test/java/org/apache/lens/server/metastore/TestMetastoreService.java
 ca0fe56876302ac6790f9369a595d3cc97c8da39 

Diff: https://reviews.apache.org/r/39390/diff/


Testing (updated)
---

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Lens Checkstyle Rules . SUCCESS [1.894s]
[INFO] Lens .. SUCCESS [3.029s]
[INFO] Lens API .. SUCCESS [23.659s]
[INFO] Lens API for server and extensions  SUCCESS [19.972s]
[INFO] Lens Cube . SUCCESS [5:19.589s]
[INFO] Lens DB storage ... SUCCESS [19.294s]
[INFO] Lens Query Library  SUCCESS [17.365s]
[INFO] Lens Hive Driver .. SUCCESS [2:55.303s]
[INFO] Lens Driver for JDBC .. SUCCESS [33.998s]
[INFO] Lens Elastic Search Driver  SUCCESS [18.769s]
[INFO] Lens Server ... SUCCESS [8:33.289s]
[INFO] Lens client ... SUCCESS [35.943s]
[INFO] Lens CLI .. SUCCESS [52.007s]
[INFO] Lens Examples . SUCCESS [11.685s]
[INFO] Lens Ship Jars to Distributed Cache ... SUCCESS [1.699s]
[INFO] Lens Distribution . SUCCESS [11.191s]
[INFO] Lens ML Lib ... SUCCESS [1:21.061s]
[INFO] Lens ML Ext Distribution .. SUCCESS [1.941s]
[INFO] Lens Regression ... SUCCESS [14.976s]
[INFO] Lens UI ... SUCCESS [26.315s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 23:04.131s
[INFO] Finished at: Tue Nov 17 17:24:12 UTC 2015
[INFO] Final Memory: 198M/2050M
[INFO] 


Thanks,

Rajat Khandelwal



[jira] [Closed] (LENS-792) StatusPoller logs are useless

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-792.
-

> StatusPoller logs are useless
> -
>
> Key: LENS-792
> URL: https://issues.apache.org/jira/browse/LENS-792
> Project: Apache Lens
>  Issue Type: Bug
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.4
>
> Attachments: LENS-792.01.patch, LENS-792.2015-09-29_12:17:30.patch, 
> LENS-792.2015-09-29_12:18:51.patch
>
>
> Endless loop of the following:
> {noformat}
> 28 Sep 2015 11:27:34 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:27:34 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:28:20 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:28:20 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:29:06 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:29:06 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:29:52 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:29:52 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:30:38 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:30:38 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:31:29 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:31:29 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:32:21 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:32:21 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:33:12 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:33:12 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:34:03 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:34:03 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:34:59 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:34:59 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Updating 
> status for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:35:55 [6a61d6b0-66a9-4b39-8f3a-ba2a722fb737] [StatusPoller] 
> INFO  org.apache.lens.server.query.QueryExecutionServiceImpl - Polling status 
> for 6a61d6b0-66a9-4b39-8f3a-ba2a722fb737
> 28 Sep 2015 11:35:55 

[jira] [Closed] (LENS-772) Both time and size based rolling for logs

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-772.
-

> Both time and size based rolling for logs
> -
>
> Key: LENS-772
> URL: https://issues.apache.org/jira/browse/LENS-772
> Project: Apache Lens
>  Issue Type: Improvement
>  Components: build
>Affects Versions: 2.3
>Reporter: Amareshwari Sriramadasu
>Assignee: Amareshwari Sriramadasu
> Fix For: 2.4
>
> Attachments: LENS-772.2.patch, LENS-772.patch
>
>
> Right now, logback configuration has rollingPolicy and triggeringPolicy 
> defined separately, which is causing the logs not to roll on time based.
> To roll files based on both, we should be using 
> timeBasedFileNamingAndTriggeringPolicy.
> Reference : 
> http://stackoverflow.com/questions/2602415/rolling-logback-logs-on-filesize-and-time



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-693) Queries get purged to DB as soon as they finish

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-693.
-

> Queries get purged to DB as soon as they finish
> ---
>
> Key: LENS-693
> URL: https://issues.apache.org/jira/browse/LENS-693
> Project: Apache Lens
>  Issue Type: Improvement
>  Components: server
>Affects Versions: 2.0
>Reporter: Arshad Matin
>Assignee: Rajat Khandelwal
>  Labels: incompatible
> Fix For: 2.4
>
> Attachments: LENS-693.04.patch, LENS-693.12.patch
>
>
> Query Result Mail is not working when finished queries is set to zero as the 
> queries are immediately going to the DB



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-852) lens-ship-jars in current-release-line branch should have parent version 2.4.0-beta-SNAPSHOT instead of 2.5.0-beta-SNAPSHOT

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-852.
-

> lens-ship-jars in current-release-line branch should have parent version 
> 2.4.0-beta-SNAPSHOT instead of 2.5.0-beta-SNAPSHOT
> ---
>
> Key: LENS-852
> URL: https://issues.apache.org/jira/browse/LENS-852
> Project: Apache Lens
>  Issue Type: Bug
>  Components: build
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
>Priority: Critical
> Fix For: 2.4
>
> Attachments: LENS-852.patch
>
>
> lens-ship-jars module was added recently and committed to both master & 
> current release branch. In current-release-line, lens-ship-jarsmodule parent 
> version should be 2.4.0-beta-SNAPSHOT.
> I think 2.4.0-beta-SNAPSHOT snapshot version of lens-ship-jars should be 
> present in one of the repositories.
> https://repository.apache.org/content/groups/snapshots/org/apache/lens/lens-ship-jars/
>   has only latest version.
> ++ [~sriksun]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-224) FinishedLensQuery is not storing selectedDriver

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-224.
-

> FinishedLensQuery is not storing selectedDriver
> ---
>
> Key: LENS-224
> URL: https://issues.apache.org/jira/browse/LENS-224
> Project: Apache Lens
>  Issue Type: Bug
>  Components: server
>Reporter: Amareshwari Sriramadasu
>Assignee: Deepak Barr
>  Labels: incompatible
> Fix For: 2.4
>
> Attachments: LENS-224.patch
>
>
> FinishedLensQuery is not storing selectedDriver. Once the query is purged to 
> DB, the reconstructed query does not have selectedDriver.
> This makes missing information for user for knowing where the query ran.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-113) Document how to document a feature in contributor guide

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-113.
-

> Document how to document a feature in contributor guide
> ---
>
> Key: LENS-113
> URL: https://issues.apache.org/jira/browse/LENS-113
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Amareshwari Sriramadasu
>Assignee: Amareshwari Sriramadasu
> Fix For: 2.4
>
> Attachments: LENS-113.2.patch, LENS-113.patch
>
>
> We should include details on how to document a feature in contributor page.
> The should come up with template/details to describe the following:
> * Why is the feature required
> * What is the feature
> * How to enable feature
> * Where should design doc should go
> * Who are the users of features and who are not.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-732) exclude patchprocess directory from licence check.

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-732.
-

> exclude patchprocess directory from licence check. 
> ---
>
> Key: LENS-732
> URL: https://issues.apache.org/jira/browse/LENS-732
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: build
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Fix For: 2.4
>
> Attachments: LENS-732.patch
>
>
> Every project is using patchprocess directory inside their jenkins workspace. 
> We've had to use it outside our workspace because if we use it inside, rat 
> check fails. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-831) Create a single jar for shipping with hive queries

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-831.
-

> Create a single jar for shipping with hive queries
> --
>
> Key: LENS-831
> URL: https://issues.apache.org/jira/browse/LENS-831
> Project: Apache Lens
>  Issue Type: Improvement
>  Components: build
>Affects Versions: 2.4
>Reporter: Srikanth Sundarrajan
>Assignee: Srikanth Sundarrajan
>  Labels: packaging
> Fix For: 2.4
>
> Attachments: LENS-831-V1.patch, LENS-831.patch
>
>
> Currently a number of jars have to be shipped along with each query apart 
> from user extension jars for udf, serde etc. This has two side effects:
> 1. Number of ClassLoader on the hive server increases (potentially causing 
> PermGen OOM issues)
> 2. Number of jar localization events in the node manager when executing a 
> task.
> The proposal is to bundle these and create a single shaded jar and make it 
> available in the binary distribution.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-775) NPE on closing HadoopFileFormatter

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-775.
-

> NPE on closing HadoopFileFormatter
> --
>
> Key: LENS-775
> URL: https://issues.apache.org/jira/browse/LENS-775
> Project: Apache Lens
>  Issue Type: Bug
>Reporter: Deepak Barr
>Assignee: Deepak Barr
>Priority: Minor
> Fix For: 2.4
>
> Attachments: LENS-775.patch
>
>
> In HadoopFileFormatter, If rowWriter intialization fails because of,say, HDFS 
> permission issue. The close() method (called in finally block in 
> ResultFormatter class) throws an NPE.
> Code snippet - 
>  public void setupOutputs() throws IOException {
> String pathStr = ctx.getResultSetParentDir();
> if (StringUtils.isBlank(pathStr)) {
>   throw new IllegalArgumentException("No output path specified");
> }
> String outputPathStr = Strings.isNullOrEmpty(ctx.getQueryName()) ? ""
>   : LensFileOutputFormat.getValidOutputFileName(ctx.getQueryName()) + "-";
> outputPath = new Path(pathStr, outputPathStr + 
> ctx.getQueryHandle().toString());
> Path tmpWorkPath = new Path(pathStr, ctx.getQueryHandle().toString() + 
> ".tmp");
> try {
>   rowWriter = LensFileOutputFormat.createRecordWriter(ctx.getConf(), 
> tmpWorkPath, Reporter.NULL,
> ctx.getCompressOutput(), ctx.getOuptutFileExtn(), 
> ctx.getResultEncoding());
>   numRows=0;
> } catch (IOException e) {
>   throw new IllegalArgumentException("Could not create tmp path");
> }
>   }
> @Override
>   public void close() throws IOException {
> rowWriter.close(Reporter.NULL);
>   }



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-804) Verify Lens 2.4 issues

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-804.
-

> Verify Lens 2.4 issues
> --
>
> Key: LENS-804
> URL: https://issues.apache.org/jira/browse/LENS-804
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: build
>Reporter: Raju Bairishetti
>Assignee: Arshad Matin
> Fix For: 2.4
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (LENS-847) Columnar JDBC Rewriter in incorrectly pushing filter against wrong alias when fact columns map to a single dimension

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti closed LENS-847.
-

> Columnar JDBC Rewriter in incorrectly pushing filter against wrong alias when 
> fact columns map to a single dimension
> 
>
> Key: LENS-847
> URL: https://issues.apache.org/jira/browse/LENS-847
> Project: Apache Lens
>  Issue Type: Bug
>  Components: driver-jdbc
>Affects Versions: 2.3, 2.4, 2.5
>Reporter: Srikanth Sundarrajan
>Assignee: Srikanth Sundarrajan
> Fix For: 2.4, 2.5
>
> Attachments: LEN-847-V1.patch, LEN-847.patch
>
>
> Columnar JDBC Rewriter in incorrectly pushing filter against wrong alias when 
> fact columns map to a single dimension.
> Ex:
> select fact.time_key, time_dim.day_of_week, location_dim_a.location_name, 
> other_location_dim.location_name, sum(fact.dollars_sold) from sales_fact fact 
> inner join time_dim time_dim on fact.time_key = time_dim.time_key inner join 
> location_dim location_dim_a on fact.location_key = 
> location_dim_a.location_key inner join location_dim other_location_dim on 
> fact.other_location_key = other_location_dim.location_key where 
> time_dim.time_key between '2013-01-01' and '2013-01-31' and 
> location_dim_a.location_key = 'some-loc' group by fact.time_key, 
> location_dim_a.location_key, other_location_dim.location_key
> is being rewritten to 
> select ( sales_fact___fact . time_key ), ( time_dim___time_dim . day_of_week 
> ), ( location_dim___location_dim_a . location_name ), ( 
> location_dim___other_location_dim . location_name ), sum(alias1) from  
> (select sales_fact___fact.time_key, sales_fact___fact.location_key, 
> sales_fact___fact.other_location_key,sum(( sales_fact___fact . dollars_sold 
> )) as alias1 from sales_fact sales_fact___fact where 
> sales_fact___fact.time_key in  (  select time_dim .time_key from time_dim 
> where ( time_dim. time_key ) between  '2013-01-01'  and  '2013-01-31'  ) and 
> sales_fact___fact.location_key in  (  select location_dim .location_key from 
> location_dim where (( location_dim. location_key ) =  'some-loc' ) ) and 
> {{sales_fact___fact.other_location_key in  (  select location_dim 
> .location_key from location_dim where (( location_dim. location_key ) =  
> 'some-loc' ) )}}  group by sales_fact___fact.time_key, 
> sales_fact___fact.location_key, sales_fact___fact.other_location_key) 
> sales_fact___fact  inner join (select time_key,day_of_week from time_dim) 
> time_dim___time_dim on (( sales_fact___fact . time_key ) = ( 
> time_dim___time_dim . time_key ))  inner join (select 
> location_key,location_name from location_dim) location_dim___location_dim_a 
> on (( sales_fact___fact . location_key ) = ( location_dim___location_dim_a . 
> location_key ))  inner join (select location_key,location_name from 
> location_dim) location_dim___other_location_dim on (( sales_fact___fact . 
> other_location_key ) = ( location_dim___other_location_dim . location_key ))  
> where (( time_dim___time_dim . time_key ) between  '2013-01-01'  and  
> '2013-01-31'  and (( location_dim___location_dim_a . location_key ) =  
> 'some-loc' )) group by ( sales_fact___fact . time_key ), ( 
> location_dim___location_dim_a . location_key ), ( 
> location_dim___other_location_dim . location_key )



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (LENS-826) lens.client.query.poll.interval needs doc update

2015-11-17 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009907#comment-15009907
 ] 

Hadoop QA commented on LENS-826:


Applied patch: 
[LENS-826.01.patch|https://issues.apache.org/jira/secure/attachment/12772875/LENS-826.01.patch]
 and ran command: mvn clean install -fae. Result: Failure. Build Job: 
https://builds.apache.org/job/PreCommit-Lens-Build/175/

> lens.client.query.poll.interval needs doc update
> 
>
> Key: LENS-826
> URL: https://issues.apache.org/jira/browse/LENS-826
> Project: Apache Lens
>  Issue Type: Bug
>  Components: docs
>Reporter: Amareshwari Sriramadasu
>Assignee: Raju Bairishetti
>Priority: Minor
> Fix For: 2.4
>
> Attachments: LENS-826.01.patch, LENS-826.patch
>
>
> lens.client.query.poll.interval is missing in lens-client-default.xml and the 
> apt file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (LENS-781) Ctrl+C on cli should kill the query if executing

2015-11-17 Thread Amareshwari Sriramadasu (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008234#comment-15008234
 ] 

Amareshwari Sriramadasu commented on LENS-781:
--

Yes. Some discussion on LENS-760 and https://reviews.apache.org/r/39911/

> Ctrl+C on cli should kill the query if executing
> 
>
> Key: LENS-781
> URL: https://issues.apache.org/jira/browse/LENS-781
> Project: Apache Lens
>  Issue Type: Improvement
>  Components: client
>Reporter: Rajat Khandelwal
>  Labels: newbie
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [DISCUSS] Release Plan for 2.4

2015-11-17 Thread amareshwarisr .
Seems issue verification is done. Can we do other release tasks and
progress on the release?

This release has been taking so much time, we should do a proper planning
for next one to avoid such huge dates for rolling the release.

On Fri, Oct 16, 2015 at 9:41 PM, Raju Bairishetti  wrote:

> Verifying the issues is still in progress. I will start release voting
> thread once the verification of issues is done.
>
> On Fri, Oct 9, 2015 at 10:25 AM, Raju Bairishetti  wrote:
>
> > Hello all,
> >  Merged master into current-release-line branch and updated master to
> > next development version 2.5.0-beta-SNAPSHOT.
> >
> > On Tue, Oct 6, 2015 at 10:30 AM, Raju Bairishetti 
> wrote:
> >
> >> Hello dev,
> >>  Gentle reminder for feature freeze scheduled on 8th October.
> >> On 25-Sep-2015 3:20 pm, "Raju Bairishetti"  >
> >> wrote:
> >>
> >>> My bad. typo mistake.   Extending it to october 8th.
> >>>
> >>> On Fri, Sep 25, 2015 at 3:16 PM, Raju Bairishetti 
> >>> wrote:
> >>>
> >>> > I am extending the feature/commits freezing date to 8th september to
> >>> > include some more issues in the 2.4.
> >>> >
> >>> > updated timelines on calendar.
> >>> > https://cwiki.apache.org/confluence/display/LENS/Release+Calendar
> >>> >
> >>> > On Mon, Sep 21, 2015 at 10:02 AM, Raju Bairishetti <
> raju@gmail.com
> >>> >
> >>> > wrote:
> >>> >
> >>> > > We have moved few issues to 2.5. Assignees, feel free to move back
> >>> to 2.4
> >>> > > if you think you can make it to 2.4.
> >>> > >
> >>> > > Summary of open issues after triage:
> >>> > > Total : 37 issues  open: 31 issues,  6 issues in-progress
> >>> > >
> >>> > > I am thinking to wait till sept 25th. Will extend the freezing date
> >>> if we
> >>> > > have many open issues.
> >>> > >
> >>> > > On Sat, Sep 19, 2015 at 5:37 PM, amareshwarisr . <
> >>> amareshw...@gmail.com>
> >>> > > wrote:
> >>> > >
> >>> > >> 64 open issues seems big. Can you do triage and move the ones that
> >>> are
> >>> > not
> >>> > >> required? If you think most of them are required, them moving the
> >>> date
> >>> > >> seems a good option.
> >>> > >>
> >>> > >> On Sat, Sep 19, 2015 at 1:16 PM, Raju Bairishetti <
> >>> raju@gmail.com>
> >>> > >> wrote:
> >>> > >>
> >>> > >> > Hello All,
> >>> > >> >Gentle reminder for feature freeze scheduled on 28th
> >>> september.
> >>> > >> We
> >>> > >> > have resolved 22 issues so far. 7 issues are under review
> process.
> >>> > >> >
> >>> > >> > Here's a summary of the open issues:
> >>> > >> >   Total: 73 issues, 64 Open, 9 In Progress
> >>> > >> >
> >>> > >> > *Issues by assignee:*
> >>> > >> > Akshay Goyal: 2 Issues, LENS-518 (moving to apache hive
> >>> dependency)
> >>> > >> > Amareshwari: 6 issues
> >>> > >> > Arshad: 4 issues
> >>> > >> > Deepak Barr: 3 issues
> >>> > >> > Jaideep Dhok: 4 issues
> >>> > >> > Kartheek : 1 issue
> >>> > >> > Pranav : 1 issue
> >>> > >> > Prashanth : 1 issue
> >>> > >> > Rajat : 7 issues
> >>> > >> > Raju 8 issues: 4 issues related to java8
> >>> > >> > Sushil: 6 issues, 4 issues related to error codes improvements
> >>> > >> > Vikas: 2 issues
> >>> > >> > YashSharma: 1 issue
> >>> > >> >
> >>> > >> > *26 unassigned issues:*
> >>> > >> >
> >>> > >> >
> >>> > >>
> >>> >
> >>>
> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true=project+%3D+LENS+AND+fixVersion+%3D+2.4+AND+resolution+%3D+Unresolved+AND+assignee+is+EMPTY+ORDER+BY+priority+DESC=hide
> >>> > >> >
> >>> > >> > Assignees: Please update on your assigned issues whether you'll
> be
> >>> > able
> >>> > >> to
> >>> > >> > complete them
> >>> > >> >
> >>> > >> >
> >>> > >> > On Fri, Sep 18, 2015 at 2:36 PM, amareshwarisr . <
> >>> > amareshw...@gmail.com
> >>> > >> >
> >>> > >> > wrote:
> >>> > >> >
> >>> > >> > > Hi,
> >>> > >> > >
> >>> > >> > > I would like to see the following in 2.4 release :
> >>> > >> > >
> >>> > >> > > https://issues.apache.org/jira/browse/LENS-752 ( i should be
> >>> mostly
> >>> > >> done
> >>> > >> > > by
> >>> > >> > > 28th sept),
> >>> > >> > > https://issues.apache.org/jira/browse/LENS-576
> >>> > >> > > and
> >>> > >> > > https://issues.apache.org/jira/browse/LENS-518 (mostly
> >>> optimistic
> >>> > >> here,
> >>> > >> > > not
> >>> > >> > > sure we can move there in 2.4)
> >>> > >> > >
> >>> > >> > > Thanks
> >>> > >> > > Amareshwari
> >>> > >> > >
> >>> > >> > > On Thu, Sep 3, 2015 at 10:04 AM, Raju Bairishetti <
> >>> r...@apache.org>
> >>> > >> > wrote:
> >>> > >> > >
> >>> > >> > > > Hi all,
> >>> > >> > > >I will be volunteering for our next release (2.4).
> >>> > >> > > >
> >>> > >> > > > The following issues are expected to be included in 2.4:
> >>> > >> > > > - Java8 build
> >>> > >> > > > - Improving all errors
> >>> > >> > > > - Spark Driver
> >>> > >> > > > - Move to Apache Hive
> >>> > >> > > > - Improved UI
> >>> > >> > > > -More bug fixes and 

[jira] [Commented] (LENS-828) Add derived cube validation

2015-11-17 Thread Rajat Khandelwal (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010401#comment-15010401
 ] 

Rajat Khandelwal commented on LENS-828:
---

Taking patch from reviewboard and attaching

> Add derived cube validation
> ---
>
> Key: LENS-828
> URL: https://issues.apache.org/jira/browse/LENS-828
> Project: Apache Lens
>  Issue Type: Improvement
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Attachments: LENS-828.06.patch
>
>
> All fields should be present in parent cube. 
> Otherwise, we're seeing NPE at runtime. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (LENS-826) lens.client.query.poll.interval needs doc update

2015-11-17 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010404#comment-15010404
 ] 

Hudson commented on LENS-826:
-

SUCCESS: Integrated in Lens-Commit-Java8 #40 (See 
[https://builds.apache.org/job/Lens-Commit-Java8/40/])
LENS-826 : Updates doc for lens.client.query.poll.interval (amareshwari: rev 
bc8658705afc7d8cd582e312278ff30b405b3dc3)
* lens-client/src/main/resources/lens-client-default.xml
* src/site/apt/user/client-config.apt


> lens.client.query.poll.interval needs doc update
> 
>
> Key: LENS-826
> URL: https://issues.apache.org/jira/browse/LENS-826
> Project: Apache Lens
>  Issue Type: Bug
>  Components: docs
>Reporter: Amareshwari Sriramadasu
>Assignee: Raju Bairishetti
>Priority: Minor
> Fix For: 2.4
>
> Attachments: LENS-826.01.patch, LENS-826.patch
>
>
> lens.client.query.poll.interval is missing in lens-client-default.xml and the 
> apt file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (LENS-828) Add derived cube validation

2015-11-17 Thread Rajat Khandelwal (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajat Khandelwal updated LENS-828:
--
Attachment: LENS-828.06.patch

> Add derived cube validation
> ---
>
> Key: LENS-828
> URL: https://issues.apache.org/jira/browse/LENS-828
> Project: Apache Lens
>  Issue Type: Improvement
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Attachments: LENS-828.06.patch
>
>
> All fields should be present in parent cube. 
> Otherwise, we're seeing NPE at runtime. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (LENS-828) Add derived cube validation

2015-11-17 Thread Rajat Khandelwal (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajat Khandelwal updated LENS-828:
--
Status: Patch Available  (was: Open)

> Add derived cube validation
> ---
>
> Key: LENS-828
> URL: https://issues.apache.org/jira/browse/LENS-828
> Project: Apache Lens
>  Issue Type: Improvement
>Reporter: Rajat Khandelwal
>Assignee: Rajat Khandelwal
> Attachments: LENS-828.06.patch
>
>
> All fields should be present in parent cube. 
> Otherwise, we're seeing NPE at runtime. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 39895: LENS-851: queries where results of two storage tables of same fact are unioned, the rows should be aggregated

2015-11-17 Thread Rajat Khandelwal

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39895/
---

(Updated Nov. 18, 2015, 1 p.m.)


Review request for lens.


Bugs: LENS-851
https://issues.apache.org/jira/browse/LENS-851


Repository: lens


Description
---

Will do further cleanup and refactoring. Putting this up for an early review.


Diffs (updated)
-

  lens-api/src/main/resources/lens-errors.conf 
a582dc266ae98c240489d2fe78fde0887601545e 
  lens-cube/src/main/java/org/apache/lens/cube/error/LensCubeErrorCode.java 
73a584f507444ceceb265e8439fab45d0de7a1b3 
  lens-cube/src/main/java/org/apache/lens/cube/parse/CubeQueryConfUtil.java 
87972c87126210a10fcb55c136409fb18deca8c8 
  lens-cube/src/main/java/org/apache/lens/cube/parse/CubeQueryContext.java 
450d17202d7a06214ecd997d4bab68fe8351ab3e 
  lens-cube/src/main/java/org/apache/lens/cube/parse/HQLParser.java 
16e1aa3f3288426e1bc9b823ac8c3d805d54c42f 
  lens-cube/src/main/java/org/apache/lens/cube/parse/SimpleHQLContext.java 
067a37a29b536a9ff03aae12a396e7bb99f9ba0f 
  
lens-cube/src/main/java/org/apache/lens/cube/parse/SingleFactMultiStorageHQLContext.java
 15a98dd941bd7b4cb68369fb553d6722956430d6 
  lens-cube/src/main/java/org/apache/lens/cube/parse/UnionHQLContext.java 
90058260b36879bbc149c3c33198d3daf1179b36 
  lens-cube/src/test/java/org/apache/lens/cube/parse/CubeTestSetup.java 
826f6b63cb4b2c3c3be7846bfbd8d0744d1069ad 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestAggregateResolver.java 
8da52635c72dfc5f669002f1c8dd1da1b9712b40 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestCubeRewriter.java 
4acd063f4746044afa0e0345faf81adbdda18e0c 
  
lens-cube/src/test/java/org/apache/lens/cube/parse/TestDenormalizationResolver.java
 64b1ac66566239f3a16e55fb5174467940fa0818 
  
lens-cube/src/test/java/org/apache/lens/cube/parse/TestExpressionResolver.java 
9dcced06b533461c0f2e087709546fe7b66e89c2 
  lens-cube/src/test/java/org/apache/lens/cube/parse/TestQuery.java 
8e35ea9bd9cd727cc25ff011a03d6a38a6f0229f 

Diff: https://reviews.apache.org/r/39895/diff/


Testing
---

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Lens Checkstyle Rules . SUCCESS [2.062s]
[INFO] Lens .. SUCCESS [3.128s]
[INFO] Lens API .. SUCCESS [29.618s]
[INFO] Lens API for server and extensions  SUCCESS [23.581s]
[INFO] Lens Cube . SUCCESS [5:44.708s]
[INFO] Lens DB storage ... SUCCESS [20.474s]
[INFO] Lens Query Library  SUCCESS [16.973s]
[INFO] Lens Hive Driver .. SUCCESS [2:53.401s]
[INFO] Lens Driver for JDBC .. SUCCESS [37.230s]
[INFO] Lens Elastic Search Driver  SUCCESS [17.677s]
[INFO] Lens Server ... SUCCESS [8:16.106s]
[INFO] Lens client ... SUCCESS [38.470s]
[INFO] Lens CLI .. SUCCESS [51.862s]
[INFO] Lens Examples . SUCCESS [9.145s]
[INFO] Lens Ship Jars to Distributed Cache ... SUCCESS [1.612s]
[INFO] Lens Distribution . SUCCESS [9.499s]
[INFO] Lens ML Lib ... SUCCESS [1:20.974s]
[INFO] Lens ML Ext Distribution .. SUCCESS [2.216s]
[INFO] Lens Regression ... SUCCESS [14.834s]
[INFO] Lens UI ... SUCCESS [27.308s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 23:21.839s
[INFO] Finished at: Tue Nov 17 14:25:05 UTC 2015
[INFO] Final Memory: 202M/2273M
[INFO] 


Thanks,

Rajat Khandelwal



Re: Review Request 40383: Updating release doc information

2015-11-17 Thread Raju Bairishetti

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40383/
---

(Updated Nov. 18, 2015, 6:12 a.m.)


Review request for lens, Amareshwari Sriramadasu and Rajat Khandelwal.


Bugs: LENS-805
https://issues.apache.org/jira/browse/LENS-805


Repository: lens


Description
---

added tasks info in release doc


Diffs (updated)
-

  src/site/apt/releases/download.apt eba5172 
  src/site/apt/releases/release-history.apt b683360 

Diff: https://reviews.apache.org/r/40383/diff/


Testing
---

Tested on local.

Download links are not valid at this moment.


Thanks,

Raju Bairishetti



[jira] [Updated] (LENS-805) Update 2.4 release documentation

2015-11-17 Thread Raju Bairishetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raju Bairishetti updated LENS-805:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Merged to current-release-line. 

> Update 2.4 release documentation
> 
>
> Key: LENS-805
> URL: https://issues.apache.org/jira/browse/LENS-805
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
> Fix For: 2.4
>
> Attachments: LENS-805.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (LENS-805) Update 2.4 release documentation

2015-11-17 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/LENS-805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010376#comment-15010376
 ] 

Hadoop QA commented on LENS-805:


Applied patch: 
[LENS-805.patch|https://issues.apache.org/jira/secure/attachment/12772926/LENS-805.patch]
 and ran command: mvn clean install -fae. Result: Success. Build Job: 
https://builds.apache.org/job/PreCommit-Lens-Build/176/

> Update 2.4 release documentation
> 
>
> Key: LENS-805
> URL: https://issues.apache.org/jira/browse/LENS-805
> Project: Apache Lens
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Raju Bairishetti
>Assignee: Raju Bairishetti
> Fix For: 2.4
>
> Attachments: LENS-805.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (LENS-826) lens.client.query.poll.interval needs doc update

2015-11-17 Thread Amareshwari Sriramadasu (JIRA)

 [ 
https://issues.apache.org/jira/browse/LENS-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amareshwari Sriramadasu updated LENS-826:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed. Thanks [~raju.bairishetti]

> lens.client.query.poll.interval needs doc update
> 
>
> Key: LENS-826
> URL: https://issues.apache.org/jira/browse/LENS-826
> Project: Apache Lens
>  Issue Type: Bug
>  Components: docs
>Reporter: Amareshwari Sriramadasu
>Assignee: Raju Bairishetti
>Priority: Minor
> Fix For: 2.4
>
> Attachments: LENS-826.01.patch, LENS-826.patch
>
>
> lens.client.query.poll.interval is missing in lens-client-default.xml and the 
> apt file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)