[jira] [Updated] (LENS-1041) Test case org.apache.lens.client.TestLensClient.testTimeout Failing intermittently
[ https://issues.apache.org/jira/browse/LENS-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1041: --- Component/s: test > Test case org.apache.lens.client.TestLensClient.testTimeout Failing > intermittently > --- > > Key: LENS-1041 > URL: https://issues.apache.org/jira/browse/LENS-1041 > Project: Apache Lens > Issue Type: Bug > Components: test >Reporter: Puneet Gupta >Assignee: Puneet Gupta >Priority: Minor > Fix For: 2.6 > > Attachments: lens-1041.01.patch > > > **Error Message** > java.net.SocketTimeoutException: Read timed out > **Stacktrace** > javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed > out > at java.net.SocketInputStream.socketRead0(Native Method) > at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) > at java.net.SocketInputStream.read(SocketInputStream.java:170) > at java.net.SocketInputStream.read(SocketInputStream.java:141) > at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) > at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) > at java.io.BufferedInputStream.read(BufferedInputStream.java:345) > at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:704) > at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647) > at > sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1536) > at > sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) > at > java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) > at > org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:394) > at > org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:285) > at > org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:255) > at > org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:700) > at org.glassfish.jersey.internal.Errors.process(Errors.java:315) > at org.glassfish.jersey.internal.Errors.process(Errors.java:297) > at org.glassfish.jersey.internal.Errors.process(Errors.java:228) > at > org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444) > at > org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:696) > at > org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:420) > at > org.glassfish.jersey.client.JerseyInvocation$Builder.delete(JerseyInvocation.java:365) > at org.apache.lens.client.LensConnection.close(LensConnection.java:217) > at > org.apache.lens.client.LensClient.closeConnection(LensClient.java:408) > at > org.apache.lens.client.TestLensClient.testTimeout(TestLensClient.java:267) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1178) lens-cli tests broken in master
[ https://issues.apache.org/jira/browse/LENS-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1178: --- Component/s: test > lens-cli tests broken in master > --- > > Key: LENS-1178 > URL: https://issues.apache.org/jira/browse/LENS-1178 > Project: Apache Lens > Issue Type: Bug > Components: test >Affects Versions: 2.6 >Reporter: Rajat Khandelwal >Assignee: Puneet Gupta > Fix For: 2.6 > > > https://builds.apache.org/job/PreCommit-Lens-Build/555/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1156) TestUnionQueries.testDimAttrExpressionQuery failed in commit build
[ https://issues.apache.org/jira/browse/LENS-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1156: --- Component/s: test > TestUnionQueries.testDimAttrExpressionQuery failed in commit build > -- > > Key: LENS-1156 > URL: https://issues.apache.org/jira/browse/LENS-1156 > Project: Apache Lens > Issue Type: Bug > Components: cube, test >Affects Versions: 2.6 >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu >Priority: Minor > Fix For: 2.6 > > Attachments: LENS-1156.patch > > > https://builds.apache.org/job/Lens-Commit/org.apache.lens$lens-cube/1256/testReport/junit/org.apache.lens.cube.parse/TestUnionQueries/testDimAttrExpressionQuery/ > has failed. > Looking at the failure - it seems join strings and comparison is not working > for union queries. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-964) Lens-cli test case TestLensQueryCommands.executeSyncQuery() getting skipped but build is passing
[ https://issues.apache.org/jira/browse/LENS-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-964: -- Component/s: test > Lens-cli test case TestLensQueryCommands.executeSyncQuery() getting skipped > but build is passing > - > > Key: LENS-964 > URL: https://issues.apache.org/jira/browse/LENS-964 > Project: Apache Lens > Issue Type: Bug > Components: test >Reporter: Puneet Gupta >Assignee: Puneet Gupta > Fix For: 2.6 > > Attachments: lens-964.v2.patch > > > mvn clean test > -Dtest=org.apache.lens.cli.TestLensQueryCommands#executeSyncQuery > --- > T E S T S > --- > Running org.apache.lens.cli.TestLensQueryCommands > Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 601.078 sec - > in org.apache.lens.cli.TestLensQueryCommands > Results : > Tests run: 1, Failures: 0, Errors: 0, Skipped: 1 > [INFO] > > [INFO] BUILD SUCCESS > [INFO] > > [INFO] Total time: 11:08 min > [INFO] Finished at: 2016-02-19T18:53:23+05:30 > [INFO] Final Memory: 73M/1022M > [INFO] > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1143) Fix test cases to incorporate LENS-1019 changes
[ https://issues.apache.org/jira/browse/LENS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1143: --- Component/s: test > Fix test cases to incorporate LENS-1019 changes > --- > > Key: LENS-1143 > URL: https://issues.apache.org/jira/browse/LENS-1143 > Project: Apache Lens > Issue Type: Bug > Components: server, test >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir >Priority: Blocker > Fix For: 2.6 > > Attachments: 0001-Changes-in-the-test-case.patch, > 0001-Fixing-Text-case-for-duplicate-queries.patch, 0001-Test-case-fix.patch, > fix-test-case-1.patch > > > Test cases should keep lens.server.duplicate.query.allowed true by default. > Because some of the test cases might be submitting the same query and > expecting the queue length to increase. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1025) Getting Intermittent failure from org.apache.lens.cube.parse.TestCubeRewriter.testQueryWithContinuousUpdatePeriod
[ https://issues.apache.org/jira/browse/LENS-1025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1025: --- Issue Type: Bug (was: Test) > Getting Intermittent failure from > org.apache.lens.cube.parse.TestCubeRewriter.testQueryWithContinuousUpdatePeriod > - > > Key: LENS-1025 > URL: https://issues.apache.org/jira/browse/LENS-1025 > Project: Apache Lens > Issue Type: Bug > Components: cube, test >Reporter: Puneet Gupta >Assignee: Amareshwari Sriramadasu >Priority: Minor > Fix For: 2.6 > > Attachments: LENS-1025.2.patch, LENS-1025.patch > > > *Error Message* > CANNOT_USE_TIMERANGE_WRITER[Partitions are in different update periods] > *Stacktrace* > org.apache.lens.server.api.error.LensException: > CANNOT_USE_TIMERANGE_WRITER[Partitions are in different update periods] > at > org.apache.lens.cube.parse.BetweenTimeRangeWriter.getTimeRangeWhereClause(BetweenTimeRangeWriter.java:67) > at > org.apache.lens.cube.parse.StorageTableResolver.resolveFactStoragePartitions(StorageTableResolver.java:496) > at > org.apache.lens.cube.parse.StorageTableResolver.rewriteContext(StorageTableResolver.java:138) > at > org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:229) > at > org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:199) > at > org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:215) > at > org.apache.lens.cube.parse.TestQueryRewrite.rewriteCtx(TestQueryRewrite.java:92) > at > org.apache.lens.cube.parse.TestCubeRewriter.testQueryWithContinuousUpdatePeriod(TestCubeRewriter.java:97) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1042) TestEventService.testSesionHandleEvent fails intermittently
[
https://issues.apache.org/jira/browse/LENS-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Puneet Gupta updated LENS-1042:
---
Issue Type: Bug (was: Test)
> TestEventService.testSesionHandleEvent fails intermittently
> ---
>
> Key: LENS-1042
> URL: https://issues.apache.org/jira/browse/LENS-1042
> Project: Apache Lens
> Issue Type: Bug
> Components: server, test
>Reporter: Amareshwari Sriramadasu
>Assignee: Raju Bairishetti
> Fix For: 2.6
>
> Attachments: LENS-1042.patch, LENS-1042_01.patch
>
>
> {noformat}
> Error Message
> expected [true] but found [false]
> Stacktrace
> java.lang.AssertionError: expected [true] but found [false]
> at org.testng.Assert.fail(Assert.java:94)
> at org.testng.Assert.failNotEquals(Assert.java:494)
> at org.testng.Assert.assertTrue(Assert.java:42)
> at org.testng.Assert.assertTrue(Assert.java:52)
> at
> org.apache.lens.server.query.TestEventService.testSesionHandleEvent(TestEventService.java:403)
> Standard Output
> Got Event: Type= org.apache.lens.server.api.session.SessionOpened obj =
> SessionOpened(super=SessionEvent(sessionHandle= encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=c05af6e3-4498-46fe-b83a-f1aab9499005), user=user)
> Got Event: Type= org.apache.lens.server.api.session.SessionRestored obj
> = SessionRestored(super=SessionEvent(sessionHandle= encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=09e24c8b-10d5-4e01-815e-049d62e935ec))
> Got Event: Type= org.apache.lens.server.query.TestEventService$1 obj =
> org.apache.lens.server.query.TestEventService$1@45e0744
> Got Event: Type= org.apache.lens.server.api.session.SessionClosed obj =
> SessionClosed(super=SessionEvent(sessionHandle= encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=2a4cc8cd-f025-434c-acf8-b9e7ed11872f))
> Got Event: Type= org.apache.lens.server.api.session.SessionExpired obj =
> SessionExpired(super=SessionClosed(super=SessionEvent(sessionHandle= version="1.0" encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=65ea3954-dfd9-435d-85aa-1fbe08db076a)))
> {noformat}
> Failure at
> https://builds.apache.org/job/PreCommit-Lens-Build/431/testReport/junit/org.apache.lens.server.query/TestEventService/testSesionHandleEvent/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (LENS-1042) TestEventService.testSesionHandleEvent fails intermittently
[
https://issues.apache.org/jira/browse/LENS-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Puneet Gupta updated LENS-1042:
---
Issue Type: Test (was: Bug)
> TestEventService.testSesionHandleEvent fails intermittently
> ---
>
> Key: LENS-1042
> URL: https://issues.apache.org/jira/browse/LENS-1042
> Project: Apache Lens
> Issue Type: Test
> Components: server, test
>Reporter: Amareshwari Sriramadasu
>Assignee: Raju Bairishetti
> Fix For: 2.6
>
> Attachments: LENS-1042.patch, LENS-1042_01.patch
>
>
> {noformat}
> Error Message
> expected [true] but found [false]
> Stacktrace
> java.lang.AssertionError: expected [true] but found [false]
> at org.testng.Assert.fail(Assert.java:94)
> at org.testng.Assert.failNotEquals(Assert.java:494)
> at org.testng.Assert.assertTrue(Assert.java:42)
> at org.testng.Assert.assertTrue(Assert.java:52)
> at
> org.apache.lens.server.query.TestEventService.testSesionHandleEvent(TestEventService.java:403)
> Standard Output
> Got Event: Type= org.apache.lens.server.api.session.SessionOpened obj =
> SessionOpened(super=SessionEvent(sessionHandle= encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=c05af6e3-4498-46fe-b83a-f1aab9499005), user=user)
> Got Event: Type= org.apache.lens.server.api.session.SessionRestored obj
> = SessionRestored(super=SessionEvent(sessionHandle= encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=09e24c8b-10d5-4e01-815e-049d62e935ec))
> Got Event: Type= org.apache.lens.server.query.TestEventService$1 obj =
> org.apache.lens.server.query.TestEventService$1@45e0744
> Got Event: Type= org.apache.lens.server.api.session.SessionClosed obj =
> SessionClosed(super=SessionEvent(sessionHandle= encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=2a4cc8cd-f025-434c-acf8-b9e7ed11872f))
> Got Event: Type= org.apache.lens.server.api.session.SessionExpired obj =
> SessionExpired(super=SessionClosed(super=SessionEvent(sessionHandle= version="1.0" encoding="UTF-8"
> standalone="yes"?>b5528854-4452-496d-a97f-0772c5c0bcd81891cde4-90fb-414d-b162-0a0854b0a9ba,
> id=65ea3954-dfd9-435d-85aa-1fbe08db076a)))
> {noformat}
> Failure at
> https://builds.apache.org/job/PreCommit-Lens-Build/431/testReport/junit/org.apache.lens.server.query/TestEventService/testSesionHandleEvent/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (LENS-1206) Test Cases for SchedulerDAO
[ https://issues.apache.org/jira/browse/LENS-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1206: --- Issue Type: Test (was: Task) > Test Cases for SchedulerDAO > --- > > Key: LENS-1206 > URL: https://issues.apache.org/jira/browse/LENS-1206 > Project: Apache Lens > Issue Type: Test >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Fix For: 2.6 > > Attachments: scheduler-store-test-1.patch, > scheduler-store-test.patch, scheduler-store-test.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-906) Seeing huge time for test TestCubeMetastoreClient
[ https://issues.apache.org/jira/browse/LENS-906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-906: -- Issue Type: Test (was: Improvement) > Seeing huge time for test TestCubeMetastoreClient > - > > Key: LENS-906 > URL: https://issues.apache.org/jira/browse/LENS-906 > Project: Apache Lens > Issue Type: Test > Components: cube, test >Reporter: Amareshwari Sriramadasu >Assignee: Amareshwari Sriramadasu >Priority: Minor > Fix For: 2.6 > > Attachments: LENS-906.patch > > > https://builds.apache.org/job/Lens-Commit/org.apache.lens$lens-cube/1156/testReport/org.apache.lens.cube.metadata/TestCubeMetastoreClient/ > : > The test is taking around 11 minutes. > > testAlterCube 1 min 39 secPassed > testAlterCubeFact 1 min 3 sec Passed > testAlterDerivedCube 0.23 secPassed > testAlterDim 0.41 secPassed > testCaching 1 min 38 secPassed > testCube 50 sec Passed > testCubeDim 2.8 sec Passed > testCubeDimWithNonTimeParts 2.1 sec Passed > testCubeDimWithThreeTimedParts5.4 sec Passed > testCubeDimWithTwoStorages0.3 sec Passed > testCubeDimWithWeight 0.56 secPassed > testCubeDimWithoutDumps 43 ms Passed > testCubeFact 47 sec Passed > testCubeFactWithParts 24 sec Passed > testCubeFactWithPartsAndTimedParts22 sec Passed > testCubeFactWithThreeTimedParts 2 min 54 secPassed > testCubeFactWithTwoStorages 36 sec Passed > testCubeFactWithTwoTimedParts 25 sec Passed > testCubeFactWithWeight26 sec Passed > testDimension 0.42 secPassed > testStorage 0.11 secPassed > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1172) TestQueryServiceDuplicate failing in tearDown
[ https://issues.apache.org/jira/browse/LENS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1172: --- Issue Type: Test (was: Improvement) > TestQueryServiceDuplicate failing in tearDown > - > > Key: LENS-1172 > URL: https://issues.apache.org/jira/browse/LENS-1172 > Project: Apache Lens > Issue Type: Test >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.6 > > Attachments: LENS-1172.01.patch, LENS-1172.02.patch, > LENS-1172.03.patch, LENS-1172.04.patch > > > The test class has an AfterMethod tearDown method, which drops a table and > closes a session. But the session and the table don't get created until the > test method of this class is run. Furthermore, this test depends on other > test groups. So if any of the tests of those groups fail, the tests of this > class won't be run. But the tearDown will still be run since setUp was run > too. > Proposed fix is to drop the table and close the session in the test method > itself. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1171) TestMetastoreService is creating/destroying session in each test
[ https://issues.apache.org/jira/browse/LENS-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet Gupta updated LENS-1171: --- Issue Type: Test (was: Improvement) > TestMetastoreService is creating/destroying session in each test > > > Key: LENS-1171 > URL: https://issues.apache.org/jira/browse/LENS-1171 > Project: Apache Lens > Issue Type: Test >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Fix For: 2.6 > > Attachments: LENS-1171.01.patch, LENS-1171.02.patch > > > Session can be created at the start and can be destroyed at the end. This > will be an improvement wrt test running time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-1283) Map failure APIResult to Exception in Lens client
[ https://issues.apache.org/jira/browse/LENS-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434774#comment-15434774 ] Rajat Khandelwal commented on LENS-1283: Taking patch from reviewboard and attaching > Map failure APIResult to Exception in Lens client > - > > Key: LENS-1283 > URL: https://issues.apache.org/jira/browse/LENS-1283 > Project: Apache Lens > Issue Type: Improvement >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Attachments: LENS-1283.02.patch, LENS-1283.05.patch, > LENS-1283.06.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 51332: LENS-1283: Map failure APIResult to Exception in Lens client
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51332/ --- (Updated Aug. 24, 2016, 5:13 p.m.) Review request for lens. Bugs: LENS-1283 https://issues.apache.org/jira/browse/LENS-1283 Repository: lens Description --- Diffs (updated) - lens-api/src/main/java/org/apache/lens/api/APIResult.java 26e99265f8437fedfcb093ad61ba1f810c026516 lens-api/src/main/java/org/apache/lens/api/ToYAMLString.java 65a0c44813569848d35127b0a58b0831bd8e67f7 lens-api/src/test/java/org/apache/lens/api/jaxb/YAMLToStringStrategyTest.java 3a784f8e52311ed5875c1e2471bb3bd2e46931f6 lens-api/src/test/resources/toString/org.apache.lens.api.query.QueryHandleWithResultSet.yaml dfa33d22976bd3a98c17c190d4c99f2d4d22b4c0 lens-client/src/main/java/org/apache/lens/client/LensMetadataClient.java a1a78c50b8cd83fcf7e5c76022566889a246a2b3 lens-client/src/main/java/org/apache/lens/client/exceptions/LensBriefErrorException.java ddfd777a77247ece953d11208086ea7f473179e1 lens-client/src/main/java/org/apache/lens/client/model/IdBriefErrorTemplate.java 8a485b521b6aa2544c65035ef4edcde272c04e43 lens-examples/src/test/java/org/apache/lens/examples/ExampleSchemaToStringTest.java 4a3c07b501064238bd9fa068cfbbaccadc045f46 Diff: https://reviews.apache.org/r/51332/diff/ Testing --- Thanks, Rajat Khandelwal
[jira] [Updated] (LENS-1288) example-job.xml in example schema isn't up to date with recent xsd changes
[ https://issues.apache.org/jira/browse/LENS-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajat Khandelwal updated LENS-1288: --- Issue Type: Bug (was: New Feature) > example-job.xml in example schema isn't up to date with recent xsd changes > -- > > Key: LENS-1288 > URL: https://issues.apache.org/jira/browse/LENS-1288 > Project: Apache Lens > Issue Type: Bug >Reporter: Rajat Khandelwal >Assignee: Lavkesh Lahngir > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-1288) example-job.xml in example schema isn't up to date with recent xsd changes
Rajat Khandelwal created LENS-1288: -- Summary: example-job.xml in example schema isn't up to date with recent xsd changes Key: LENS-1288 URL: https://issues.apache.org/jira/browse/LENS-1288 Project: Apache Lens Issue Type: New Feature Reporter: Rajat Khandelwal Assignee: Lavkesh Lahngir -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-1275) Launch Time should be set before executeAsync is called on selected driver
[ https://issues.apache.org/jira/browse/LENS-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434662#comment-15434662 ] Hadoop QA commented on LENS-1275: - Applied patch: [LENS-1275.04.patch|https://issues.apache.org/jira/secure/attachment/12825010/LENS-1275.04.patch] and ran command: mvn clean install -fae. Result: Success. Build Job: https://builds.apache.org/job/PreCommit-Lens-Build/829/ > Launch Time should be set before executeAsync is called on selected driver > -- > > Key: LENS-1275 > URL: https://issues.apache.org/jira/browse/LENS-1275 > Project: Apache Lens > Issue Type: Bug >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Attachments: LENS-1275.02.patch, LENS-1275.03.patch, > LENS-1275.04.patch, LENS-1275.2016-08-11_16:06:44.patch, > LENS-1275.2016-08-11_18:31:13.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-952) Bump up enunciate version to work with java 8
[ https://issues.apache.org/jira/browse/LENS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434640#comment-15434640 ] Hudson commented on LENS-952: - SUCCESS: Integrated in Jenkins build Lens-Commit-Java8 #244 (See [https://builds.apache.org/job/Lens-Commit-Java8/244/]) LENS-952: Bump up enunciate version to work with java 8 (raju: rev abf44abab36f5f289032050fd09cb8fe7685dbb0) * (edit) lens-server/enunciate.xml * (edit) lens-server/pom.xml * (edit) pom.xml > Bump up enunciate version to work with java 8 > - > > Key: LENS-952 > URL: https://issues.apache.org/jira/browse/LENS-952 > Project: Apache Lens > Issue Type: Improvement > Components: build >Reporter: Amareshwari Sriramadasu >Assignee: Deepak Barr > Fix For: 2.6 > > Attachments: LENS-952.2.patch, LENS-952.3.patch > > > We are depending on 1.28 version of enunciate, which does not work on java 8. > We should move to latest version to work fine with java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-1279) Improve Scheduler API messages
[ https://issues.apache.org/jira/browse/LENS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434561#comment-15434561 ] Hudson commented on LENS-1279: -- UNSTABLE: Integrated in Jenkins build Lens-Commit-Java8 #243 (See [https://builds.apache.org/job/Lens-Commit-Java8/243/]) [LENS-1279] Imporve error messages and API responses (rajatgupta59: rev fae2773cd2a9c3a35875584493892abd5c1b6f18) * (delete) lens-api/src/test/java/org/apache/lens/api/query/SupportedQuerySubmitOperationsTest.java * (edit) lens-api/src/main/java/org/apache/lens/api/scheduler/SchedulerJobInstanceHandle.java * (edit) lens-api/src/main/java/org/apache/lens/api/result/LensAPIResult.java * (delete) lens-server/src/main/java/org/apache/lens/server/error/UnSupportedQuerySubmitOpException.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/SchedulerEventListener.java * (edit) lens-api/src/main/resources/lens-errors.conf * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/AlarmService.java * (add) lens-server/src/main/java/org/apache/lens/server/error/UnSupportedOpException.java * (edit) lens-api/src/main/java/org/apache/lens/api/scheduler/SchedulerJobHandle.java * (add) lens-server/src/test/java/org/apache/lens/server/scheduler/util/SchedulerTestUtils.java * (edit) lens-server/src/main/java/org/apache/lens/server/util/UtilityMethods.java * (add) lens-api/src/test/java/org/apache/lens/api/query/SupportedOperationsTest.java * (edit) lens-server/src/main/java/org/apache/lens/server/query/QueryServiceResource.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/ScheduleResource.java * (delete) lens-api/src/main/java/org/apache/lens/api/query/SupportedQuerySubmitOperations.java * (edit) lens-server/src/test/java/org/apache/lens/server/scheduler/TestSchedulerServiceImpl.java * (edit) lens-server/src/main/java/org/apache/lens/server/error/LensServerErrorCode.java * (add) lens-api/src/main/java/org/apache/lens/api/SupportedOperations.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/SchedulerServiceImpl.java * (edit) lens-server-api/src/main/java/org/apache/lens/server/api/scheduler/SchedulerService.java * (add) lens-server/src/main/java/org/apache/lens/server/error/LensSchedulerErrorCode.java * (edit) lens-server/src/test/java/org/apache/lens/server/query/QueryAPIErrorResponseTest.java > Improve Scheduler API messages > > > Key: LENS-1279 > URL: https://issues.apache.org/jira/browse/LENS-1279 > Project: Apache Lens > Issue Type: Improvement >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Fix For: 2.7 > > Attachments: Scheduler-API-fixes.patch > > > This patch includes more clearer scheduler APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-1275) Launch Time should be set before executeAsync is called on selected driver
[ https://issues.apache.org/jira/browse/LENS-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434521#comment-15434521 ] Hadoop QA commented on LENS-1275: - Applied patch: [LENS-1275.04.patch|https://issues.apache.org/jira/secure/attachment/12825010/LENS-1275.04.patch] and ran command: mvn clean install -fae. Result: Failure. Build Job: https://builds.apache.org/job/PreCommit-Lens-Build/827/ > Launch Time should be set before executeAsync is called on selected driver > -- > > Key: LENS-1275 > URL: https://issues.apache.org/jira/browse/LENS-1275 > Project: Apache Lens > Issue Type: Bug >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Attachments: LENS-1275.02.patch, LENS-1275.03.patch, > LENS-1275.04.patch, LENS-1275.2016-08-11_16:06:44.patch, > LENS-1275.2016-08-11_18:31:13.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-1287) Create command in cli to create schema taking parent directory where schema is stored
[ https://issues.apache.org/jira/browse/LENS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434457#comment-15434457 ] Rajat Khandelwal commented on LENS-1287: Created https://reviews.apache.org/r/51363/ > Create command in cli to create schema taking parent directory where schema > is stored > - > > Key: LENS-1287 > URL: https://issues.apache.org/jira/browse/LENS-1287 > Project: Apache Lens > Issue Type: New Feature >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Review Request 51363: LENS-1287: Create command in cli to create schema taking parent directory where schema is stored
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51363/ --- Review request for lens. Bugs: LENS-1287 https://issues.apache.org/jira/browse/LENS-1287 Repository: lens Description --- Diffs - lens-api/src/main/java/org/apache/lens/api/APIResult.java 26e99265f8437fedfcb093ad61ba1f810c026516 lens-api/src/main/java/org/apache/lens/api/ToYAMLString.java 65a0c44813569848d35127b0a58b0831bd8e67f7 lens-cli/src/main/java/org/apache/lens/cli/commands/LensCRUDCommand.java 6ce8209eec3a8a92c14462f82e7c3ec5921d855a lens-cli/src/main/java/org/apache/lens/cli/commands/LensSchemaCommands.java PRE-CREATION lens-cli/src/main/java/org/apache/lens/cli/commands/LensSegmentationCommands.java PRE-CREATION lens-cli/src/main/java/org/apache/lens/cli/commands/annotations/LensSegmentationCommands.java e53442d2e169c003326eff0d83a826bb22aa7c37 lens-cli/src/main/resources/META-INF/spring/spring-shell-plugin.xml bfcf16b997fc101e7d2904b9e5ebed5d1bdd480c lens-cli/src/test/java/org/apache/lens/cli/TestLensDatabaseCommands.java 41672ac5a1091a14831dd5e8ecb24a62e1a908e5 lens-cli/src/test/java/org/apache/lens/cli/TestLensFactCommandsWithMissingWeight.java 24f9279b24de98ed1e7304ec2e2010c17df9f8d8 lens-cli/src/test/java/org/apache/lens/cli/TestLensSegmentationCommands.java e6d4bc5354bbcae9ea6d1f06ec2be6e2ff885cf6 lens-client/src/main/java/org/apache/lens/client/LensMetadataClient.java a1a78c50b8cd83fcf7e5c76022566889a246a2b3 lens-client/src/main/java/org/apache/lens/client/exceptions/LensBriefErrorException.java ddfd777a77247ece953d11208086ea7f473179e1 lens-client/src/main/java/org/apache/lens/client/model/IdBriefErrorTemplate.java 8a485b521b6aa2544c65035ef4edcde272c04e43 lens-server/src/test/resources/hive-site.xml 94c5012821330e1a78aad2a7fdfca0cc1d0fade2 Diff: https://reviews.apache.org/r/51363/diff/ Testing --- Thanks, Rajat Khandelwal
[jira] [Commented] (LENS-1279) Improve Scheduler API messages
[ https://issues.apache.org/jira/browse/LENS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434449#comment-15434449 ] Hudson commented on LENS-1279: -- SUCCESS: Integrated in Jenkins build Lens-Commit #1327 (See [https://builds.apache.org/job/Lens-Commit/1327/]) [LENS-1279] Imporve error messages and API responses (rajatgupta59: rev fae2773cd2a9c3a35875584493892abd5c1b6f18) * (edit) lens-api/src/main/java/org/apache/lens/api/result/LensAPIResult.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/AlarmService.java * (add) lens-api/src/main/java/org/apache/lens/api/SupportedOperations.java * (delete) lens-api/src/test/java/org/apache/lens/api/query/SupportedQuerySubmitOperationsTest.java * (add) lens-api/src/test/java/org/apache/lens/api/query/SupportedOperationsTest.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/SchedulerServiceImpl.java * (add) lens-server/src/main/java/org/apache/lens/server/error/LensSchedulerErrorCode.java * (edit) lens-server/src/main/java/org/apache/lens/server/query/QueryServiceResource.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/ScheduleResource.java * (delete) lens-server/src/main/java/org/apache/lens/server/error/UnSupportedQuerySubmitOpException.java * (add) lens-server/src/main/java/org/apache/lens/server/error/UnSupportedOpException.java * (edit) lens-server/src/main/java/org/apache/lens/server/util/UtilityMethods.java * (edit) lens-server/src/test/java/org/apache/lens/server/scheduler/TestSchedulerServiceImpl.java * (edit) lens-server/src/main/java/org/apache/lens/server/error/LensServerErrorCode.java * (edit) lens-server/src/main/java/org/apache/lens/server/scheduler/SchedulerEventListener.java * (edit) lens-server/src/test/java/org/apache/lens/server/query/QueryAPIErrorResponseTest.java * (edit) lens-server-api/src/main/java/org/apache/lens/server/api/scheduler/SchedulerService.java * (add) lens-server/src/test/java/org/apache/lens/server/scheduler/util/SchedulerTestUtils.java * (edit) lens-api/src/main/java/org/apache/lens/api/scheduler/SchedulerJobInstanceHandle.java * (delete) lens-api/src/main/java/org/apache/lens/api/query/SupportedQuerySubmitOperations.java * (edit) lens-api/src/main/java/org/apache/lens/api/scheduler/SchedulerJobHandle.java * (edit) lens-api/src/main/resources/lens-errors.conf > Improve Scheduler API messages > > > Key: LENS-1279 > URL: https://issues.apache.org/jira/browse/LENS-1279 > Project: Apache Lens > Issue Type: Improvement >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Fix For: 2.7 > > Attachments: Scheduler-API-fixes.patch > > > This patch includes more clearer scheduler APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 51332: LENS-1283: Map failure APIResult to Exception in Lens client
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51332/ --- (Updated Aug. 24, 2016, 1:40 p.m.) Review request for lens. Bugs: LENS-1283 https://issues.apache.org/jira/browse/LENS-1283 Repository: lens Description --- Diffs (updated) - lens-api/src/main/java/org/apache/lens/api/APIResult.java 26e99265f8437fedfcb093ad61ba1f810c026516 lens-api/src/main/java/org/apache/lens/api/ToYAMLString.java 65a0c44813569848d35127b0a58b0831bd8e67f7 lens-client/src/main/java/org/apache/lens/client/LensMetadataClient.java a1a78c50b8cd83fcf7e5c76022566889a246a2b3 lens-client/src/main/java/org/apache/lens/client/exceptions/LensBriefErrorException.java ddfd777a77247ece953d11208086ea7f473179e1 lens-client/src/main/java/org/apache/lens/client/model/IdBriefErrorTemplate.java 8a485b521b6aa2544c65035ef4edcde272c04e43 Diff: https://reviews.apache.org/r/51332/diff/ Testing --- Thanks, Rajat Khandelwal
[jira] [Created] (LENS-1287) Create command in cli to create schema taking parent directory where schema is stored
Rajat Khandelwal created LENS-1287: -- Summary: Create command in cli to create schema taking parent directory where schema is stored Key: LENS-1287 URL: https://issues.apache.org/jira/browse/LENS-1287 Project: Apache Lens Issue Type: New Feature Reporter: Rajat Khandelwal Assignee: Rajat Khandelwal -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 51332: LENS-1283: Map failure APIResult to Exception in Lens client
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51332/ --- (Updated Aug. 24, 2016, 1:36 p.m.) Review request for lens. Summary (updated) - LENS-1283: Map failure APIResult to Exception in Lens client Bugs: LENS-1283 https://issues.apache.org/jira/browse/LENS-1283 Repository: lens Description --- Diffs (updated) - lens-api/src/main/java/org/apache/lens/api/APIResult.java 26e99265f8437fedfcb093ad61ba1f810c026516 lens-api/src/main/java/org/apache/lens/api/ToYAMLString.java 65a0c44813569848d35127b0a58b0831bd8e67f7 lens-cli/src/main/java/org/apache/lens/cli/commands/LensSchemaCommands.java PRE-CREATION lens-cli/src/main/java/org/apache/lens/cli/commands/LensSegmentationCommands.java PRE-CREATION lens-client/src/main/java/org/apache/lens/client/LensMetadataClient.java a1a78c50b8cd83fcf7e5c76022566889a246a2b3 lens-client/src/main/java/org/apache/lens/client/exceptions/LensBriefErrorException.java ddfd777a77247ece953d11208086ea7f473179e1 lens-client/src/main/java/org/apache/lens/client/model/IdBriefErrorTemplate.java 8a485b521b6aa2544c65035ef4edcde272c04e43 lens-server/src/test/resources/hive-site.xml 94c5012821330e1a78aad2a7fdfca0cc1d0fade2 Diff: https://reviews.apache.org/r/51332/diff/ Testing --- Thanks, Rajat Khandelwal
[jira] [Commented] (LENS-1283) Map failure APIResult to Exception in Lens client
[ https://issues.apache.org/jira/browse/LENS-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434442#comment-15434442 ] Rajat Khandelwal commented on LENS-1283: Exception signature can't be same, I'm mapping FAILED APIResult to LensBriefErrorException in this jira. > Map failure APIResult to Exception in Lens client > - > > Key: LENS-1283 > URL: https://issues.apache.org/jira/browse/LENS-1283 > Project: Apache Lens > Issue Type: Improvement >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Attachments: LENS-1283.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 51332: LENS-1283: throw LensAPIException in lens client code when http status is 500 and APIResult payload is provided with FAILED status
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51332/ --- (Updated Aug. 24, 2016, 1:29 p.m.) Review request for lens. Bugs: LENS-1283 https://issues.apache.org/jira/browse/LENS-1283 Repository: lens Description --- Diffs (updated) - lens-api/src/main/java/org/apache/lens/api/APIResult.java 26e99265f8437fedfcb093ad61ba1f810c026516 lens-api/src/main/java/org/apache/lens/api/ToYAMLString.java 65a0c44813569848d35127b0a58b0831bd8e67f7 lens-cli/src/main/java/org/apache/lens/cli/commands/LensCRUDCommand.java 6ce8209eec3a8a92c14462f82e7c3ec5921d855a lens-cli/src/main/java/org/apache/lens/cli/commands/LensSchemaCommands.java PRE-CREATION lens-cli/src/main/java/org/apache/lens/cli/commands/LensSegmentationCommands.java PRE-CREATION lens-cli/src/main/java/org/apache/lens/cli/commands/annotations/LensSegmentationCommands.java e53442d2e169c003326eff0d83a826bb22aa7c37 lens-cli/src/main/resources/META-INF/spring/spring-shell-plugin.xml bfcf16b997fc101e7d2904b9e5ebed5d1bdd480c lens-cli/src/test/java/org/apache/lens/cli/TestLensDatabaseCommands.java 41672ac5a1091a14831dd5e8ecb24a62e1a908e5 lens-cli/src/test/java/org/apache/lens/cli/TestLensFactCommandsWithMissingWeight.java 24f9279b24de98ed1e7304ec2e2010c17df9f8d8 lens-cli/src/test/java/org/apache/lens/cli/TestLensSegmentationCommands.java e6d4bc5354bbcae9ea6d1f06ec2be6e2ff885cf6 lens-client/src/main/java/org/apache/lens/client/LensMetadataClient.java a1a78c50b8cd83fcf7e5c76022566889a246a2b3 lens-client/src/main/java/org/apache/lens/client/exceptions/LensBriefErrorException.java ddfd777a77247ece953d11208086ea7f473179e1 lens-client/src/main/java/org/apache/lens/client/model/IdBriefErrorTemplate.java 8a485b521b6aa2544c65035ef4edcde272c04e43 lens-server/src/test/resources/hive-site.xml 94c5012821330e1a78aad2a7fdfca0cc1d0fade2 Diff: https://reviews.apache.org/r/51332/diff/ Testing --- Thanks, Rajat Khandelwal
[jira] [Commented] (LENS-1243) Support Asynchronous status updates from drivers
[ https://issues.apache.org/jira/browse/LENS-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434427#comment-15434427 ] Hadoop QA commented on LENS-1243: - Applied patch: [LENS-1243.14.patch|https://issues.apache.org/jira/secure/attachment/12825056/LENS-1243.14.patch] and ran command: mvn clean install -fae. Result: Failure. Build Job: https://builds.apache.org/job/PreCommit-Lens-Build/824/ > Support Asynchronous status updates from drivers > > > Key: LENS-1243 > URL: https://issues.apache.org/jira/browse/LENS-1243 > Project: Apache Lens > Issue Type: Improvement >Reporter: Rajat Khandelwal >Assignee: Rajat Khandelwal > Attachments: LENS-1243.07.patch, LENS-1243.09.patch, > LENS-1243.10.patch, LENS-1243.12.patch, LENS-1243.13.patch, LENS-1243.14.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-952) Bump up enunciate version to work with java 8
[ https://issues.apache.org/jira/browse/LENS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434422#comment-15434422 ] Hadoop QA commented on LENS-952: Patch does not apply. Build job: https://builds.apache.org/job/PreCommit-Lens-Build/826/ > Bump up enunciate version to work with java 8 > - > > Key: LENS-952 > URL: https://issues.apache.org/jira/browse/LENS-952 > Project: Apache Lens > Issue Type: Improvement > Components: build >Reporter: Amareshwari Sriramadasu >Assignee: Deepak Barr > Fix For: 2.6 > > Attachments: LENS-952.2.patch, LENS-952.3.patch > > > We are depending on 1.28 version of enunciate, which does not work on java 8. > We should move to latest version to work fine with java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-952) Bump up enunciate version to work with java 8
[ https://issues.apache.org/jira/browse/LENS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated LENS-952: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to both master and current-release-line. Thanks [~deepak.barr] > Bump up enunciate version to work with java 8 > - > > Key: LENS-952 > URL: https://issues.apache.org/jira/browse/LENS-952 > Project: Apache Lens > Issue Type: Improvement > Components: build >Reporter: Amareshwari Sriramadasu >Assignee: Deepak Barr > Fix For: 2.6 > > Attachments: LENS-952.2.patch, LENS-952.3.patch > > > We are depending on 1.28 version of enunciate, which does not work on java 8. > We should move to latest version to work fine with java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1286) Handle Lens server restart
[ https://issues.apache.org/jira/browse/LENS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated LENS-1286: -- Description: Scheduled events which are generated by AlarmService for scheduling are processed by a SchedulerEventListener thread. These steps are performed after receiving a scheduled event: 1. Get the job stored in the SchedulerDAO 2. Create a session with job owner and fill the session conf. 3. Create the instance if it is not a rerun otherwise get the instance from the store. 4. Create a Run instance. 5. Store instance (if not present) and run to the store. 6. Launch the query. 7. Update the run with the latest information. 8. If there is a failure in query launch then update the run status to be failed. While EventListener is processing the event, it can be closed during the shutdown of scheduler service. Closing the thread can cause operations to be incomplete. There are these stages where the thread can be interrupted: 1. Shutdown just after the alarm Event is fired and received: In this case, we won't have any entry for the instance run in the store. This will cause a hole in the list of instances. 2. Shutdown before query launch. In this case, at least we will have an entry in the table and status as NEW. 3. Shutdown after query launch. In this case, the status won't be updated, and even if the query is launched we will have no information about the handle. When this happens the scheduled status will remain NEW Of all the scenarios above, the first one is kind of annoying because there is no way to generate the event from Alarm Service again if it is already triggered. Second and third scenarios can be handled manually by killing the instance and re-running it. Apart from the scheduler event listener thread, we have another thread which processes the query end event which works as follows: 1. Receive the event and check if this is a scheduled query. 2. Check the final status of the query and set it as the instance status. If a shutdown happens after receiving the query end event, it will cause the status to remain as RUNNING. > Handle Lens server restart > -- > > Key: LENS-1286 > URL: https://issues.apache.org/jira/browse/LENS-1286 > Project: Apache Lens > Issue Type: Sub-task > Components: server >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > > Scheduled events which are generated by AlarmService for scheduling are > processed by a SchedulerEventListener thread. > These steps are performed after receiving a scheduled event: > 1. Get the job stored in the SchedulerDAO > 2. Create a session with job owner and fill the session conf. > 3. Create the instance if it is not a rerun otherwise get the instance from > the store. > 4. Create a Run instance. > 5. Store instance (if not present) and run to the store. > 6. Launch the query. > 7. Update the run with the latest information. > 8. If there is a failure in query launch then update the run status to be > failed. > While EventListener is processing the event, it can be closed during the > shutdown of scheduler service. Closing the thread can cause operations to be > incomplete. > There are these stages where the thread can be interrupted: > 1. Shutdown just after the alarm Event is fired and received: > In this case, we won't have any entry for the instance run in the store. This > will cause a hole in the list of instances. > 2. Shutdown before query launch. > In this case, at least we will have an entry in the table and status as NEW. > 3. Shutdown after query launch. > In this case, the status won't be updated, and even if the query is launched > we will have no information about the handle. When this happens the > scheduled status will remain NEW > Of all the scenarios above, the first one is kind of annoying because there > is no way to generate the event from Alarm Service again if it is already > triggered. > Second and third scenarios can be handled manually by killing the instance > and re-running it. > Apart from the scheduler event listener thread, we have another thread which > processes the query end event which works as follows: > 1. Receive the event and check if this is a scheduled query. > 2. Check the final status of the query and set it as the instance status. > If a shutdown happens after receiving the query end event, it will cause the > status to remain as RUNNING. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (LENS-1286) Handle Lens server restart
[ https://issues.apache.org/jira/browse/LENS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir reassigned LENS-1286: - Assignee: Lavkesh Lahngir > Handle Lens server restart > -- > > Key: LENS-1286 > URL: https://issues.apache.org/jira/browse/LENS-1286 > Project: Apache Lens > Issue Type: Sub-task > Components: server >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1286) Handle Lens server restart
[ https://issues.apache.org/jira/browse/LENS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated LENS-1286: -- Summary: Handle Lens server restart (was: Handle Lens Restarts) > Handle Lens server restart > -- > > Key: LENS-1286 > URL: https://issues.apache.org/jira/browse/LENS-1286 > Project: Apache Lens > Issue Type: Sub-task > Components: server >Reporter: Lavkesh Lahngir > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (LENS-1286) Handle Lens Restarts
Lavkesh Lahngir created LENS-1286: - Summary: Handle Lens Restarts Key: LENS-1286 URL: https://issues.apache.org/jira/browse/LENS-1286 Project: Apache Lens Issue Type: Sub-task Reporter: Lavkesh Lahngir -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-952) Bump up enunciate version to work with java 8
[ https://issues.apache.org/jira/browse/LENS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Barr updated LENS-952: - Attachment: LENS-952.3.patch > Bump up enunciate version to work with java 8 > - > > Key: LENS-952 > URL: https://issues.apache.org/jira/browse/LENS-952 > Project: Apache Lens > Issue Type: Improvement > Components: build >Reporter: Amareshwari Sriramadasu >Assignee: Deepak Barr > Fix For: 2.6 > > Attachments: LENS-952.2.patch, LENS-952.3.patch > > > We are depending on 1.28 version of enunciate, which does not work on java 8. > We should move to latest version to work fine with java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-952) Bump up enunciate version to work with java 8
[ https://issues.apache.org/jira/browse/LENS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Barr updated LENS-952: - Status: Patch Available (was: Open) > Bump up enunciate version to work with java 8 > - > > Key: LENS-952 > URL: https://issues.apache.org/jira/browse/LENS-952 > Project: Apache Lens > Issue Type: Improvement > Components: build >Reporter: Amareshwari Sriramadasu >Assignee: Deepak Barr > Fix For: 2.6 > > Attachments: LENS-952.2.patch, LENS-952.3.patch > > > We are depending on 1.28 version of enunciate, which does not work on java 8. > We should move to latest version to work fine with java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 50579: LENS-952 : Bump up enunciate version to work with java 8
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50579/ --- (Updated Aug. 24, 2016, 7:30 a.m.) Review request for lens. Changes --- Fixed indentation. Bugs: LENS-952 https://issues.apache.org/jira/browse/LENS-952 Repository: lens Description --- Bump up enunciate version to work with java 8 Diffs (updated) - lens-server/enunciate.xml 7013f13 lens-server/pom.xml 86343fd pom.xml f7ebee6 Diff: https://reviews.apache.org/r/50579/diff/ Testing --- Yes. Ran "mvn clean install -Penunciate" successfully. Thanks, Deepak Barr
[jira] [Updated] (LENS-952) Bump up enunciate version to work with java 8
[ https://issues.apache.org/jira/browse/LENS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Barr updated LENS-952: - Status: Open (was: Patch Available) > Bump up enunciate version to work with java 8 > - > > Key: LENS-952 > URL: https://issues.apache.org/jira/browse/LENS-952 > Project: Apache Lens > Issue Type: Improvement > Components: build >Reporter: Amareshwari Sriramadasu >Assignee: Deepak Barr > Fix For: 2.6 > > Attachments: LENS-952.2.patch > > > We are depending on 1.28 version of enunciate, which does not work on java 8. > We should move to latest version to work fine with java8. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1285) Adding unit tests for scheduler API
[ https://issues.apache.org/jira/browse/LENS-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated LENS-1285: -- Attachment: Scheduler-API-tests.patch > Adding unit tests for scheduler API > --- > > Key: LENS-1285 > URL: https://issues.apache.org/jira/browse/LENS-1285 > Project: Apache Lens > Issue Type: Test >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Attachments: Scheduler-API-tests.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1285) Adding unit tests for scheduler API
[ https://issues.apache.org/jira/browse/LENS-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated LENS-1285: -- Status: Patch Available (was: Open) > Adding unit tests for scheduler API > --- > > Key: LENS-1285 > URL: https://issues.apache.org/jira/browse/LENS-1285 > Project: Apache Lens > Issue Type: Test >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Attachments: Scheduler-API-tests.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1279) Improve Scheduler API messages
[ https://issues.apache.org/jira/browse/LENS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajat Khandelwal updated LENS-1279: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Improve Scheduler API messages > > > Key: LENS-1279 > URL: https://issues.apache.org/jira/browse/LENS-1279 > Project: Apache Lens > Issue Type: Improvement >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Fix For: 2.7 > > Attachments: Scheduler-API-fixes.patch > > > This patch includes more clearer scheduler APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (LENS-1279) Improve Scheduler API messages
[ https://issues.apache.org/jira/browse/LENS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajat Khandelwal updated LENS-1279: --- Fix Version/s: 2.7 > Improve Scheduler API messages > > > Key: LENS-1279 > URL: https://issues.apache.org/jira/browse/LENS-1279 > Project: Apache Lens > Issue Type: Improvement >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Fix For: 2.7 > > Attachments: Scheduler-API-fixes.patch > > > This patch includes more clearer scheduler APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (LENS-1279) Improve Scheduler API messages
[ https://issues.apache.org/jira/browse/LENS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434270#comment-15434270 ] Rajat Khandelwal commented on LENS-1279: https://reviews.apache.org/r/51206/ > Improve Scheduler API messages > > > Key: LENS-1279 > URL: https://issues.apache.org/jira/browse/LENS-1279 > Project: Apache Lens > Issue Type: Improvement >Reporter: Lavkesh Lahngir >Assignee: Lavkesh Lahngir > Attachments: Scheduler-API-fixes.patch > > > This patch includes more clearer scheduler APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
