[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=268839=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-268839 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 27/Jun/19 21:18 Start Date: 27/Jun/19 21:18 Worklog Time Spent: 10m Work Description: stale[bot] commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-506515507 This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 268839) Time Spent: 1.5h (was: 1h 20m) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=268840=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-268840 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 27/Jun/19 21:18 Start Date: 27/Jun/19 21:18 Worklog Time Spent: 10m Work Description: stale[bot] commented on pull request #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 268840) Time Spent: 1h 40m (was: 1.5h) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Time Spent: 1h 40m > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=264090=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-264090 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 20/Jun/19 20:19 Start Date: 20/Jun/19 20:19 Worklog Time Spent: 10m Work Description: stale[bot] commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-504168120 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the d...@beam.apache.org list. Thank you for your contributions. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 264090) Time Spent: 1h 20m (was: 1h 10m) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=230530=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230530 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 21/Apr/19 19:54 Start Date: 21/Apr/19 19:54 Worklog Time Spent: 10m Work Description: kennknowles commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-485278143 Looks like the plan for the current version even results in a join with a condition that is non-equijoin, which we don't support. So there's more to it. Probably the plan for the revised version is the same, but not necessarily. So that would be another benefit. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 230530) Time Spent: 1h 10m (was: 1h) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Labels: triaged > Time Spent: 1h 10m > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=230500=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-230500 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 21/Apr/19 05:53 Start Date: 21/Apr/19 05:53 Worklog Time Spent: 10m Work Description: stale[bot] commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-485226957 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the d...@beam.apache.org list. Thank you for your contributions. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 230500) Time Spent: 1h (was: 50m) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Labels: triaged > Time Spent: 1h > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=201086=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-201086 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 20/Feb/19 05:03 Start Date: 20/Feb/19 05:03 Worklog Time Spent: 10m Work Description: stale[bot] commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-465425496 This pull request is no longer marked as stale. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 201086) Time Spent: 50m (was: 40m) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Labels: triaged > Time Spent: 50m > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=199774=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-199774 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 17/Feb/19 14:56 Start Date: 17/Feb/19 14:56 Worklog Time Spent: 10m Work Description: stale[bot] commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-464466890 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the d...@beam.apache.org list. Thank you for your contributions. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 199774) Time Spent: 40m (was: 0.5h) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Labels: triaged > Time Spent: 40m > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=177001=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-177001 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 19/Dec/18 14:06 Start Date: 19/Dec/18 14:06 Worklog Time Spent: 10m Work Description: kennknowles commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-448607681 Thanks, stalebot. I'll keep this open. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 177001) Time Spent: 0.5h (was: 20m) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=176807=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-176807 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 18/Dec/18 23:58 Start Date: 18/Dec/18 23:58 Worklog Time Spent: 10m Work Description: stale[bot] commented on issue #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757#issuecomment-448417279 This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the d...@beam.apache.org list. Thank you for your contributions. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 176807) Time Spent: 20m (was: 10m) > Can SQL Query 5 be simplified? > -- > > Key: BEAM-5795 > URL: https://issues.apache.org/jira/browse/BEAM-5795 > Project: Beam > Issue Type: Improvement > Components: dsl-sql >Reporter: Kenneth Knowles >Assignee: Kenneth Knowles >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The original CQL query uses the ALL operator over the set of rows that are > within a certain period from the watermark. We instead have a fancy join, due > to windowing. Nonetheless, can this be simplified? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-5795) Can SQL Query 5 be simplified?
[ https://issues.apache.org/jira/browse/BEAM-5795?focusedWorklogId=156422=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-156422 ] ASF GitHub Bot logged work on BEAM-5795: Author: ASF GitHub Bot Created on: 19/Oct/18 18:05 Start Date: 19/Oct/18 18:05 Worklog Time Spent: 10m Work Description: kennknowles opened a new pull request #6757: [BEAM-5795] Simplify SQL Query 5 URL: https://github.com/apache/beam/pull/6757 I set out to see if it could be more like the CQL query, just to remember exactly what was different. And the difference is that we can't do `WHERE rowtime - CURRENT_TIMESTAMP` (aka watermark). So it still needs a join, but I tried using WITH to make it a smidgin more readable. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). It will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it. Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | --- Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/) Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | --- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: