[jira] [Created] (BEAM-9871) Continuous performance tests for BigQuery read is not displayed on the dashboard

2020-05-01 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9871: --- Summary: Continuous performance tests for BigQuery read is not displayed on the dashboard Key: BEAM-9871 URL: https://issues.apache.org/jira/browse/BEAM-9871 Project: B

[jira] [Commented] (BEAM-7609) SqlTransform#getSchema for "SELECT DISTINCT + JOIN" has invalid field names

2020-03-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066946#comment-17066946 ] Kirill Kozlov commented on BEAM-7609: - Not sure if this issue is still reproducible. N

[jira] [Comment Edited] (BEAM-7610) SELECT COALESCE(...) isn't inferred as non-nullable field

2020-03-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066942#comment-17066942 ] Kirill Kozlov edited comment on BEAM-7610 at 3/25/20, 6:10 PM: -

[jira] [Assigned] (BEAM-7610) SELECT COALESCE(...) isn't inferred as non-nullable field

2020-03-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov reassigned BEAM-7610: --- Assignee: (was: Kirill Kozlov) > SELECT COALESCE(...) isn't inferred as non-nullable fiel

[jira] [Assigned] (BEAM-7609) SqlTransform#getSchema for "SELECT DISTINCT + JOIN" has invalid field names

2020-03-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov reassigned BEAM-7609: --- Assignee: (was: Kirill Kozlov) > SqlTransform#getSchema for "SELECT DISTINCT + JOIN" has

[jira] [Commented] (BEAM-7610) SELECT COALESCE(...) isn't inferred as non-nullable field

2020-03-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17066942#comment-17066942 ] Kirill Kozlov commented on BEAM-7610: - The underlying issue was fixed in Calcite. Upda

[jira] [Closed] (BEAM-9358) BigQueryIO potential write speed regression

2020-02-24 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov closed BEAM-9358. --- Fix Version/s: 2.19.0 Resolution: Resolved > BigQueryIO potential write speed regression >

[jira] [Commented] (BEAM-9358) BigQueryIO potential write speed regression

2020-02-24 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043694#comment-17043694 ] Kirill Kozlov commented on BEAM-9358: - Looks like everything went back to normal on th

[jira] [Updated] (BEAM-9358) BigQueryIO potential write speed regression

2020-02-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-9358: Description: There is a drastic decrease in Megabytes/second write speeds (from ~50 to ~5) [1], as

[jira] [Created] (BEAM-9358) BigQueryIO potential write speed regression

2020-02-21 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9358: --- Summary: BigQueryIO potential write speed regression Key: BEAM-9358 URL: https://issues.apache.org/jira/browse/BEAM-9358 Project: Beam Issue Type: Task

[jira] [Commented] (BEAM-4457) Analyze FieldAccessDescriptors and drop fields that are never accessed

2020-02-04 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030165#comment-17030165 ] Kirill Kozlov commented on BEAM-4457: - Definitely a cool idea! Yes, right now push-dow

[jira] [Resolved] (BEAM-8042) Parsing of aggregate query fails

2020-01-30 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8042. - Fix Version/s: 2.20.0 Resolution: Fixed > Parsing of aggregate query fails > --

[jira] [Commented] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2020-01-24 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023346#comment-17023346 ] Kirill Kozlov commented on BEAM-9027: - Thanks! Yes, feel free to assign to yourself.

[jira] [Comment Edited] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-24 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020681#comment-17020681 ] Kirill Kozlov edited comment on BEAM-9169 at 1/24/20 10:00 PM: -

[jira] [Resolved] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-24 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-9169. - Fix Version/s: 2.20.0 Resolution: Fixed > Extra character introduced during Calcite unparsi

[jira] [Updated] (BEAM-8890) Update google-cloud-java version

2020-01-24 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8890: Description: google-cloud-java under v0.117.0 has a limit on gRPC message size (~11 MB). Which is a

[jira] [Resolved] (BEAM-9072) [SQL] Add support for Datastore source

2020-01-23 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-9072. - Fix Version/s: 2.20.0 Resolution: Fixed > [SQL] Add support for Datastore source >

[jira] [Created] (BEAM-9180) [ZetaSQL] Support 4-byte unicode in literal string unparsing

2020-01-23 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9180: --- Summary: [ZetaSQL] Support 4-byte unicode in literal string unparsing Key: BEAM-9180 URL: https://issues.apache.org/jira/browse/BEAM-9180 Project: Beam Issue

[jira] [Commented] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-22 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021459#comment-17021459 ] Kirill Kozlov commented on BEAM-9169: - Created a PR to use a custom escape method. The

[jira] [Commented] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020690#comment-17020690 ] Kirill Kozlov commented on BEAM-9169: - Yes, we might be able to fix this by specifying

[jira] [Comment Edited] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020681#comment-17020681 ] Kirill Kozlov edited comment on BEAM-9169 at 1/22/20 12:30 AM: -

[jira] [Comment Edited] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020681#comment-17020681 ] Kirill Kozlov edited comment on BEAM-9169 at 1/22/20 12:30 AM: -

[jira] [Comment Edited] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020681#comment-17020681 ] Kirill Kozlov edited comment on BEAM-9169 at 1/22/20 12:28 AM: -

[jira] [Comment Edited] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020681#comment-17020681 ] Kirill Kozlov edited comment on BEAM-9169 at 1/22/20 12:28 AM: -

[jira] [Commented] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020681#comment-17020681 ] Kirill Kozlov commented on BEAM-9169: - [~robinyqiu] This might be the cause:  [https:/

[jira] [Work started] (BEAM-8042) Parsing of aggregate query fails

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8042 started by Kirill Kozlov. --- > Parsing of aggregate query fails > > >

[jira] [Assigned] (BEAM-8042) Parsing of aggregate query fails

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov reassigned BEAM-8042: --- Assignee: Kirill Kozlov > Parsing of aggregate query fails >

[jira] [Updated] (BEAM-9164) [PreCommit_Java] [Flake] org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2020-01-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-9164: Summary: [PreCommit_Java] [Flake] org.apache.beam.runners.flink.translation.wrappers.streaming.io.Un

[jira] [Created] (BEAM-9164) Flaky test: org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest

2020-01-21 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9164: --- Summary: Flaky test: org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapperTest$ParameterizedUnboundedSourceWrapperTest Key: BEAM-9164 URL: https://i

[jira] [Updated] (BEAM-9072) [SQL] Add support for Datastore source

2020-01-14 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-9072: Description: * Create a Datastore table and table provider * Conversion between Datastore and Beam

[jira] [Comment Edited] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2020-01-14 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010124#comment-17010124 ] Kirill Kozlov edited comment on BEAM-9027 at 1/14/20 8:51 PM: --

[jira] [Resolved] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-14 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8844. - Fix Version/s: 2.19.0 Resolution: Fixed > [SQL] Create performance tests for BigQueryTable

[jira] [Commented] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2020-01-13 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17014717#comment-17014717 ] Kirill Kozlov commented on BEAM-8844: - Result can be viewed here:  [https://apache-bea

[jira] [Created] (BEAM-9114) BigQueryIO TableRowParser should support Arrow and Avro data formats

2020-01-13 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9114: --- Summary: BigQueryIO TableRowParser should support Arrow and Avro data formats Key: BEAM-9114 URL: https://issues.apache.org/jira/browse/BEAM-9114 Project: Beam

[jira] [Resolved] (BEAM-8993) [SQL] MongoDb should use predicate push-down

2020-01-13 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8993. - Fix Version/s: 2.19.0 Resolution: Fixed > [SQL] MongoDb should use predicate push-down > --

[jira] [Comment Edited] (BEAM-7865) Java precommit Samza tests opening RocksDB flaky

2020-01-09 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012208#comment-17012208 ] Kirill Kozlov edited comment on BEAM-7865 at 1/9/20 8:30 PM: -

[jira] [Commented] (BEAM-7865) Java precommit Samza tests opening RocksDB flaky

2020-01-09 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012208#comment-17012208 ] Kirill Kozlov commented on BEAM-7865: - This PR [1] seems to be affected. Jenkins tasks

[jira] [Updated] (BEAM-9072) [SQL] Add support for Datastore source

2020-01-08 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-9072: Summary: [SQL] Add support for Datastore source (was: [SQL] Add Datastore table read support) > [S

[jira] [Created] (BEAM-9072) [SQL] Add Datastore table read support

2020-01-08 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9072: --- Summary: [SQL] Add Datastore table read support Key: BEAM-9072 URL: https://issues.apache.org/jira/browse/BEAM-9072 Project: Beam Issue Type: New Feature

[jira] [Resolved] (BEAM-8794) Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule

2020-01-07 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8794. - Fix Version/s: 2.18.0 Resolution: Fixed > Projects should be handled by an IOPushDownRule b

[jira] [Commented] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2020-01-07 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010124#comment-17010124 ] Kirill Kozlov commented on BEAM-9027: - Brief update on this issue. Following unparsin

[jira] [Commented] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

2019-12-26 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003733#comment-17003733 ] Kirill Kozlov commented on BEAM-9000: - I believe that the following PR [1] is somewhat

[jira] [Commented] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2019-12-23 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002570#comment-17002570 ] Kirill Kozlov commented on BEAM-9027: - CC: [~apilloud] > [SQL] ZetaSQL unparsing shou

[jira] [Commented] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2019-12-23 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002569#comment-17002569 ] Kirill Kozlov commented on BEAM-9027: - CC: [~robinyqiu] > [SQL] ZetaSQL unparsing sho

[jira] [Created] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2019-12-23 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-9027: --- Summary: [SQL] ZetaSQL unparsing should produce valid result Key: BEAM-9027 URL: https://issues.apache.org/jira/browse/BEAM-9027 Project: Beam Issue Type: Impr

[jira] [Work started] (BEAM-8933) BigQuery IO should support read/write in Arrow format

2019-12-18 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8933 started by Kirill Kozlov. --- > BigQuery IO should support read/write in Arrow format > -

[jira] [Updated] (BEAM-8993) [SQL] MongoDb should use predicate push-down

2019-12-18 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8993: Description: * Add a MongoDbFilter class, implementing BeamSqlTableFilter. ** Support simple compar

[jira] [Updated] (BEAM-8993) [SQL] MongoDb should use predicate push-down

2019-12-18 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8993: Status: Open (was: Triage Needed) > [SQL] MongoDb should use predicate push-down >

[jira] [Created] (BEAM-8993) [SQL] MongoDb should use predicate push-down

2019-12-18 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8993: --- Summary: [SQL] MongoDb should use predicate push-down Key: BEAM-8993 URL: https://issues.apache.org/jira/browse/BEAM-8993 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-8664) [SQL] MongoDb should use project push-down

2019-12-18 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8664. - Fix Version/s: 2.18.0 Resolution: Fixed > [SQL] MongoDb should use project push-down >

[jira] [Updated] (BEAM-8933) BigQuery IO should support read/write in Arrow format

2019-12-17 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8933: Description: As of right now BigQuery uses Avro format for reading and writing. We should add a con

[jira] [Commented] (BEAM-8933) BigQuery IO should support read/write in Arrow format

2019-12-16 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997475#comment-16997475 ] Kirill Kozlov commented on BEAM-8933: - [~iemejia], I meant to say Arrow [1] in the tit

[jira] [Assigned] (BEAM-8933) BigQuery IO should support read/write in Arrow format

2019-12-10 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov reassigned BEAM-8933: --- Assignee: Kirill Kozlov > BigQuery IO should support read/write in Arrow format > ---

[jira] [Created] (BEAM-8933) BigQuery IO should support read/write in Arrow format

2019-12-09 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8933: --- Summary: BigQuery IO should support read/write in Arrow format Key: BEAM-8933 URL: https://issues.apache.org/jira/browse/BEAM-8933 Project: Beam Issue Type: Im

[jira] [Commented] (BEAM-8896) WITH query AS + SELECT query JOIN other throws invalid type

2019-12-05 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989329#comment-16989329 ] Kirill Kozlov commented on BEAM-8896: - [~amaliujia], yes, join condition is pushed dow

[jira] [Comment Edited] (BEAM-8896) WITH query AS + SELECT query JOIN other throws invalid type

2019-12-05 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989162#comment-16989162 ] Kirill Kozlov edited comment on BEAM-8896 at 12/5/19 10:27 PM: -

[jira] [Comment Edited] (BEAM-8896) WITH query AS + SELECT query JOIN other throws invalid type

2019-12-05 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989162#comment-16989162 ] Kirill Kozlov edited comment on BEAM-8896 at 12/5/19 10:24 PM: -

[jira] [Comment Edited] (BEAM-8896) WITH query AS + SELECT query JOIN other throws invalid type

2019-12-05 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989162#comment-16989162 ] Kirill Kozlov edited comment on BEAM-8896 at 12/5/19 10:23 PM: -

[jira] [Commented] (BEAM-8896) WITH query AS + SELECT query JOIN other throws invalid type

2019-12-05 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989162#comment-16989162 ] Kirill Kozlov commented on BEAM-8896: - After some investigating I have a feeling that

[jira] [Updated] (BEAM-8890) Update google-cloud-java version

2019-12-04 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8890: Summary: Update google-cloud-java version (was: Update google-cloud-java) > Update google-cloud-jav

[jira] [Created] (BEAM-8890) Update google-cloud-java

2019-12-04 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8890: --- Summary: Update google-cloud-java Key: BEAM-8890 URL: https://issues.apache.org/jira/browse/BEAM-8890 Project: Beam Issue Type: Bug Components: io-ja

[jira] [Commented] (BEAM-8564) Add LZO compression and decompression support

2019-12-03 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987266#comment-16987266 ] Kirill Kozlov commented on BEAM-8564: - I do not have much experience working with GO S

[jira] [Work started] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2019-12-03 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8844 started by Kirill Kozlov. --- > [SQL] Create performance tests for BigQueryTable > --

[jira] [Comment Edited] (BEAM-8564) Add LZO compression and decompression support

2019-12-02 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986375#comment-16986375 ] Kirill Kozlov edited comment on BEAM-8564 at 12/2/19 9:14 PM: --

[jira] [Commented] (BEAM-8564) Add LZO compression and decompression support

2019-12-02 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986375#comment-16986375 ] Kirill Kozlov commented on BEAM-8564: - [~AmoghTiwari], thanks for working on this! Ar

[jira] [Updated] (BEAM-8844) [SQL] Create performance tests for BigQueryTable

2019-11-27 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8844: Summary: [SQL] Create performance tests for BigQueryTable (was: [SQL] Create performance tests for

[jira] [Created] (BEAM-8844) [SQL] Create performance tests for BigQuery

2019-11-27 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8844: --- Summary: [SQL] Create performance tests for BigQuery Key: BEAM-8844 URL: https://issues.apache.org/jira/browse/BEAM-8844 Project: Beam Issue Type: New Feature

[jira] [Resolved] (BEAM-8586) [SQL] Add a server for MongoDb Integration Test

2019-11-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8586. - Fix Version/s: 2.18.0 Resolution: Fixed > [SQL] Add a server for MongoDb Integration Test >

[jira] [Assigned] (BEAM-8586) [SQL] Add a server for MongoDb Integration Test

2019-11-25 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov reassigned BEAM-8586: --- Assignee: Kirill Kozlov > [SQL] Add a server for MongoDb Integration Test > -

[jira] [Resolved] (BEAM-8427) [SQL] Add support for MongoDB source

2019-11-21 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8427. - Fix Version/s: 2.18.0 Resolution: Fixed > [SQL] Add support for MongoDB source > --

[jira] [Updated] (BEAM-8794) Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule

2019-11-20 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8794: Status: Open (was: Triage Needed) > Projects should be handled by an IOPushDownRule before applying

[jira] [Created] (BEAM-8794) Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule

2019-11-20 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8794: --- Summary: Projects should be handled by an IOPushDownRule before applying AggregateProjectMergeRule Key: BEAM-8794 URL: https://issues.apache.org/jira/browse/BEAM-8794 P

[jira] [Resolved] (BEAM-8343) Add means for IO APIs to support predicate and/or project push-down when running SQL pipelines

2019-11-20 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8343. - Fix Version/s: 2.18.0 Resolution: Fixed > Add means for IO APIs to support predicate and/or

[jira] [Resolved] (BEAM-8583) [SQL] BigQuery should support predicate push-down in DIRECT_READ mode

2019-11-15 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8583. - Fix Version/s: 2.18.0 Resolution: Fixed > [SQL] BigQuery should support predicate push-down

[jira] [Created] (BEAM-8664) [SQL] MongoDb should use project push-down

2019-11-14 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8664: --- Summary: [SQL] MongoDb should use project push-down Key: BEAM-8664 URL: https://issues.apache.org/jira/browse/BEAM-8664 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-8583) [SQL] BigQuery should support predicate push-down in DIRECT_READ mode

2019-11-13 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8583: Status: Open (was: Triage Needed) > [SQL] BigQuery should support predicate push-down in DIRECT_REA

[jira] [Resolved] (BEAM-8468) Add predicate/filter push-down capability to IO APIs

2019-11-13 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8468. - Fix Version/s: 2.18.0 Resolution: Fixed > Add predicate/filter push-down capability to IO A

[jira] [Resolved] (BEAM-8508) [SQL] Support predicate push-down without project push-down

2019-11-13 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8508. - Fix Version/s: 2.18.0 Resolution: Fixed > [SQL] Support predicate push-down without project

[jira] [Commented] (BEAM-8042) Parsing of aggregate query fails

2019-11-13 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973664#comment-16973664 ] Kirill Kozlov commented on BEAM-8042: - [~kanterov] After looking more into this, I sus

[jira] [Comment Edited] (BEAM-8042) Parsing of aggregate query fails

2019-11-12 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972928#comment-16972928 ] Kirill Kozlov edited comment on BEAM-8042 at 11/13/19 1:03 AM: -

[jira] [Comment Edited] (BEAM-8042) Parsing of aggregate query fails

2019-11-12 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972928#comment-16972928 ] Kirill Kozlov edited comment on BEAM-8042 at 11/13/19 1:03 AM: -

[jira] [Commented] (BEAM-8042) Parsing of aggregate query fails

2019-11-12 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972928#comment-16972928 ] Kirill Kozlov commented on BEAM-8042: - I tried running a similar query, but without CO

[jira] [Updated] (BEAM-8586) [SQL] Add a server for MongoDb Integration Test

2019-11-11 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8586: Summary: [SQL] Add a server for MongoDb Integration Test (was: Add a server for MongoDb Integration

[jira] [Updated] (BEAM-8586) [SQL] Add a server for MongoDb Integration Test

2019-11-11 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8586: Status: Open (was: Triage Needed) > [SQL] Add a server for MongoDb Integration Test > -

[jira] [Updated] (BEAM-8427) [SQL] Add support for MongoDB source

2019-11-11 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8427: Description: * Create a MongoDB table and table provider. * Implement buildIOReader * Support prim

[jira] [Updated] (BEAM-8583) [SQL] BigQuery should support predicate push-down in DIRECT_READ mode

2019-11-07 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8583: Description: * Add BigQuery Dialect with TypeTranslation (since it is not implemented in Calcite 1.

[jira] [Closed] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-07 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov closed BEAM-8574. --- Fix Version/s: 2.18.0 Resolution: Resolved > [SQL] MongoDb PostCommit_SQL fails > -

[jira] [Created] (BEAM-8586) Add a server for MongoDb Integration Test

2019-11-07 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8586: --- Summary: Add a server for MongoDb Integration Test Key: BEAM-8586 URL: https://issues.apache.org/jira/browse/BEAM-8586 Project: Beam Issue Type: Test

[jira] [Created] (BEAM-8583) [SQL] BigQuery should support predicate push-down in DIRECT_READ mode

2019-11-07 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8583: --- Summary: [SQL] BigQuery should support predicate push-down in DIRECT_READ mode Key: BEAM-8583 URL: https://issues.apache.org/jira/browse/BEAM-8583 Project: Beam

[jira] [Updated] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8574: Description: Integration test for Sql MongoDb table read and write fails. Jenkins:  [https://builds

[jira] [Updated] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8574: Description: Integration test for Sql MongoDb table read and write fails. Jenkins:  [https://builds

[jira] [Updated] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8574: Description: Integration test for Sql MongoDb table read and write fails. Jenkins:  [https://builds

[jira] [Updated] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8574: Description: Integration test for Sql MongoDb table read and write fails. Jenkins:  [https://builds

[jira] [Updated] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8574: Description: Integration test for Sql MongoDb table read and write fails. [https://builds.apache.or

[jira] [Created] (BEAM-8574) [SQL] MongoDb PostCommit_SQL fails

2019-11-06 Thread Kirill Kozlov (Jira)
Kirill Kozlov created BEAM-8574: --- Summary: [SQL] MongoDb PostCommit_SQL fails Key: BEAM-8574 URL: https://issues.apache.org/jira/browse/BEAM-8574 Project: Beam Issue Type: Bug Compone

[jira] [Updated] (BEAM-8343) Add means for IO APIs to support predicate and/or project push-down when running SQL pipelines

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8343: Description: The objective is to create a universal way for Beam SQL IO APIs to support predicate/p

[jira] [Updated] (BEAM-8343) Add means for IO APIs to support predicate and/or project push-down when running SQL pipelines

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8343: Description: The objective is to create a universal way for Beam SQL IO APIs to support predicate/p

[jira] [Commented] (BEAM-8514) ZetaSql should use cost-based optimization to take advantage of Join Reordering Rule and Push-Down Rule

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968625#comment-16968625 ] Kirill Kozlov commented on BEAM-8514: - There are currently no ZetaSql tests to validat

[jira] [Updated] (BEAM-8498) [SQL] MongoDb table reader should convert Documents directly to Row (and vice versa)

2019-11-06 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov updated BEAM-8498: Summary: [SQL] MongoDb table reader should convert Documents directly to Row (and vice versa) (was:

[jira] [Resolved] (BEAM-8428) [SQL] BigQuery should support project push-down in DIRECT_READ mode

2019-11-02 Thread Kirill Kozlov (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill Kozlov resolved BEAM-8428. - Fix Version/s: 2.18.0 Resolution: Fixed > [SQL] BigQuery should support project push-down i

  1   2   >