[jira] [Created] (BEAM-8593) Define expected behavior of running ZetaSQL query on tables with unsupported field types

2019-11-07 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8593: - Summary: Define expected behavior of running ZetaSQL query on tables with unsupported field types Key: BEAM-8593 URL: https://issues.apache.org/jira/browse/BEAM-8593 Projec

[jira] [Created] (BEAM-8609) Add HllCount to Java transform catalog

2019-11-11 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8609: - Summary: Add HllCount to Java transform catalog Key: BEAM-8609 URL: https://issues.apache.org/jira/browse/BEAM-8609 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-8609) Add HllCount to Java transform catalog

2019-11-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8609: -- Description: Add a Java transform catalog page on Beam website for HllCount. > Add HllCount to Java tran

[jira] [Closed] (BEAM-8609) Add HllCount to Java transform catalog

2019-11-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-8609. - Fix Version/s: 2.17.0 Resolution: Fixed > Add HllCount to Java transform catalog >

[jira] [Created] (BEAM-8630) Prototype of BeamSQL Calc using ZetaSQL Expression Evaluator

2019-11-12 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8630: - Summary: Prototype of BeamSQL Calc using ZetaSQL Expression Evaluator Key: BEAM-8630 URL: https://issues.apache.org/jira/browse/BEAM-8630 Project: Beam Issue Type

[jira] [Assigned] (BEAM-7554) datetime and decimal should be logical types

2019-09-17 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7554: - Assignee: Yueyang Qiu > datetime and decimal should be logical types > --

[jira] [Assigned] (BEAM-7554) datetime and decimal should be logical types

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7554: - Assignee: (was: Yueyang Qiu) > datetime and decimal should be logical types > ---

[jira] [Assigned] (BEAM-7855) Support logical types when translating the portable row coder representation

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7855: - Assignee: (was: Yueyang Qiu) > Support logical types when translating the portable row coder

[jira] [Assigned] (BEAM-7301) Beam transforms reorder fields

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7301: - Assignee: (was: Yueyang Qiu) > Beam transforms reorder fields > -

[jira] [Assigned] (BEAM-6906) Mutating accumulators in fused stages is generally unsafe - need to provide a single mutable accumulator

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-6906: - Assignee: (was: Yueyang Qiu) > Mutating accumulators in fused stages is generally unsafe - ne

[jira] [Assigned] (BEAM-4372) Need an undeprecated Reshuffle transform

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-4372: - Assignee: (was: Yueyang Qiu) > Need an undeprecated Reshuffle transform > ---

[jira] [Assigned] (BEAM-7333) Select need the ability to rename fields

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7333: - Assignee: (was: Yueyang Qiu) > Select need the ability to rename fields > ---

[jira] [Updated] (BEAM-7879) HllCount does not work on Dataflow FnAPI workers

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7879: -- Summary: HllCount does not work on Dataflow FnAPI workers (was: HllCount does not work on FnAPI workers

[jira] [Assigned] (BEAM-7855) Support logical types when translating the portable row coder representation

2019-09-27 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7855: - Assignee: Yueyang Qiu > Support logical types when translating the portable row coder representat

[jira] [Updated] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Labels: (was: currently-failing) > Newly added Java ValidatesRunner tests failed on ApexRunner > -

[jira] [Updated] (BEAM-8205) Newly added Java ValidatesRunner tests failed on FlinkRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8205: -- Labels: (was: currently-failing) > Newly added Java ValidatesRunner tests failed on FlinkRunner >

[jira] [Updated] (BEAM-8204) ParDoTest.testSideInputAnnotationWithMultipleSideInputs failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Summary: ParDoTest.testSideInputAnnotationWithMultipleSideInputs failed on ApexRunner (was: Newly added

[jira] [Updated] (BEAM-8205) AvroSchemaTest failed on FlinkRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8205: -- Summary: AvroSchemaTest failed on FlinkRunner (was: Newly added Java ValidatesRunner tests failed on Fl

[jira] [Updated] (BEAM-8204) ParDoTest.testSideInputAnnotationWithMultipleSideInputs & AvroSchemaTest failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Summary: ParDoTest.testSideInputAnnotationWithMultipleSideInputs & AvroSchemaTest failed on ApexRunner

[jira] [Commented] (BEAM-8204) ParDoTest.testSideInputAnnotationWithMultipleSideInputs & AvroSchemaTest failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946064#comment-16946064 ] Yueyang Qiu commented on BEAM-8204: --- Thanks for the reminder. Done! > ParDoTest.testSid

[jira] [Updated] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-07-17 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7013: -- Fix Version/s: 2.15.0 > A new count distinct transform based on BigQuery compatible HyperLogLog++ > imp

[jira] [Commented] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-07-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896536#comment-16896536 ] Yueyang Qiu commented on BEAM-7013: --- [PR #9144|https://github.com/apache/beam/pull/9144]

[jira] [Updated] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-07-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7013: -- Fix Version/s: (was: 2.15.0) 2.16.0 > A new count distinct transform based on Big

[jira] [Created] (BEAM-7879) HllCount does not work on FnAPI workers

2019-08-01 Thread Yueyang Qiu (JIRA)
Yueyang Qiu created BEAM-7879: - Summary: HllCount does not work on FnAPI workers Key: BEAM-7879 URL: https://issues.apache.org/jira/browse/BEAM-7879 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7855) Support logical types when translating the portable row coder representation

2019-08-06 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901479#comment-16901479 ] Yueyang Qiu commented on BEAM-7855: --- I am wondering if we can create a "Component" for s

[jira] [Assigned] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9709: - Assignee: Yueyang Qiu > timezone off by 8 hours > --- > > Key

[jira] [Assigned] (BEAM-9710) Got current time instead of timestamp value

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9710: - Assignee: Yueyang Qiu > Got current time instead of timestamp value > ---

[jira] [Commented] (BEAM-9710) Got current time instead of timestamp value

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082658#comment-17082658 ] Yueyang Qiu commented on BEAM-9710: --- This seems to be caused by bad code from internal c

[jira] [Commented] (BEAM-9710) Got current time instead of timestamp value

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082664#comment-17082664 ] Yueyang Qiu commented on BEAM-9710: --- I am marking this issue as a blocker of BEAM-9179.

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082670#comment-17082670 ] Yueyang Qiu commented on BEAM-9709: --- This is not supported because it creates an interme

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082672#comment-17082672 ] Yueyang Qiu commented on BEAM-9709: --- The cause of this issue is related to setting defau

[jira] [Comment Edited] (BEAM-9710) Got current time instead of timestamp value

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082658#comment-17082658 ] Yueyang Qiu edited comment on BEAM-9710 at 4/13/20, 9:34 PM: -

[jira] [Comment Edited] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082672#comment-17082672 ] Yueyang Qiu edited comment on BEAM-9709 at 4/13/20, 9:35 PM: -

[jira] [Assigned] (BEAM-9712) setting default timezone doesn't work

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9712: - Assignee: Yueyang Qiu > setting default timezone doesn't work > -

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082704#comment-17082704 ] Yueyang Qiu commented on BEAM-9709: --- OK I dug into this a bit more and found the actual

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082713#comment-17082713 ] Yueyang Qiu commented on BEAM-9709: --- Yes you are right. I deleted the previous wrong com

[jira] [Comment Edited] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082704#comment-17082704 ] Yueyang Qiu edited comment on BEAM-9709 at 4/13/20, 10:33 PM: --

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082714#comment-17082714 ] Yueyang Qiu commented on BEAM-9709: --- It seems weird to me because this ZetaSQL unit test

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082745#comment-17082745 ] Yueyang Qiu commented on BEAM-9709: --- OK. This seems to be a bug in ZetaSQL.   I run {c

[jira] [Comment Edited] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082704#comment-17082704 ] Yueyang Qiu edited comment on BEAM-9709 at 4/13/20, 11:43 PM: --

[jira] [Comment Edited] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082745#comment-17082745 ] Yueyang Qiu edited comment on BEAM-9709 at 4/13/20, 11:46 PM: --

[jira] [Comment Edited] (BEAM-9709) timezone off by 8 hours

2020-04-13 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082745#comment-17082745 ] Yueyang Qiu edited comment on BEAM-9709 at 4/13/20, 11:47 PM: --

[jira] [Commented] (BEAM-9709) timezone off by 8 hours

2020-04-17 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086302#comment-17086302 ] Yueyang Qiu commented on BEAM-9709: --- The next release of ZetaSQL will include a fix for

[jira] [Created] (BEAM-9166) Add unit tests for ZetaSQL time-related functions that depends on system clock

2020-01-21 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9166: - Summary: Add unit tests for ZetaSQL time-related functions that depends on system clock Key: BEAM-9166 URL: https://issues.apache.org/jira/browse/BEAM-9166 Project: Beam

[jira] [Created] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9169: - Summary: Extra character introduced during Calcite unparsing Key: BEAM-9169 URL: https://issues.apache.org/jira/browse/BEAM-9169 Project: Beam Issue Type: Improvem

[jira] [Updated] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9169: -- Description: When I am testing query string {code:java} "SELECT STRING(TIMESTAMP \"2008-12-25 15:30:00\"

[jira] [Updated] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9169: -- Description: When I am testing query string {code:java} "SELECT STRING(TIMESTAMP \"2008-12-25 15:30:00\"

[jira] [Updated] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9169: -- Description: When I am testing query string {code:java} "SELECT STRING(TIMESTAMP \"2008-12-25 15:30:00\"

[jira] [Commented] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020677#comment-17020677 ] Yueyang Qiu commented on BEAM-9169: --- [~kirillkozlov] [~apilloud] do you have any idea wh

[jira] [Updated] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9169: -- Description: When I am testing query string {code:java} "SELECT STRING(TIMESTAMP \"2008-12-25 15:30:00\"

[jira] [Commented] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020684#comment-17020684 ] Yueyang Qiu commented on BEAM-9169: --- Thanks for the quick reply.   This seems to be a

[jira] [Comment Edited] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020684#comment-17020684 ] Yueyang Qiu edited comment on BEAM-9169 at 1/22/20 12:30 AM: -

[jira] [Assigned] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9169: - Assignee: Kirill Kozlov (was: Yueyang Qiu) > Extra character introduced during Calcite unparsing

[jira] [Commented] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-21 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020694#comment-17020694 ] Yueyang Qiu commented on BEAM-9169: --- Sounds good. Thanks for helping! > Extra character

[jira] [Resolved] (BEAM-9536) Return type of window start/end functions is incorrectly inferred to be INT64

2020-03-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu resolved BEAM-9536. --- Fix Version/s: 2.20.0 Resolution: Fixed > Return type of window start/end functions is incorrec

[jira] [Updated] (BEAM-9536) Return type of window start/end functions is incorrectly inferred to be INT64

2020-03-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9536: -- Fix Version/s: (was: 2.20.0) 2.21.0 > Return type of window start/end functions i

[jira] [Assigned] (BEAM-4684) Support @RequiresStableInput on Dataflow runner in Java SDK

2020-03-30 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-4684: - Assignee: (was: Yueyang Qiu) > Support @RequiresStableInput on Dataflow runner in Java SDK >

[jira] [Assigned] (BEAM-3194) Support annotating that a DoFn requires stable / deterministic input for replay/retry

2020-03-30 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-3194: - Assignee: (was: Yueyang Qiu) > Support annotating that a DoFn requires stable / deterministic

[jira] [Resolved] (BEAM-8630) Prototype of BeamSQL Calc using ZetaSQL Expression Evaluator

2020-03-30 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu resolved BEAM-8630. --- Fix Version/s: 2.19.0 Resolution: Fixed > Prototype of BeamSQL Calc using ZetaSQL Expression Ev

[jira] [Assigned] (BEAM-7855) Support logical types when translating the portable row coder representation

2020-03-30 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7855: - Assignee: (was: Yueyang Qiu) > Support logical types when translating the portable row coder

[jira] [Created] (BEAM-9641) Support ZetaSQL DATE functions in BeamSQL

2020-03-30 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9641: - Summary: Support ZetaSQL DATE functions in BeamSQL Key: BEAM-9641 URL: https://issues.apache.org/jira/browse/BEAM-9641 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-9641) Support ZetaSQL DATE functions in BeamSQL

2020-03-31 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9641: -- Labels: zetasql-compliance (was: ) > Support ZetaSQL DATE functions in BeamSQL > --

[jira] [Work started] (BEAM-9641) Support ZetaSQL DATE functions in BeamSQL

2020-03-31 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-9641 started by Yueyang Qiu. - > Support ZetaSQL DATE functions in BeamSQL > -

[jira] [Commented] (BEAM-6777) SDK Harness Resilience

2019-08-12 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905654#comment-16905654 ] Yueyang Qiu commented on BEAM-6777: --- Hi Oded, Dataflow has implemented a solution to thi

[jira] [Commented] (BEAM-6777) SDK Harness Resilience

2019-08-12 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905682#comment-16905682 ] Yueyang Qiu commented on BEAM-6777: --- cc: [~angoenka] > SDK Harness Resilience > ---

[jira] [Created] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

2019-08-26 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8098: - Summary: BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond Key: BEAM-8098 URL: https://issues.apache.org/jira/browse/BEAM-8098 Project

[jira] [Created] (BEAM-8126) HllCount needs to handle null sketches properly

2019-08-31 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8126: - Summary: HllCount needs to handle null sketches properly Key: BEAM-8126 URL: https://issues.apache.org/jira/browse/BEAM-8126 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-09-09 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926021#comment-16926021 ] Yueyang Qiu commented on BEAM-7013: --- This is on track for 2.16 and I will make sure PR #

[jira] [Created] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8204: - Summary: Newly added Java ValidatesRunner tests failed on ApexRunner Key: BEAM-8204 URL: https://issues.apache.org/jira/browse/BEAM-8204 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Description: Jenkins link: [https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/las

[jira] [Commented] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927127#comment-16927127 ] Yueyang Qiu commented on BEAM-8204: --- cc: Reuven Lax > Newly added Java ValidatesRunner

[jira] [Comment Edited] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927127#comment-16927127 ] Yueyang Qiu edited comment on BEAM-8204 at 9/11/19 12:00 AM: -

[jira] [Created] (BEAM-8205) Newly added Java ValidatesRunner tests failed on FlinkRunner

2019-09-10 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8205: - Summary: Newly added Java ValidatesRunner tests failed on FlinkRunner Key: BEAM-8205 URL: https://issues.apache.org/jira/browse/BEAM-8205 Project: Beam Issue Type

[jira] [Updated] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Component/s: sdk-java-core > Newly added Java ValidatesRunner tests failed on ApexRunner > -

[jira] [Commented] (BEAM-8205) Newly added Java ValidatesRunner tests failed on FlinkRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927133#comment-16927133 ] Yueyang Qiu commented on BEAM-8205: --- cc: [~reuvenlax] > Newly added Java ValidatesRunne

[jira] [Commented] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927162#comment-16927162 ] Yueyang Qiu commented on BEAM-8204: --- Sent a PR to exclude the tests on Apex and Flink ru

[jira] [Closed] (BEAM-8126) HllCount needs to handle null sketches properly

2019-09-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-8126. - Fix Version/s: 2.16.0 Resolution: Fixed > HllCount needs to handle null sketches properly > ---

[jira] [Closed] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-09-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-7013. - Resolution: Fixed > A new count distinct transform based on BigQuery compatible HyperLogLog++ > implement

[jira] [Closed] (BEAM-6777) SDK Harness Resilience

2019-09-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-6777. - Fix Version/s: 2.14.0 Resolution: Fixed > SDK Harness Resilience > -- > >

[jira] [Work started] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

2019-09-12 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8098 started by Yueyang Qiu. - > BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK > corre

[jira] [Closed] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

2019-09-12 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-8098. - Fix Version/s: 2.17.0 Resolution: Fixed > BigQueryIO needs documentation on how data types in BigQu

[jira] [Updated] (BEAM-8224) The way we inspect arguments in Python does not work for lambda *_: ...

2019-09-12 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8224: -- Summary: The way we inspect arguments in Python does not work for lambda *_: ... (was: The way we inspe

[jira] [Created] (BEAM-8224) The way we inspect arguments does not work for lambda *_: ...

2019-09-12 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8224: - Summary: The way we inspect arguments does not work for lambda *_: ... Key: BEAM-8224 URL: https://issues.apache.org/jira/browse/BEAM-8224 Project: Beam Issue Typ

[jira] [Commented] (BEAM-8224) The way we inspect arguments in Python does not work for lambda *_: ...

2019-09-16 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930904#comment-16930904 ] Yueyang Qiu commented on BEAM-8224: --- Fix is in the PR [https://github.com/apache/beam/pu

[jira] [Created] (BEAM-9178) Support ZetaSQL TIMESTAMP functions in BeamSQL

2020-01-23 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9178: - Summary: Support ZetaSQL TIMESTAMP functions in BeamSQL Key: BEAM-9178 URL: https://issues.apache.org/jira/browse/BEAM-9178 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-9179) Better story for types in Beam ZetaSQL

2020-01-23 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9179: - Summary: Better story for types in Beam ZetaSQL Key: BEAM-9179 URL: https://issues.apache.org/jira/browse/BEAM-9179 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-9179) Simplify types in Beam ZetaSQL

2020-01-23 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9179: -- Summary: Simplify types in Beam ZetaSQL (was: Better story for types in Beam ZetaSQL) > Simplify types

[jira] [Created] (BEAM-9182) Support NULL parameter in BeamZetaSqlCalcRel

2020-01-23 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9182: - Summary: Support NULL parameter in BeamZetaSqlCalcRel Key: BEAM-9182 URL: https://issues.apache.org/jira/browse/BEAM-9182 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-9182) Support NULL parameter in BeamZetaSqlCalcRel

2020-01-23 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9182: -- Status: Open (was: Triage Needed) > Support NULL parameter in BeamZetaSqlCalcRel >

[jira] [Commented] (BEAM-9182) Support NULL parameter in BeamZetaSqlCalcRel

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023161#comment-17023161 ] Yueyang Qiu commented on BEAM-9182: --- Thanks for the clarification. My plan is to disable

[jira] [Created] (BEAM-9190) Remove duplicate content in BeamBigQuerySqlDialect after updating Calcite version

2020-01-24 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9190: - Summary: Remove duplicate content in BeamBigQuerySqlDialect after updating Calcite version Key: BEAM-9190 URL: https://issues.apache.org/jira/browse/BEAM-9190 Project: Beam

[jira] [Created] (BEAM-9191) CAST does not work in some cases due to bugs in Calcite unparsing

2020-01-24 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9191: - Summary: CAST does not work in some cases due to bugs in Calcite unparsing Key: BEAM-9191 URL: https://issues.apache.org/jira/browse/BEAM-9191 Project: Beam Issue

[jira] [Updated] (BEAM-9191) CAST does not work in some cases due to bugs in Calcite unparsing

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9191: -- Description: For example: "CAST(xxx AS TIMESTAMP)" is unparsed to "CAST(xxx AS TIMESTAMP(0))" The fix

[jira] [Commented] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023331#comment-17023331 ] Yueyang Qiu commented on BEAM-9027: --- Update * CAST issue is tracked in https://issues.a

[jira] [Commented] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023332#comment-17023332 ] Yueyang Qiu commented on BEAM-9027: --- I will keep working on the remaining issue. I will

[jira] [Assigned] (BEAM-9027) [SQL] ZetaSQL unparsing should produce valid result

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9027: - Assignee: Yueyang Qiu (was: Kirill Kozlov) > [SQL] ZetaSQL unparsing should produce valid result

[jira] [Assigned] (BEAM-9180) [ZetaSQL] Support 4-byte unicode in literal string unparsing

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9180: - Assignee: Yueyang Qiu > [ZetaSQL] Support 4-byte unicode in literal string unparsing > --

[jira] [Assigned] (BEAM-9169) Extra character introduced during Calcite unparsing

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-9169: - Assignee: Yueyang Qiu (was: Kirill Kozlov) > Extra character introduced during Calcite unparsing

[jira] [Updated] (BEAM-9180) [ZetaSQL] Support 4-byte unicode in literal string unparsing

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9180: -- Status: Open (was: Triage Needed) > [ZetaSQL] Support 4-byte unicode in literal string unparsing >

[jira] [Updated] (BEAM-9180) [ZetaSQL] Support 4-byte unicode in literal string unparsing

2020-01-24 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9180: -- Priority: Minor (was: Major) > [ZetaSQL] Support 4-byte unicode in literal string unparsing > -

  1   2   >