[jira] [Commented] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2018-10-29 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667643#comment-16667643 ] Yueyang Qiu commented on BEAM-5243: --- Nose's note to user:  Nose has been in maintenance mode for the

[jira] [Commented] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2018-10-31 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670707#comment-16670707 ] Yueyang Qiu commented on BEAM-5243: --- I created a shell script wrapper around tox to retry exit code -11

[jira] [Commented] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2018-10-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669163#comment-16669163 ] Yueyang Qiu commented on BEAM-5243: --- As the Nose's note mentioned, we could choose from Nose2, py.test,

[jira] [Comment Edited] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2018-10-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669143#comment-16669143 ] Yueyang Qiu edited comment on BEAM-5243 at 10/30/18 6:14 PM: - I did

[jira] [Comment Edited] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2018-10-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669143#comment-16669143 ] Yueyang Qiu edited comment on BEAM-5243 at 10/30/18 6:24 PM: - I did

[jira] [Commented] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2018-10-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669143#comment-16669143 ] Yueyang Qiu commented on BEAM-5243: --- I did successfully reproduced the error locally. The error occurred

[jira] [Commented] (BEAM-5911) Python Dataflow IT test fails even though job succeeded

2019-01-03 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733798#comment-16733798 ] Yueyang Qiu commented on BEAM-5911: --- Sure. I am looking into it. > Python Dataflow IT test fails even

[jira] [Commented] (BEAM-5243) beam_Release_Gradle_NightlySnapshot InvocationError py27-cython/bin/python setup.py nosetests

2019-01-03 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733691#comment-16733691 ] Yueyang Qiu commented on BEAM-5243: --- This bug should have been fixed already by the script wrapper. Did

[jira] [Resolved] (BEAM-6048) pylint-27 failed but not caught in Pre/PostCommit

2019-03-25 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu resolved BEAM-6048. --- Resolution: Fixed Fix Version/s: 2.9.0 > pylint-27 failed but not caught in Pre/PostCommit >

[jira] [Resolved] (BEAM-5911) Python Dataflow IT test fails even though job succeeded

2019-03-25 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu resolved BEAM-5911. --- Resolution: Fixed Fix Version/s: 2.10.0 > Python Dataflow IT test fails even though job

[jira] [Updated] (BEAM-5911) Python Dataflow IT test fails even though job succeeded

2019-03-25 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-5911: -- External issue URL: (was: https://github.com/apache/beam/pull/7424) > Python Dataflow IT test fails

[jira] [Updated] (BEAM-5911) Python Dataflow IT test fails even though job succeeded

2019-03-25 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-5911: -- External issue URL: https://github.com/apache/beam/pull/7424 > Python Dataflow IT test fails even

[jira] [Work started] (BEAM-5911) Python Dataflow IT test fails even though job succeeded

2019-03-25 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-5911 started by Yueyang Qiu. - > Python Dataflow IT test fails even though job succeeded >

[jira] [Assigned] (BEAM-7002) [beam_PostCommit_Java_Nexmark_Dataflow] [Nexmark] NullPointerException in Main

2019-04-03 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7002: - Assignee: Andrew Pilloud > [beam_PostCommit_Java_Nexmark_Dataflow] [Nexmark]

[jira] [Created] (BEAM-7002) [beam_PostCommit_Java_Nexmark_Dataflow] [Nexmark] NullPointerException in Main

2019-04-03 Thread Yueyang Qiu (JIRA)
Yueyang Qiu created BEAM-7002: - Summary: [beam_PostCommit_Java_Nexmark_Dataflow] [Nexmark] NullPointerException in Main Key: BEAM-7002 URL: https://issues.apache.org/jira/browse/BEAM-7002 Project: Beam

[jira] [Commented] (BEAM-2728) Extension for sketch-based statistics

2019-04-04 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810050#comment-16810050 ] Yueyang Qiu commented on BEAM-2728: --- Hi Brachi! FYI, the open-sourced HLL implementation this library

[jira] [Commented] (BEAM-6974) [beam_PreCommit_Java_Cron] [:beam-sdks-java-io-cassandra:test][Flake] Test fails in native code

2019-04-04 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810060#comment-16810060 ] Yueyang Qiu commented on BEAM-6974: --- This is a Jenkins job failing HadoopFormatIOCassandraTest:

[jira] [Comment Edited] (BEAM-2728) Extension for sketch-based statistics

2019-04-05 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811041#comment-16811041 ] Yueyang Qiu edited comment on BEAM-2728 at 4/5/19 5:02 PM: --- [~iemejia] The new

[jira] [Created] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-04-05 Thread Yueyang Qiu (JIRA)
Yueyang Qiu created BEAM-7013: - Summary: A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation Key: BEAM-7013 URL: https://issues.apache.org/jira/browse/BEAM-7013

[jira] [Commented] (BEAM-2728) Extension for sketch-based statistics

2019-04-05 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811041#comment-16811041 ] Yueyang Qiu commented on BEAM-2728: --- [~iemejia] The new HLL implementation will be open-sourced and once

[jira] [Updated] (BEAM-7466) Remove the enable_health_checker flag after Python SDK 2.13 becomes unsupported

2019-05-31 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7466: -- Description: [PR8681|https://github.com/apache/beam/pull/8681] introduced a new flag

[jira] [Created] (BEAM-7466) Remove the enable_health_checker flag after Python SDK 2.13 becomes unsupported

2019-05-31 Thread Yueyang Qiu (JIRA)
Yueyang Qiu created BEAM-7466: - Summary: Remove the enable_health_checker flag after Python SDK 2.13 becomes unsupported Key: BEAM-7466 URL: https://issues.apache.org/jira/browse/BEAM-7466 Project: Beam

[jira] [Commented] (BEAM-7424) Retry HTTP 429 errors from GCS when reading/writing data and when staging files

2019-05-31 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853455#comment-16853455 ] Yueyang Qiu commented on BEAM-7424: --- Retry while staging files is out of scope because writing data to

[jira] [Updated] (BEAM-7424) Retry HTTP 429 errors from GCS when reading data

2019-05-31 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7424: -- Summary: Retry HTTP 429 errors from GCS when reading data (was: Retry HTTP 429 errors from GCS when

[jira] [Resolved] (BEAM-7466) Remove the enable_health_checker flag after Python SDK 2.13 becomes unsupported

2019-06-06 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu resolved BEAM-7466. --- Resolution: Fixed Fix Version/s: Not applicable Turns out that this flag is not needed so it

[jira] [Updated] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

2019-06-03 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7424: -- Summary: Retry HTTP 429 errors from GCS w/ exponential backoff when reading data (was: Retry HTTP 429

[jira] [Updated] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

2019-06-03 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7424: -- Description: This has to be done for both Java and Python SDKs. Seems like Java SDK already retries

[jira] [Assigned] (BEAM-7424) Retry HTTP 429 errors from GCS w/ exponential backoff when reading data

2019-06-03 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7424: - Assignee: Heejong Lee (was: Yueyang Qiu) > Retry HTTP 429 errors from GCS w/ exponential

[jira] [Comment Edited] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-06-24 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871825#comment-16871825 ] Yueyang Qiu edited comment on BEAM-7013 at 6/24/19 10:08 PM: - Update: A

[jira] [Commented] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-06-24 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871825#comment-16871825 ] Yueyang Qiu commented on BEAM-7013: --- Update: Google's implementation of HyperLogLog++ has been

[jira] [Comment Edited] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-06-24 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871825#comment-16871825 ] Yueyang Qiu edited comment on BEAM-7013 at 6/24/19 10:07 PM: - Update: Google's

[jira] [Commented] (BEAM-7301) Beam transforms reorder fields

2019-05-14 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839875#comment-16839875 ] Yueyang Qiu commented on BEAM-7301: --- Context: [https://github.com/apache/beam/pull/8425] > Beam

[jira] [Assigned] (BEAM-7333) Select need the ability to rename fields

2019-05-16 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7333: - Assignee: Yueyang Qiu > Select need the ability to rename fields >

[jira] [Assigned] (BEAM-6777) SDK Harness Resilience

2019-05-01 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-6777: - Assignee: Yueyang Qiu (was: Sam Rohde) > SDK Harness Resilience > -- > >

[jira] [Commented] (BEAM-7006) test_split_crazy_sdf broken in python presubmit. 'DataInputOperation' object has no attribute 'index'

2019-04-09 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813622#comment-16813622 ] Yueyang Qiu commented on BEAM-7006: --- This should be fixed by https://github.com/apache/beam/pull/8256 >

[jira] [Commented] (BEAM-6777) SDK Harness Resilience

2019-08-12 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905682#comment-16905682 ] Yueyang Qiu commented on BEAM-6777: --- cc: [~angoenka] > SDK Harness Resilience > --

[jira] [Commented] (BEAM-6777) SDK Harness Resilience

2019-08-12 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905654#comment-16905654 ] Yueyang Qiu commented on BEAM-6777: --- Hi Oded, Dataflow has implemented a solution to this issue but I

[jira] [Created] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

2019-08-26 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8098: - Summary: BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond Key: BEAM-8098 URL: https://issues.apache.org/jira/browse/BEAM-8098

[jira] [Created] (BEAM-8126) HllCount needs to handle null sketches properly

2019-08-31 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8126: - Summary: HllCount needs to handle null sketches properly Key: BEAM-8126 URL: https://issues.apache.org/jira/browse/BEAM-8126 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-09-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-7013. - Resolution: Fixed > A new count distinct transform based on BigQuery compatible HyperLogLog++ >

[jira] [Closed] (BEAM-8126) HllCount needs to handle null sketches properly

2019-09-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-8126. - Fix Version/s: 2.16.0 Resolution: Fixed > HllCount needs to handle null sketches properly >

[jira] [Closed] (BEAM-6777) SDK Harness Resilience

2019-09-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-6777. - Fix Version/s: 2.14.0 Resolution: Fixed > SDK Harness Resilience > -- > >

[jira] [Work started] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

2019-09-12 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8098 started by Yueyang Qiu. - > BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK >

[jira] [Closed] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

2019-09-12 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-8098. - Fix Version/s: 2.17.0 Resolution: Fixed > BigQueryIO needs documentation on how data types in

[jira] [Updated] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Component/s: sdk-java-core > Newly added Java ValidatesRunner tests failed on ApexRunner >

[jira] [Created] (BEAM-8205) Newly added Java ValidatesRunner tests failed on FlinkRunner

2019-09-10 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8205: - Summary: Newly added Java ValidatesRunner tests failed on FlinkRunner Key: BEAM-8205 URL: https://issues.apache.org/jira/browse/BEAM-8205 Project: Beam Issue

[jira] [Updated] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Description: Jenkins link:

[jira] [Commented] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927127#comment-16927127 ] Yueyang Qiu commented on BEAM-8204: --- cc: Reuven Lax > Newly added Java ValidatesRunner tests failed on

[jira] [Created] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8204: - Summary: Newly added Java ValidatesRunner tests failed on ApexRunner Key: BEAM-8204 URL: https://issues.apache.org/jira/browse/BEAM-8204 Project: Beam Issue

[jira] [Comment Edited] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927127#comment-16927127 ] Yueyang Qiu edited comment on BEAM-8204 at 9/11/19 12:00 AM: - cc: [~reuvenlax]

[jira] [Commented] (BEAM-8205) Newly added Java ValidatesRunner tests failed on FlinkRunner

2019-09-10 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927133#comment-16927133 ] Yueyang Qiu commented on BEAM-8205: --- cc: [~reuvenlax] > Newly added Java ValidatesRunner tests failed

[jira] [Commented] (BEAM-8224) The way we inspect arguments in Python does not work for lambda *_: ...

2019-09-16 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930904#comment-16930904 ] Yueyang Qiu commented on BEAM-8224: --- Fix is in the PR [https://github.com/apache/beam/pull/9563] but it

[jira] [Commented] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-09-09 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926021#comment-16926021 ] Yueyang Qiu commented on BEAM-7013: --- This is on track for 2.16 and I will make sure PR #9519 (an

[jira] [Assigned] (BEAM-7554) datetime and decimal should be logical types

2019-09-17 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7554: - Assignee: Yueyang Qiu > datetime and decimal should be logical types >

[jira] [Assigned] (BEAM-7554) datetime and decimal should be logical types

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7554: - Assignee: (was: Yueyang Qiu) > datetime and decimal should be logical types >

[jira] [Assigned] (BEAM-7855) Support logical types when translating the portable row coder representation

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7855: - Assignee: (was: Yueyang Qiu) > Support logical types when translating the portable row coder

[jira] [Updated] (BEAM-7879) HllCount does not work on Dataflow FnAPI workers

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7879: -- Summary: HllCount does not work on Dataflow FnAPI workers (was: HllCount does not work on FnAPI

[jira] [Assigned] (BEAM-7301) Beam transforms reorder fields

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7301: - Assignee: (was: Yueyang Qiu) > Beam transforms reorder fields >

[jira] [Assigned] (BEAM-6906) Mutating accumulators in fused stages is generally unsafe - need to provide a single mutable accumulator

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-6906: - Assignee: (was: Yueyang Qiu) > Mutating accumulators in fused stages is generally unsafe -

[jira] [Assigned] (BEAM-4372) Need an undeprecated Reshuffle transform

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-4372: - Assignee: (was: Yueyang Qiu) > Need an undeprecated Reshuffle transform >

[jira] [Assigned] (BEAM-7333) Select need the ability to rename fields

2019-09-18 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7333: - Assignee: (was: Yueyang Qiu) > Select need the ability to rename fields >

[jira] [Updated] (BEAM-8224) The way we inspect arguments in Python does not work for lambda *_: ...

2019-09-12 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8224: -- Summary: The way we inspect arguments in Python does not work for lambda *_: ... (was: The way we

[jira] [Created] (BEAM-8224) The way we inspect arguments does not work for lambda *_: ...

2019-09-12 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8224: - Summary: The way we inspect arguments does not work for lambda *_: ... Key: BEAM-8224 URL: https://issues.apache.org/jira/browse/BEAM-8224 Project: Beam Issue

[jira] [Commented] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-07-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896536#comment-16896536 ] Yueyang Qiu commented on BEAM-7013: --- [PR #9144|https://github.com/apache/beam/pull/9144] is pending

[jira] [Updated] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-07-30 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7013: -- Fix Version/s: (was: 2.15.0) 2.16.0 > A new count distinct transform based on

[jira] [Created] (BEAM-7879) HllCount does not work on FnAPI workers

2019-08-01 Thread Yueyang Qiu (JIRA)
Yueyang Qiu created BEAM-7879: - Summary: HllCount does not work on FnAPI workers Key: BEAM-7879 URL: https://issues.apache.org/jira/browse/BEAM-7879 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7855) Support logical types when translating the portable row coder representation

2019-08-06 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901479#comment-16901479 ] Yueyang Qiu commented on BEAM-7855: --- I am wondering if we can create a "Component" for schema related

[jira] [Updated] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-07-17 Thread Yueyang Qiu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-7013: -- Fix Version/s: 2.15.0 > A new count distinct transform based on BigQuery compatible HyperLogLog++ >

[jira] [Assigned] (BEAM-7855) Support logical types when translating the portable row coder representation

2019-09-27 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-7855: - Assignee: Yueyang Qiu > Support logical types when translating the portable row coder

[jira] [Created] (BEAM-8593) Define expected behavior of running ZetaSQL query on tables with unsupported field types

2019-11-07 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8593: - Summary: Define expected behavior of running ZetaSQL query on tables with unsupported field types Key: BEAM-8593 URL: https://issues.apache.org/jira/browse/BEAM-8593

[jira] [Created] (BEAM-8630) Prototype of BeamSQL Calc using ZetaSQL Expression Evaluator

2019-11-12 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8630: - Summary: Prototype of BeamSQL Calc using ZetaSQL Expression Evaluator Key: BEAM-8630 URL: https://issues.apache.org/jira/browse/BEAM-8630 Project: Beam Issue

[jira] [Updated] (BEAM-8609) Add HllCount to Java transform catalog

2019-11-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8609: -- Description: Add a Java transform catalog page on Beam website for HllCount. > Add HllCount to Java

[jira] [Created] (BEAM-8609) Add HllCount to Java transform catalog

2019-11-11 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8609: - Summary: Add HllCount to Java transform catalog Key: BEAM-8609 URL: https://issues.apache.org/jira/browse/BEAM-8609 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-8609) Add HllCount to Java transform catalog

2019-11-11 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu closed BEAM-8609. - Fix Version/s: 2.17.0 Resolution: Fixed > Add HllCount to Java transform catalog >

[jira] [Commented] (BEAM-8874) WindowTest timing out on Dataflow python ValidatesRunner tests

2019-12-04 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988215#comment-16988215 ] Yueyang Qiu commented on BEAM-8874: --- The fix has been merged into master and cherry-picked into 2.17

[jira] [Created] (BEAM-8931) [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing

2019-12-09 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8931: - Summary: [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing Key: BEAM-8931 URL: https://issues.apache.org/jira/browse/BEAM-8931 Project: Beam

[jira] [Updated] (BEAM-8931) [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing

2019-12-09 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8931: -- Description: [https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4484/] This test

[jira] [Assigned] (BEAM-8931) [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing

2019-12-09 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-8931: - Assignee: Kenneth Knowles (was: Yueyang Qiu) > [beam_PostCommit_Java_Nexmark_Dataflow] Several

[jira] [Updated] (BEAM-8931) [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing

2019-12-09 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8931: -- Description: [https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4484/] This test

[jira] [Assigned] (BEAM-8931) [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing

2019-12-09 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu reassigned BEAM-8931: - Assignee: Yueyang Qiu > [beam_PostCommit_Java_Nexmark_Dataflow] Several queries are failing >

[jira] [Updated] (BEAM-8204) ParDoTest.testSideInputAnnotationWithMultipleSideInputs failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Summary: ParDoTest.testSideInputAnnotationWithMultipleSideInputs failed on ApexRunner (was: Newly

[jira] [Updated] (BEAM-8205) AvroSchemaTest failed on FlinkRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8205: -- Summary: AvroSchemaTest failed on FlinkRunner (was: Newly added Java ValidatesRunner tests failed on

[jira] [Updated] (BEAM-8204) ParDoTest.testSideInputAnnotationWithMultipleSideInputs & AvroSchemaTest failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Summary: ParDoTest.testSideInputAnnotationWithMultipleSideInputs & AvroSchemaTest failed on ApexRunner

[jira] [Commented] (BEAM-8204) ParDoTest.testSideInputAnnotationWithMultipleSideInputs & AvroSchemaTest failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946064#comment-16946064 ] Yueyang Qiu commented on BEAM-8204: --- Thanks for the reminder. Done! >

[jira] [Updated] (BEAM-8204) Newly added Java ValidatesRunner tests failed on ApexRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8204: -- Labels: (was: currently-failing) > Newly added Java ValidatesRunner tests failed on ApexRunner >

[jira] [Updated] (BEAM-8205) Newly added Java ValidatesRunner tests failed on FlinkRunner

2019-10-07 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-8205: -- Labels: (was: currently-failing) > Newly added Java ValidatesRunner tests failed on FlinkRunner >

[jira] [Created] (BEAM-8936) BigQuery related ITs are failing in PostCommit: quota exceeded

2019-12-09 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-8936: - Summary: BigQuery related ITs are failing in PostCommit: quota exceeded Key: BEAM-8936 URL: https://issues.apache.org/jira/browse/BEAM-8936 Project: Beam Issue

[jira] [Commented] (BEAM-9190) Remove duplicate content in BeamBigQuerySqlDialect after updating Calcite version

2020-02-25 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044959#comment-17044959 ] Yueyang Qiu commented on BEAM-9190: --- cc: [~ibzib] > Remove duplicate content in BeamBigQuerySqlDialect

[jira] [Commented] (BEAM-9413) [beam_PostCommit_Py_ValCont] build failed

2020-02-28 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048090#comment-17048090 ] Yueyang Qiu commented on BEAM-9413: --- cc: [~altay] [~udim]  [~tvalentyn] > [beam_PostCommit_Py_ValCont]

[jira] [Commented] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-28 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048089#comment-17048089 ] Yueyang Qiu commented on BEAM-9414: --- cc: [~altay] [~udim]  [~tvalentyn] > [beam_PostCommit_Python2]

[jira] [Created] (BEAM-9413) [beam_PostCommit_Py_ValCont] build failed

2020-02-28 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9413: - Summary: [beam_PostCommit_Py_ValCont] build failed Key: BEAM-9413 URL: https://issues.apache.org/jira/browse/BEAM-9413 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-28 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9414: - Summary: [beam_PostCommit_Python2] build failed Key: BEAM-9414 URL: https://issues.apache.org/jira/browse/BEAM-9414 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-9389) [Java_ValidatesRunner_PortabilityApi_Dataflow] [ParDoTest.TimerFamilyTests] are failing

2020-02-26 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9389: - Summary: [Java_ValidatesRunner_PortabilityApi_Dataflow] [ParDoTest.TimerFamilyTests] are failing Key: BEAM-9389 URL: https://issues.apache.org/jira/browse/BEAM-9389

[jira] [Created] (BEAM-9390) [PostCommit_Java_PortabilityApi] [BigQuery related ITs] are failing

2020-02-26 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9390: - Summary: [PostCommit_Java_PortabilityApi] [BigQuery related ITs] are failing Key: BEAM-9390 URL: https://issues.apache.org/jira/browse/BEAM-9390 Project: Beam

[jira] [Commented] (BEAM-9389) [Java_ValidatesRunner_PortabilityApi_Dataflow] [ParDoTest.TimerFamilyTests] are failing

2020-02-26 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045845#comment-17045845 ] Yueyang Qiu commented on BEAM-9389: --- cc: [~lcwik] > [Java_ValidatesRunner_PortabilityApi_Dataflow]

[jira] [Commented] (BEAM-9271) beam_PostCommit_Py_ValCont failure due to timeout

2020-02-26 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045858#comment-17045858 ] Yueyang Qiu commented on BEAM-9271: --- The tests are still failing. Is anyone looking into it?  cc:

[jira] [Updated] (BEAM-9390) [PostCommit_Java_PortabilityApi] [BigQuery related ITs] UnsupportedOperationException: BigQuery source must be split before being read

2020-02-26 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9390: -- Summary: [PostCommit_Java_PortabilityApi] [BigQuery related ITs] UnsupportedOperationException:

[jira] [Commented] (BEAM-9390) [PostCommit_Java_PortabilityApi] [BigQuery related ITs] UnsupportedOperationException: BigQuery source must be split before being read

2020-02-26 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045852#comment-17045852 ] Yueyang Qiu commented on BEAM-9390: --- cc: [~lcwik] > [PostCommit_Java_PortabilityApi] [BigQuery related

[jira] [Updated] (BEAM-9390) [PostCommit_Java_PortabilityApi] [BigQuery related ITs] are failing

2020-02-26 Thread Yueyang Qiu (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yueyang Qiu updated BEAM-9390: -- Description: Failed tests:

[jira] [Created] (BEAM-9178) Support ZetaSQL TIMESTAMP functions in BeamSQL

2020-01-23 Thread Yueyang Qiu (Jira)
Yueyang Qiu created BEAM-9178: - Summary: Support ZetaSQL TIMESTAMP functions in BeamSQL Key: BEAM-9178 URL: https://issues.apache.org/jira/browse/BEAM-9178 Project: Beam Issue Type: New Feature

  1   2   >