Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-12 Thread Byron Ellis via dev
Congrats Svetak!

On Mon, Feb 12, 2024 at 6:57 PM Shunping Huang via dev 
wrote:

> Congratulations, Svetak!
>
> On Mon, Feb 12, 2024 at 9:50 PM XQ Hu via dev  wrote:
>
>> Great job, Svetak! Thanks for all your contributions to Beam!!!
>>
>> On Mon, Feb 12, 2024 at 4:44 PM Valentyn Tymofieiev via dev <
>> dev@beam.apache.org> wrote:
>>
>>> Congrats, Svetak!
>>>
>>> On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles 
>>> wrote:
>>>
 Hi all,

 Please join me and the rest of the Beam PMC in welcoming a new
 committer: Svetak Sundhar (sve...@apache.org).

 Svetak has been with Beam since 2021. Svetak has contributed code to
 many areas of Beam, including notebooks, Beam Quest, dataframes, and IOs.
 We also want to especially highlight the effort Svetak has put into
 improving Beam's documentation, participating in release validation, and
 evangelizing Beam.

 Considering his contributions to the project over this timeframe, the
 Beam PMC trusts Svetak with the responsibilities of a Beam committer. [1]

 Thank you Svetak! And we are looking to see more of your contributions!

 Kenn, on behalf of the Apache Beam PMC

 [1]

 https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer

>>>


Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-12 Thread Shunping Huang via dev
Congratulations, Svetak!

On Mon, Feb 12, 2024 at 9:50 PM XQ Hu via dev  wrote:

> Great job, Svetak! Thanks for all your contributions to Beam!!!
>
> On Mon, Feb 12, 2024 at 4:44 PM Valentyn Tymofieiev via dev <
> dev@beam.apache.org> wrote:
>
>> Congrats, Svetak!
>>
>> On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles  wrote:
>>
>>> Hi all,
>>>
>>> Please join me and the rest of the Beam PMC in welcoming a new
>>> committer: Svetak Sundhar (sve...@apache.org).
>>>
>>> Svetak has been with Beam since 2021. Svetak has contributed code to
>>> many areas of Beam, including notebooks, Beam Quest, dataframes, and IOs.
>>> We also want to especially highlight the effort Svetak has put into
>>> improving Beam's documentation, participating in release validation, and
>>> evangelizing Beam.
>>>
>>> Considering his contributions to the project over this timeframe, the
>>> Beam PMC trusts Svetak with the responsibilities of a Beam committer. [1]
>>>
>>> Thank you Svetak! And we are looking to see more of your contributions!
>>>
>>> Kenn, on behalf of the Apache Beam PMC
>>>
>>> [1]
>>>
>>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>>>
>>


Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-12 Thread XQ Hu via dev
Great job, Svetak! Thanks for all your contributions to Beam!!!

On Mon, Feb 12, 2024 at 4:44 PM Valentyn Tymofieiev via dev <
dev@beam.apache.org> wrote:

> Congrats, Svetak!
>
> On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles  wrote:
>
>> Hi all,
>>
>> Please join me and the rest of the Beam PMC in welcoming a new committer:
>> Svetak Sundhar (sve...@apache.org).
>>
>> Svetak has been with Beam since 2021. Svetak has contributed code to many
>> areas of Beam, including notebooks, Beam Quest, dataframes, and IOs. We
>> also want to especially highlight the effort Svetak has put into improving
>> Beam's documentation, participating in release validation, and evangelizing
>> Beam.
>>
>> Considering his contributions to the project over this timeframe, the
>> Beam PMC trusts Svetak with the responsibilities of a Beam committer. [1]
>>
>> Thank you Svetak! And we are looking to see more of your contributions!
>>
>> Kenn, on behalf of the Apache Beam PMC
>>
>> [1]
>>
>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>>
>


Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-12 Thread Valentyn Tymofieiev via dev
Congrats, Svetak!

On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles  wrote:

> Hi all,
>
> Please join me and the rest of the Beam PMC in welcoming a new committer:
> Svetak Sundhar (sve...@apache.org).
>
> Svetak has been with Beam since 2021. Svetak has contributed code to many
> areas of Beam, including notebooks, Beam Quest, dataframes, and IOs. We
> also want to especially highlight the effort Svetak has put into improving
> Beam's documentation, participating in release validation, and evangelizing
> Beam.
>
> Considering his contributions to the project over this timeframe, the Beam
> PMC trusts Svetak with the responsibilities of a Beam committer. [1]
>
> Thank you Svetak! And we are looking to see more of your contributions!
>
> Kenn, on behalf of the Apache Beam PMC
>
> [1]
>
> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>


Re: [VOTE] Vendored Dependencies Release

2024-02-12 Thread Yi Hu via dev
Hi,

I am trying to open "
https://repository.apache.org/content/repositories/orgapachebeam-1369/; but
get "[id=orgapachebeam-1369] exists but is not exposed." It seems the
staging repository needs to be closed to have it available to public: [1]

[1]
https://docs.google.com/document/d/1ztEoyGkqq9ie5riQxRtMuBu3vb6BUO91mSMn1PU0pDA/edit?disco=vHX80XE

On Mon, Feb 12, 2024 at 1:44 PM Chamikara Jayalath via dev <
dev@beam.apache.org> wrote:

> +1 (binding)
>
> Thanks,
> Cham
>
> On Fri, Feb 9, 2024 at 5:25 AM Sam Whittle  wrote:
>
>> Please review the release of the following artifacts that we vendor,
>> following the process [5]:
>>
>>  * beam-vendor-grpc-1-60-1:0.2
>>
>> Hi everyone,
>>
>> Please review and vote on the release candidate #1 for the version
>> beam-vendor-grpc-1-60-1:0.2 as follows:
>>
>> [ ] +1, Approve the release
>>
>> [ ] -1, Do not approve the release (please provide specific comments)
>>
>>
>> The complete staging area is available for your review, which includes:
>>
>> * the official Apache source release to be deployed to dist.apache.org
>> [1], which is signed with the key with fingerprint FCFD152811BF1578 [2],
>>
>> * all artifacts to be deployed to the Maven Central Repository [3],
>>
>> * commit hash "2d08b32e674a1046ba7be0ae5f1e4b7b05b73488" [4].
>>
>> The vote will be open for at least 72 hours. It is adopted by majority
>> approval, with at least 3 PMC affirmative votes.
>>
>> Thanks,
>>
>> Sam
>>
>> [1] https://dist.apache.org/repos/dist/dev/beam/vendor/
>>
>> [2] https://dist.apache.org/repos/dist/release/beam/KEYS
>>
>> [3]
>> https://repository.apache.org/content/repositories/orgapachebeam-1369/
>>
>> [4]
>> https://github.com/apache/beam/commit/2d08b32e674a1046ba7be0ae5f1e4b7b05b73488
>>
>> [5] https://s.apache.org/beam-release-vendored-artifacts
>>
>


[ANNOUNCE] New Committer: Svetak Sundhar

2024-02-12 Thread Kenneth Knowles
Hi all,

Please join me and the rest of the Beam PMC in welcoming a new committer:
Svetak Sundhar (sve...@apache.org).

Svetak has been with Beam since 2021. Svetak has contributed code to many
areas of Beam, including notebooks, Beam Quest, dataframes, and IOs. We
also want to especially highlight the effort Svetak has put into improving
Beam's documentation, participating in release validation, and evangelizing
Beam.

Considering his contributions to the project over this timeframe, the Beam
PMC trusts Svetak with the responsibilities of a Beam committer. [1]

Thank you Svetak! And we are looking to see more of your contributions!

Kenn, on behalf of the Apache Beam PMC

[1]
https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer


Re: [VOTE] Vendored Dependencies Release

2024-02-12 Thread Chamikara Jayalath via dev
+1 (binding)

Thanks,
Cham

On Fri, Feb 9, 2024 at 5:25 AM Sam Whittle  wrote:

> Please review the release of the following artifacts that we vendor,
> following the process [5]:
>
>  * beam-vendor-grpc-1-60-1:0.2
>
> Hi everyone,
>
> Please review and vote on the release candidate #1 for the version
> beam-vendor-grpc-1-60-1:0.2 as follows:
>
> [ ] +1, Approve the release
>
> [ ] -1, Do not approve the release (please provide specific comments)
>
>
> The complete staging area is available for your review, which includes:
>
> * the official Apache source release to be deployed to dist.apache.org
> [1], which is signed with the key with fingerprint FCFD152811BF1578 [2],
>
> * all artifacts to be deployed to the Maven Central Repository [3],
>
> * commit hash "2d08b32e674a1046ba7be0ae5f1e4b7b05b73488" [4].
>
> The vote will be open for at least 72 hours. It is adopted by majority
> approval, with at least 3 PMC affirmative votes.
>
> Thanks,
>
> Sam
>
> [1] https://dist.apache.org/repos/dist/dev/beam/vendor/
>
> [2] https://dist.apache.org/repos/dist/release/beam/KEYS
>
> [3] https://repository.apache.org/content/repositories/orgapachebeam-1369/
>
> [4]
> https://github.com/apache/beam/commit/2d08b32e674a1046ba7be0ae5f1e4b7b05b73488
>
> [5] https://s.apache.org/beam-release-vendored-artifacts
>


Beam High Priority Issue Report (37)

2024-02-12 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need 
attention.

See https://beam.apache.org/contribute/issue-priorities for the meaning and 
expectations around issue priorities.

Unassigned P1 Issues:

https://github.com/apache/beam/issues/30266 [Bug]: Cannot read from ssl-enabled 
cassandra cluster
https://github.com/apache/beam/issues/29971 [Bug]: FixedWindows not working for 
large Kafka topic
https://github.com/apache/beam/issues/29926 [Bug]: FileIO: lack of timeouts may 
cause the pipeline to get stuck indefinitely
https://github.com/apache/beam/issues/29902 [Bug]: Messages are not ACK on 
Pubsub starting Beam 2.52.0 on Flink Runner in detached mode
https://github.com/apache/beam/issues/29099 [Bug]: FnAPI Java SDK Harness 
doesn't update user counters in OnTimer callback functions
https://github.com/apache/beam/issues/28760 [Bug]: EFO Kinesis IO reader 
provided by apache beam does not pick the event time for watermarking
https://github.com/apache/beam/issues/28383 [Failing Test]: 
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.testMaxThreadMetric
https://github.com/apache/beam/issues/28326 Bug: 
apache_beam.io.gcp.pubsublite.ReadFromPubSubLite not working
https://github.com/apache/beam/issues/27892 [Bug]: ignoreUnknownValues not 
working when using CreateDisposition.CREATE_IF_NEEDED 
https://github.com/apache/beam/issues/27616 [Bug]: Unable to use 
applyRowMutations() in bigquery IO apache beam java
https://github.com/apache/beam/issues/27486 [Bug]: Read from datastore with 
inequality filters
https://github.com/apache/beam/issues/27314 [Failing Test]: 
bigquery.StorageApiSinkCreateIfNeededIT.testCreateManyTables[1]
https://github.com/apache/beam/issues/27238 [Bug]: Window trigger has lag when 
using Kafka and GroupByKey on Dataflow Runner
https://github.com/apache/beam/issues/26911 [Bug]: UNNEST ARRAY with a nested 
ROW (described below)
https://github.com/apache/beam/issues/26343 [Bug]: 
apache_beam.io.gcp.bigquery_read_it_test.ReadAllBQTests.test_read_queries is 
flaky
https://github.com/apache/beam/issues/26329 [Bug]: BigQuerySourceBase does not 
propagate a Coder to AvroSource
https://github.com/apache/beam/issues/26041 [Bug]: Unable to create 
exactly-once Flink pipeline with stream source and file sink
https://github.com/apache/beam/issues/24776 [Bug]: Race condition in Python SDK 
Harness ProcessBundleProgress
https://github.com/apache/beam/issues/24313 [Flaky]: 
apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithSubprocesses::test_pardo_state_with_custom_key_coder
https://github.com/apache/beam/issues/23709 [Flake]: Spark batch flakes in 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElement and 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundle
https://github.com/apache/beam/issues/23525 [Bug]: Default PubsubMessage coder 
will drop message id and orderingKey
https://github.com/apache/beam/issues/22913 [Bug]: 
beam_PostCommit_Java_ValidatesRunner_Flink is flakes in 
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState
https://github.com/apache/beam/issues/22605 [Bug]: Beam Python failure for 
dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest.test_metrics_it
https://github.com/apache/beam/issues/21706 Flaky timeout in github Python unit 
test action 
StatefulDoFnOnDirectRunnerTest.test_dynamic_timer_clear_then_set_timer
https://github.com/apache/beam/issues/21643 FnRunnerTest with non-trivial 
(order 1000 elements) numpy input flakes in non-cython environment
https://github.com/apache/beam/issues/21476 WriteToBigQuery Dynamic table 
destinations returns wrong tableId
https://github.com/apache/beam/issues/21260 Python DirectRunner does not emit 
data at GC time
https://github.com/apache/beam/issues/21121 
apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT.test_streaming_wordcount_it
 flakey
https://github.com/apache/beam/issues/21104 Flaky: 
apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers
https://github.com/apache/beam/issues/20976 
apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics
 is flaky
https://github.com/apache/beam/issues/20108 Python direct runner doesn't emit 
empty pane when it should
https://github.com/apache/beam/issues/19814 Flink streaming flakes in 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful and 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElementStateful


P1 Issues with no update in the last week:

https://github.com/apache/beam/issues/29515 [Bug]: WriteToFiles in python leave 
few records in temp directory when writing to large number (100+) of files
https://github.com/apache/beam/issues/28219 [Bug]: BigQuery IO Batch load using 
File_load causing the same job id ignoring inserts as the job_id is already 
completed