Re: [PR] Update pypi documentation 30145 [beam]

2025-05-09 Thread via GitHub
rakeshcusat commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2868457410 Run Python_ML PreCommit 3.10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Update pypi documentation 30145 [beam]

2025-05-09 Thread via GitHub
rakeshcusat commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2868444633 Run Python_ML PreCommit 3.11 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Update google-bigquery.md to direct to Storage Write API as the inges… [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34909: URL: https://github.com/apache/beam/pull/34909#issuecomment-2868205597 Assigning reviewers: R: @rszper for label website. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available comma

Re: [PR] Update google-bigquery.md to direct to Storage Write API as the inges… [beam]

2025-05-09 Thread via GitHub
yirutang commented on PR #34909: URL: https://github.com/apache/beam/pull/34909#issuecomment-2868127883 In theory, they don't need to use it. And there are no other places documented INSERT method. Is this only place alone enough? On Fri, May 9, 2025 at 5:06 PM liferoad ***@***.***>

Re: [PR] Update google-bigquery.md to direct to Storage Write API as the inges… [beam]

2025-05-09 Thread via GitHub
liferoad commented on code in PR #34909: URL: https://github.com/apache/beam/pull/34909#discussion_r2082671293 ## website/www/site/content/en/documentation/io/built-in/google-bigquery.md: ## @@ -667,38 +667,30 @@ You can set `with_auto_sharding=True` to enable dynamic sharding

Re: [PR] Update google-bigquery.md to direct to Storage Write API as the inges… [beam]

2025-05-09 Thread via GitHub
liferoad commented on code in PR #34909: URL: https://github.com/apache/beam/pull/34909#discussion_r2082670433 ## website/www/site/content/en/documentation/io/built-in/google-bigquery.md: ## @@ -667,38 +667,30 @@ You can set `with_auto_sharding=True` to enable dynamic sharding

[PR] Update google-bigquery.md to direct to Storage Write API as the inges… [beam]

2025-05-09 Thread via GitHub
yirutang opened a new pull request, #34909: URL: https://github.com/apache/beam/pull/34909 …tion method. **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate yo

Re: [PR] [BEAM-12164]: Make the spanner change stream connector metadata table ParentTokens column nullable. [beam]

2025-05-09 Thread via GitHub
codecov[bot] commented on PR #34812: URL: https://github.com/apache/beam/pull/34812#issuecomment-2867982241 ## [Codecov](https://app.codecov.io/gh/apache/beam/pull/34812?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term

[PR] Change ReadFromKafkaViaSDF to use Create instead of deprecated Impulse transform. [beam]

2025-05-09 Thread via GitHub
scwhittle opened a new pull request, #34900: URL: https://github.com/apache/beam/pull/34900 Guard the graph change using the updateCompatabilityVersion option. Thank you for your contribution! Follow this checklist to help us incorporate your contributi

[PR] Share FnApiStateAccessor initialization across ParDo runners in Java SDK harness [beam]

2025-05-09 Thread via GitHub
kennknowles opened a new pull request, #34907: URL: https://github.com/apache/beam/pull/34907 This builds on #34883 by adding some abstractions and shared code across the runners, so that once we separate the independent operations we don't create copy pasta.

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on PR #34897: URL: https://github.com/apache/beam/pull/34897#issuecomment-2867770270 Run Python_Dataframes PreCommit 3.11 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on code in PR #34897: URL: https://github.com/apache/beam/pull/34897#discussion_r2082251630 ## sdks/python/apache_beam/ml/anomaly/transforms.py: ## @@ -600,20 +610,43 @@ def expand( # # We select uuid.uuid1() for its inclusion of node information, ma

Re: [PR] Revert "Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv…" [beam]

2025-05-09 Thread via GitHub
Abacn commented on PR #34901: URL: https://github.com/apache/beam/pull/34901#issuecomment-2867521341 PreCommit Python ML failing on HEAD as well, not related to this change, merging for now -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] [Feature Request]: Cap number of keys in Reshuffle.viaRandomKey [beam]

2025-05-09 Thread via GitHub
arunpandianp commented on issue #34756: URL: https://github.com/apache/beam/issues/34756#issuecomment-2867533220 @TanuSharma2511 thanks for the interest, this issue is not ready to work on. Discussed this internally, reducing the number of keys by default could expose latent issues where th

Re: [PR] Revert "Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv…" [beam]

2025-05-09 Thread via GitHub
Abacn merged PR #34901: URL: https://github.com/apache/beam/pull/34901 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on code in PR #34897: URL: https://github.com/apache/beam/pull/34897#discussion_r2082249617 ## sdks/python/apache_beam/ml/anomaly/transforms.py: ## @@ -37,13 +38,16 @@ from apache_beam.ml.anomaly.specifiable import Specifiable from apache_beam.ml.inference.b

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on PR #34897: URL: https://github.com/apache/beam/pull/34897#issuecomment-2866305213 Run Python_PVR_Flink PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Add cloudpickle default to changes.md. [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34904: URL: https://github.com/apache/beam/pull/34904#issuecomment-2867068024 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
jrmccluskey commented on code in PR #34897: URL: https://github.com/apache/beam/pull/34897#discussion_r2082135603 ## sdks/python/apache_beam/ml/anomaly/transforms.py: ## @@ -37,13 +38,16 @@ from apache_beam.ml.anomaly.specifiable import Specifiable from apache_beam.ml.inferenc

Re: [PR] Specify cryptography version. [beam]

2025-05-09 Thread via GitHub
liferoad commented on PR #34888: URL: https://github.com/apache/beam/pull/34888#issuecomment-2867305266 cc @Abacn you probably still need to run the package updates as the post-release task. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Revert "Unpin Dataflow legacy worker container for Nexmark test (#33224)" [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34804: URL: https://github.com/apache/beam/pull/34804#issuecomment-2866835991 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

Re: [PR] Specify cryptography version. [beam]

2025-05-09 Thread via GitHub
liferoad commented on PR #34888: URL: https://github.com/apache/beam/pull/34888#issuecomment-2867309969 ``` 2025-05-09T16:25:55.0570757Z Collecting crcmod<2.0,>=1.7 2025-05-09T16:25:55.0572835Z Downloading crcmod-1.7.tar.gz (89 kB) 2025-05-09T16:25:55.0574962Z Installing build de

Re: [PR] Revert "Unpin Dataflow legacy worker container for Nexmark test (#33224)" [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34804: URL: https://github.com/apache/beam/pull/34804#issuecomment-2866326651 Reminder, please take a look at this pr: @chamikaramj -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Add cloudpickle default to changes.md. [beam]

2025-05-09 Thread via GitHub
damccorm merged PR #34904: URL: https://github.com/apache/beam/pull/34904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Specify cryptography version. [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34888: URL: https://github.com/apache/beam/pull/34888#issuecomment-2867109162 Assigning reviewers: R: @liferoad for label python. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available comm

Re: [PR] Add cloudpickle default to changes.md. [beam]

2025-05-09 Thread via GitHub
claudevdm commented on PR #34904: URL: https://github.com/apache/beam/pull/34904#issuecomment-2867065312 R: @damccorm R: @tvalentyn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[PR] Add cloudpickle default to changes.md. [beam]

2025-05-09 Thread via GitHub
claudevdm opened a new pull request, #34904: URL: https://github.com/apache/beam/pull/34904 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution quic

Re: [PR] Revert "Unpin Dataflow legacy worker container for Nexmark test (#33224)" [beam]

2025-05-09 Thread via GitHub
Abacn merged PR #34804: URL: https://github.com/apache/beam/pull/34804 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on PR #34897: URL: https://github.com/apache/beam/pull/34897#issuecomment-2866316371 Run Python_Dataframes PreCommit 3.12 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Task]: Tracking cloudpickle issues [beam]

2025-05-09 Thread via GitHub
claudevdm commented on issue #34903: URL: https://github.com/apache/beam/issues/34903#issuecomment-2867056208 @tvalentyn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[I] [Task]: Tracking cloudpickle issues [beam]

2025-05-09 Thread via GitHub
claudevdm opened a new issue, #34903: URL: https://github.com/apache/beam/issues/34903 ### What needs to happen? Cloudpickle is set as the default `pickle_library` in 2.65.0, where the previous default was dill. See https://s.apache.org/beam-cloudpickle-next-steps for background.

Re: [PR] DO NOT MERGE: demonstrating impact of OutputBuilder [beam]

2025-05-09 Thread via GitHub
kennknowles commented on code in PR #34902: URL: https://github.com/apache/beam/pull/34902#discussion_r2081961073 ## sdks/java/core/src/main/java/org/apache/beam/sdk/util/WindowedValue.java: ## @@ -59,16 +64,91 @@ @Internal public abstract class WindowedValue { + public int

[PR] DO NOT MERGE: demonstrating impact of OutputBuilder [beam]

2025-05-09 Thread via GitHub
kennknowles opened a new pull request, #34902: URL: https://github.com/apache/beam/pull/34902 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution qu

Re: [I] [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier [beam]

2025-05-09 Thread via GitHub
Abacn commented on issue #32611: URL: https://github.com/apache/beam/issues/32611#issuecomment-2866933370 Yes both domain-scoped project and container registry (in your link) are deprecated so one won't be able to create new one, and likely this is the reason it has been removed from GCP do

Re: [I] [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier [beam]

2025-05-09 Thread via GitHub
TanuSharma2511 commented on issue #32611: URL: https://github.com/apache/beam/issues/32611#issuecomment-2866893591 @Abacn , I checked the naming convention of project id from: https://cloud.google.com/resource-manager/docs/creating-managing-projects#before_you_begin . I missed domained proj

Re: [PR] Revert "Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv…" [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34901: URL: https://github.com/apache/beam/pull/34901#issuecomment-2866815404 Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment `assign set of reviewer

[PR] Revert "Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv…" [beam]

2025-05-09 Thread via GitHub
Abacn opened a new pull request, #34901: URL: https://github.com/apache/beam/pull/34901 Reverts apache/beam#34898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [I] [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier [beam]

2025-05-09 Thread via GitHub
Abacn closed issue #32611: [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier URL: https://github.com/apache/beam/issues/32611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Revert "Unpin Dataflow legacy worker container for Nexmark test (#33224)" [beam]

2025-05-09 Thread via GitHub
Abacn commented on PR #34804: URL: https://github.com/apache/beam/pull/34804#issuecomment-2866831255 R: @damccorm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] Enable certain Beam module compile with newer Java version [beam]

2025-05-09 Thread via GitHub
Abacn merged PR #34858: URL: https://github.com/apache/beam/pull/34858 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.or

Re: [PR] Revert "Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv…" [beam]

2025-05-09 Thread via GitHub
Abacn commented on PR #34901: URL: https://github.com/apache/beam/pull/34901#issuecomment-2866810471 R: @jrmccluskey break testing on domained project -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [I] [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier [beam]

2025-05-09 Thread via GitHub
Abacn commented on issue #32611: URL: https://github.com/apache/beam/issues/32611#issuecomment-2866804142 colon in GCP project id is valid. The pattern was correct one -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv… [beam]

2025-05-09 Thread via GitHub
Abacn commented on PR #34898: URL: https://github.com/apache/beam/pull/34898#issuecomment-2866786161 I doubt this is a breaking change. colon in project id is valid (e.g. domained project google.com:xxx) -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
wollowizard commented on code in PR #34873: URL: https://github.com/apache/beam/pull/34873#discussion_r2081480151 ## sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoder.java: ## @@ -354,8 +392,10 @@ public Schema get() { // an inner co

Re: [PR] Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv… [beam]

2025-05-09 Thread via GitHub
jrmccluskey commented on PR #34898: URL: https://github.com/apache/beam/pull/34898#issuecomment-286144 the ML tests are broken right now, that's unrelated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [I] [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier [beam]

2025-05-09 Thread via GitHub
jrmccluskey closed issue #32611: [Bug]: bigquery_tools.parse_table_reference accepts invalid identifier URL: https://github.com/apache/beam/issues/32611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv… [beam]

2025-05-09 Thread via GitHub
jrmccluskey merged PR #34898: URL: https://github.com/apache/beam/pull/34898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apa

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
scwhittle commented on PR #34873: URL: https://github.com/apache/beam/pull/34873#issuecomment-2866658738 The test failures look unrelated I will retrigger just to be safe though -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
scwhittle commented on PR #34873: URL: https://github.com/apache/beam/pull/34873#issuecomment-2866659189 Run Java PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
scwhittle commented on code in PR #34873: URL: https://github.com/apache/beam/pull/34873#discussion_r2081742961 ## sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoderTest.java: ## @@ -416,6 +419,88 @@ public void testReflectRecordEncoding

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
scwhittle commented on code in PR #34873: URL: https://github.com/apache/beam/pull/34873#discussion_r2081742961 ## sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoderTest.java: ## @@ -416,6 +419,88 @@ public void testReflectRecordEncoding

Re: [PR] Correcting the pipeline object definition [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34899: URL: https://github.com/apache/beam/pull/34899#issuecomment-2865966706 Assigning reviewers: R: @shunping for label python. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available comm

Re: [PR] Add PyTorch DistilBERT Sentiment Analysis Batch/Streaming pipelines for ML Benchmarks [beam]

2025-05-09 Thread via GitHub
damccorm merged PR #34577: URL: https://github.com/apache/beam/pull/34577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache

Re: [PR] Fix PreCommit YAML Xlang Direct job [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34762: URL: https://github.com/apache/beam/pull/34762#issuecomment-2866326770 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @damccorm f

Re: [PR] Fix PreCommit YAML Xlang Direct job [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34762: URL: https://github.com/apache/beam/pull/34762#issuecomment-2866501665 Stopping reviewer notifications for this pull request: requested by reviewer. If you'd like to restart, comment `assign set of reviewers` -- This is an automated message from

Re: [PR] Fix PreCommit YAML Xlang Direct job [beam]

2025-05-09 Thread via GitHub
damccorm commented on PR #34762: URL: https://github.com/apache/beam/pull/34762#issuecomment-2866496485 stop reviewer notifications -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Change ReadFromKafkaViaSDF to use Create instead of deprecated Impulse transform. [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34900: URL: https://github.com/apache/beam/pull/34900#issuecomment-2866490516 Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment `assign set of reviewers` -- This is an automated me

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34897: URL: https://github.com/apache/beam/pull/34897#issuecomment-2866414381 Assigning reviewers: R: @claudevdm for label python. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available com

Re: [PR] Bump github.com/testcontainers/testcontainers-go from 0.36.0 to 0.37.0 in /sdks [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34815: URL: https://github.com/apache/beam/pull/34815#issuecomment-2866414797 R: @lostluck for final approval -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on PR #34897: URL: https://github.com/apache/beam/pull/34897#issuecomment-2866296151 Run Python_Coverage PreCommit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Fix for emojis rendering issue for yaml examples (resolves #34770) [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34795: URL: https://github.com/apache/beam/pull/34795#issuecomment-2866326696 Reminder, please take a look at this pr: @shunping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Concat protos in BQStorageWriteAPI - solve edge cases during mering of nested repeated fields [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34436: URL: https://github.com/apache/beam/pull/34436#issuecomment-2866326943 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @chamikaram

Re: [PR] [Java] Add parsedData to Hl7v2Message and Update HL7v2IO Docs [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34213: URL: https://github.com/apache/beam/pull/34213#issuecomment-2866327109 Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment `assign to next reviewer`: R: @ahmedabu98

Re: [PR] Bump github.com/testcontainers/testcontainers-go from 0.36.0 to 0.37.0 in /sdks [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34815: URL: https://github.com/apache/beam/pull/34815#issuecomment-2866326604 Reminder, please take a look at this pr: @shunping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [AnomalyDetection] Support unkeyed input for the transform. [beam]

2025-05-09 Thread via GitHub
shunping commented on PR #34897: URL: https://github.com/apache/beam/pull/34897#issuecomment-2866321279 ML tests (3.9-3.11) are flaky and not related to this changes. (https://github.com/apache/beam/issues/31285) -- This is an automated message from the Apache Git Service. To respond to t

Re: [I] Add template pipelines [beam-starter-python]

2025-05-09 Thread via GitHub
rakeshcusat closed issue #42: Add template pipelines URL: https://github.com/apache/beam-starter-python/issues/42 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] Fallback Implementation [beam]

2025-05-09 Thread via GitHub
scwhittle commented on code in PR #34148: URL: https://github.com/apache/beam/pull/34148#discussion_r2081402485 ## runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/streaming/harness/FanOutStreamingEngineWorkerHarness.java: ## @@ -27

Re: [PR] Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv… [beam]

2025-05-09 Thread via GitHub
github-actions[bot] commented on PR #34898: URL: https://github.com/apache/beam/pull/34898#issuecomment-2865966856 Assigning reviewers: R: @jrmccluskey for label python. Note: If you would like to opt out of this review, comment `assign to next reviewer`. Available c

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
scwhittle commented on code in PR #34873: URL: https://github.com/apache/beam/pull/34873#discussion_r2081292585 ## sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoder.java: ## @@ -840,4 +843,38 @@ public boolean equals(@Nullable Object ot

Re: [PR] Correcting the pipeline object definition [beam]

2025-05-09 Thread via GitHub
TanuSharma2511 commented on PR #34899: URL: https://github.com/apache/beam/pull/34899#issuecomment-2865796220 @liferoad -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Correcting the pipeline object definition [beam]

2025-05-09 Thread via GitHub
TanuSharma2511 opened a new pull request, #34899: URL: https://github.com/apache/beam/pull/34899 Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue

[PR] Correcting regex for _PROJECT_PATTERN for bigquery table name (resolv… [beam]

2025-05-09 Thread via GitHub
TanuSharma2511 opened a new pull request, #34898: URL: https://github.com/apache/beam/pull/34898 …es #32611) **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporat

Re: [PR] 34749 added cache for avro coder to reduce memory footprint [beam]

2025-05-09 Thread via GitHub
wollowizard commented on code in PR #34873: URL: https://github.com/apache/beam/pull/34873#discussion_r2081239744 ## sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoder.java: ## @@ -840,4 +843,38 @@ public boolean equals(@Nullable Object

Re: [I] [Bug]: The beam task consumes Kafka, and then the runner is Flinkrunner. After the job recovers from the checkpoint, it repeatedly consumes Kafka messages [beam]

2025-05-09 Thread via GitHub
doc-laowu commented on issue #34890: URL: https://github.com/apache/beam/issues/34890#issuecomment-2865623636 I am using the 2.61.0 version of the beam, but I noticed that in the latest 2.64.0 version, the FlinkSourceSplitAnalyzer # start function has been checked to determine if it has not

Re: [PR] Update pypi documentation 30145 [beam]

2025-05-09 Thread via GitHub
rakeshcusat commented on PR #34329: URL: https://github.com/apache/beam/pull/34329#issuecomment-2865377504 Run Python_ML PreCommit 3.9 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific