(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new c4f45d67da6 Updating config from bot
c4f45d67da6 is described below
commit c4f45d67da66257d390c5d4dde96d947f78195dd
Author: github-actions
AuthorDate: Wed Jan 17 06:07:02 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30026.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30026.json
b/scripts/ci/pr-bot/state/pr-state/pr-30026.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30026.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new d41b9303ada Updating config from bot
d41b9303ada is described below
commit d41b9303ada66c7af055bfee92fb51a123c4620c
Author: github-actions
AuthorDate: Wed Jan 17 05:05:54 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30025.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30025.json
b/scripts/ci/pr-bot/state/pr-state/pr-30025.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30025.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.11 deleted (was db7e4bbe2d3)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.11 in repository https://gitbox.apache.org/repos/asf/beam.git was db7e4bbe2d3 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.12 created (now 992a08cd4a7)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/feature/s3/manager-1.15.12 in repository https://gitbox.apache.org/repos/asf/beam.git at 992a08cd4a7 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks No new revisions were added by this update.
(beam) branch nightly-refs/heads/master updated (308c38e243c -> f1c154778f5)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git from 308c38e243c [Typescript] Worker improvements (#29903) add dd5bbb2d77d Add a read timeout and cache BigQueryIOMetadata (#29662) add c11b7c1f7cb Update scaling-streaming-workload.md (#29921) add cf201198df9 sickbay new reshuffle test on runners that do not support it add 96a9830ac27 Merge pull request #29994: sickbay new reshuffle test on runners that do not support it add 534015c0b8e [Typescript] creating dataflow job template fix (#29928) add a41fd2cba03 Remove INFO from playground python logger add 7f5c4b9b72d Merge pull request #29948 Remove INFO from playground python logger add c62c24dda4c [yaml] Revise yaml user label (#29989) add fc626b8b280 typo in docs add f1c154778f5 Merge pull request #30021: typo in docs No new revisions were added by this update. Summary of changes: playground/infrastructure/logger.py| 2 +- runners/portability/java/build.gradle | 3 ++ runners/samza/job-server/build.gradle | 2 ++ runners/spark/job-server/spark_job_server.gradle | 2 ++ runners/spark/spark_runner.gradle | 2 ++ .../sdk/extensions/gcp/util/GceMetadataUtil.java | 1 + .../sdk/io/gcp/bigquery/BigQueryIOMetadata.java| 38 -- .../runners/dataflow/dataflow_job_service.py | 3 +- .../runners/dataflow/dataflow_runner.py| 3 +- .../runners/portability/local_job_service_main.py | 4 +-- sdks/python/apache_beam/runners/render.py | 3 +- sdks/python/apache_beam/yaml/yaml_transform.py | 5 ++- .../content/en/blog/scaling-streaming-workload.md | 2 -- .../content/en/documentation/programming-guide.md | 2 +- 14 files changed, 42 insertions(+), 30 deletions(-)
(beam) 01/01: Merge pull request #30021: typo in docs
This is an automated email from the ASF dual-hosted git repository. kenn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit f1c154778f5e338c02eed0fac9a9f908aca71bd1 Merge: c62c24dda4c fc626b8b280 Author: Kenneth Knowles AuthorDate: Tue Jan 16 19:26:46 2024 -0500 Merge pull request #30021: typo in docs website/www/site/content/en/documentation/programming-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch master updated (c62c24dda4c -> f1c154778f5)
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from c62c24dda4c [yaml] Revise yaml user label (#29989) add fc626b8b280 typo in docs new f1c154778f5 Merge pull request #30021: typo in docs The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: website/www/site/content/en/documentation/programming-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch master updated (7f5c4b9b72d -> c62c24dda4c)
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 7f5c4b9b72d Merge pull request #29948 Remove INFO from playground python logger add c62c24dda4c [yaml] Revise yaml user label (#29989) No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/yaml/yaml_transform.py | 5 - 1 file changed, 4 insertions(+), 1 deletion(-)
(beam) branch master updated (534015c0b8e -> 7f5c4b9b72d)
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 534015c0b8e [Typescript] creating dataflow job template fix (#29928) add a41fd2cba03 Remove INFO from playground python logger new 7f5c4b9b72d Merge pull request #29948 Remove INFO from playground python logger The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: playground/infrastructure/logger.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) 01/01: Merge pull request #29948 Remove INFO from playground python logger
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 7f5c4b9b72d5d450a2243ea293c7107cf9997502 Merge: 534015c0b8e a41fd2cba03 Author: Robert Bradshaw AuthorDate: Tue Jan 16 16:00:37 2024 -0800 Merge pull request #29948 Remove INFO from playground python logger playground/infrastructure/logger.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(beam) branch master updated: [Typescript] creating dataflow job template fix (#29928)
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 534015c0b8e [Typescript] creating dataflow job template fix (#29928)
534015c0b8e is described below
commit 534015c0b8e6b9817ec054c4fe67b3bab423f4a6
Author: Cheskel Twersky
AuthorDate: Wed Jan 17 01:22:36 2024 +0200
[Typescript] creating dataflow job template fix (#29928)
* set template completion status to DONE
* job_servicer is not used in serve
---
sdks/python/apache_beam/runners/dataflow/dataflow_job_service.py | 3 +--
sdks/python/apache_beam/runners/dataflow/dataflow_runner.py | 3 ++-
sdks/python/apache_beam/runners/portability/local_job_service_main.py | 4 ++--
sdks/python/apache_beam/runners/render.py | 3 +--
4 files changed, 6 insertions(+), 7 deletions(-)
diff --git a/sdks/python/apache_beam/runners/dataflow/dataflow_job_service.py
b/sdks/python/apache_beam/runners/dataflow/dataflow_job_service.py
index 2bd8605c992..710c71273e3 100644
--- a/sdks/python/apache_beam/runners/dataflow/dataflow_job_service.py
+++ b/sdks/python/apache_beam/runners/dataflow/dataflow_job_service.py
@@ -74,8 +74,7 @@ def run(argv, beam_job_type=DataflowBeamJob):
options.staging_dir, beam_job_type=beam_job_type)
port = job_servicer.start_grpc_server(options.port)
try:
-local_job_service_main.serve(
-"Listening for beam jobs on port %d." % port, job_servicer)
+local_job_service_main.serve("Listening for beam jobs on port %d." % port)
finally:
job_servicer.stop()
diff --git a/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py
b/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py
index dc315119e48..db6a5235ac9 100644
--- a/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py
+++ b/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py
@@ -731,7 +731,8 @@ class DataflowPipelineResult(PipelineResult):
A PipelineState object.
"""
if not self.has_job:
- return PipelineState.UNKNOWN
+ #
https://github.com/apache/beam/blob/8f71dc41b30a978095ca0e0699009e4f4445a618/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py#L867-L870
+ return PipelineState.DONE
self._update_job()
diff --git
a/sdks/python/apache_beam/runners/portability/local_job_service_main.py
b/sdks/python/apache_beam/runners/portability/local_job_service_main.py
index 6d9d32f5f23..efc198e87db 100644
--- a/sdks/python/apache_beam/runners/portability/local_job_service_main.py
+++ b/sdks/python/apache_beam/runners/portability/local_job_service_main.py
@@ -145,7 +145,7 @@ def run(argv):
with open(options.port_file + '.tmp', 'w') as fout:
fout.write(str(port))
os.rename(options.port_file + '.tmp', options.port_file)
- serve("Listening for beam jobs on port %d." % port, job_servicer)
+ serve("Listening for beam jobs on port %d." % port)
finally:
job_servicer.stop()
finally:
@@ -155,7 +155,7 @@ def run(argv):
os.unlink(options.port_file)
-def serve(msg, job_servicer):
+def serve(msg):
logging_delay = 30
while True:
_LOGGER.info(msg)
diff --git a/sdks/python/apache_beam/runners/render.py
b/sdks/python/apache_beam/runners/render.py
index da153d25a4b..fccfa8aacd6 100644
--- a/sdks/python/apache_beam/runners/render.py
+++ b/sdks/python/apache_beam/runners/render.py
@@ -559,8 +559,7 @@ def run_server(options):
staging_dir, beam_job_type=RenderBeamJob)
port = job_servicer.start_grpc_server(options.job_port)
try:
- local_job_service_main.serve(
- "Listening for beam jobs on port %d." % port, job_servicer)
+ local_job_service_main.serve("Listening for beam jobs on port %d." %
port)
finally:
job_servicer.stop()
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 02a38fea930 Updating config from bot 02a38fea930 is described below commit 02a38fea9302e7d957f0216dfe43dde83b9ac5ae Author: github-actions AuthorDate: Tue Jan 16 21:34:36 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json b/scripts/ci/pr-bot/state/reviewers-for-label-java.json index 11a6778e744..d1450dd481c 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json @@ -9,6 +9,6 @@ "Abacn": 1705004828115, "bvolpato": 1705319351809, "m-trieu": 1705110887148, -"damondouglas": 1704819936038 +"damondouglas": 1705440872425 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 67065f669a0 Updating config from bot 67065f669a0 is described below commit 67065f669a0873b1745e8d4fec1e81c14ebce81c Author: github-actions AuthorDate: Tue Jan 16 21:34:35 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index 4f31c77e479..777fc064856 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -11,6 +11,6 @@ "damccorm": 1705025841679, "jrmccluskey": 1705110887148, "riteshghorse": 1705320833595, -"liferoad": 1704911707512 +"liferoad": 1705440872425 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 04a2d412b6f Updating config from bot 04a2d412b6f is described below commit 04a2d412b6fd6aa95c9a28fa7233937bb3fe139d Author: github-actions AuthorDate: Tue Jan 16 21:34:38 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json b/scripts/ci/pr-bot/state/reviewers-for-label-io.json index f1c3f0c1597..8a7ae321417 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json @@ -8,6 +8,6 @@ "ahmedabu98": 1705319351809, "bvolpato": 1705110896022, "manavgarg": 1690826779210, -"damondouglas": 1704816203587 +"damondouglas": 1705440872425 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new a8f59046461 Updating config from bot
a8f59046461 is described below
commit a8f590464611b03af493bd859d6def2f1ea35ea3
Author: github-actions
AuthorDate: Tue Jan 16 21:34:34 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30024.json | 12
1 file changed, 12 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30024.json
b/scripts/ci/pr-bot/state/pr-state/pr-30024.json
new file mode 100644
index 000..c14a97883ea
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30024.json
@@ -0,0 +1,12 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "liferoad",
+"java": "damondouglas",
+"io": "damondouglas"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated (c11b7c1f7cb -> 96a9830ac27)
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from c11b7c1f7cb Update scaling-streaming-workload.md (#29921) add cf201198df9 sickbay new reshuffle test on runners that do not support it new 96a9830ac27 Merge pull request #29994: sickbay new reshuffle test on runners that do not support it The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: runners/portability/java/build.gradle| 3 +++ runners/samza/job-server/build.gradle| 2 ++ runners/spark/job-server/spark_job_server.gradle | 2 ++ runners/spark/spark_runner.gradle| 2 ++ 4 files changed, 9 insertions(+)
(beam) 01/01: Merge pull request #29994: sickbay new reshuffle test on runners that do not support it
This is an automated email from the ASF dual-hosted git repository. kenn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 96a9830ac2759f1586009d3c72a0fd0732e69398 Merge: c11b7c1f7cb cf201198df9 Author: Kenneth Knowles AuthorDate: Tue Jan 16 16:27:25 2024 -0500 Merge pull request #29994: sickbay new reshuffle test on runners that do not support it runners/portability/java/build.gradle| 3 +++ runners/samza/job-server/build.gradle| 2 ++ runners/spark/job-server/spark_job_server.gradle | 2 ++ runners/spark/spark_runner.gradle| 2 ++ 4 files changed, 9 insertions(+)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new a9dcb9ac602 Updating config from bot a9dcb9ac602 is described below commit a9dcb9ac6023391b91d80cb670530e9e93df2dcf Author: github-actions AuthorDate: Tue Jan 16 21:06:18 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29689.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29689.json b/scripts/ci/pr-bot/state/pr-state/pr-29689.json index 01e4be28079..bf36c624bc1 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29689.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29689.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 7496a84e2a4 Updating config from bot 7496a84e2a4 is described below commit 7496a84e2a43284cfedf51be471a5c6c744526aa Author: github-actions AuthorDate: Tue Jan 16 20:06:00 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index 1e47c417362..8bb9989b0af 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -9,7 +9,7 @@ "jrmccluskey": 1705430101174, "kennknowles": 1705097216618, "lostluck": 1704684872095, -"riteshghorse": 1704419692633, +"riteshghorse": 1705435557774, "robertwb": 1704835147957, "tvalentyn": 1704836068541, "damondouglas": 1704824345789
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new b75343948d1 Updating config from bot
b75343948d1 is described below
commit b75343948d1151e554bcae170c32f5b34496b658
Author: github-actions
AuthorDate: Tue Jan 16 20:05:59 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29994.json | 8 +---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29994.json
b/scripts/ci/pr-bot/state/pr-state/pr-29994.json
index 242a48d7d3b..40494bf71be 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29994.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29994.json
@@ -1,7 +1,9 @@
{
- "commentedAboutFailingChecks": true,
- "reviewersAssignedForLabels": {},
- "nextAction": "Author",
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"no-matching-label": "riteshghorse"
+ },
+ "nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
"committerAssigned": false
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 4ea327aefe3 Updating config from bot
4ea327aefe3 is described below
commit 4ea327aefe3d8ed51b2a92f22fb3dd00abad5e33
Author: github-actions
AuthorDate: Tue Jan 16 18:35:08 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30021.json | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30021.json
b/scripts/ci/pr-bot/state/pr-state/pr-30021.json
index b42821bc7d4..649a1c0c257 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-30021.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30021.json
@@ -1,10 +1,10 @@
{
"commentedAboutFailingChecks": false,
"reviewersAssignedForLabels": {
-"website": "liferoad"
+"website": "kennknowles"
},
"nextAction": "Reviewers",
"stopReviewerNotifications": false,
"remindAfterTestsPass": [],
- "committerAssigned": false
+ "committerAssigned": true
}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new a85cb770e49 Updating config from bot a85cb770e49 is described below commit a85cb770e4980dcc889e1710f61becc335d93fa8 Author: github-actions AuthorDate: Tue Jan 16 18:35:04 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json index 131a15ce918..1e47c417362 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-no-matching-label.json @@ -6,7 +6,7 @@ "chamikaramj": 1704994473508, "damccorm": 1704998100377, "johnjcasey": 1705059270349, -"jrmccluskey": 1704405948377, +"jrmccluskey": 1705430101174, "kennknowles": 1705097216618, "lostluck": 1704684872095, "riteshghorse": 1704419692633,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new c27029910b6 Updating config from bot c27029910b6 is described below commit c27029910b6d30224382d640235c54cc812059e0 Author: github-actions AuthorDate: Tue Jan 16 18:35:10 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-website.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-website.json b/scripts/ci/pr-bot/state/reviewers-for-label-website.json index d008facc695..f5ab07f6f87 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-website.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-website.json @@ -5,6 +5,6 @@ "melap": 1704802432103, "damccorm": 1705407261416, "liferoad": 1705415686820, -"kennknowles": 1704400479165 +"kennknowles": 1705430107048 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new f4ddcfca389 Updating config from bot
f4ddcfca389 is described below
commit f4ddcfca389fd407e0c8d42ae70fd4e1d26ac697
Author: github-actions
AuthorDate: Tue Jan 16 18:35:02 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30022.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30022.json
b/scripts/ci/pr-bot/state/pr-state/pr-30022.json
new file mode 100644
index 000..cd352f44205
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30022.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"no-matching-label": "jrmccluskey"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch asf-site updated: Publishing website 2024/01/16 17:41:18 at commit c11b7c1
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 9a2f060ce0b Publishing website 2024/01/16 17:41:18 at commit c11b7c1 9a2f060ce0b is described below commit 9a2f060ce0bfbbc51a163e8c95b47329e0186079 Author: runner AuthorDate: Tue Jan 16 17:41:18 2024 + Publishing website 2024/01/16 17:41:18 at commit c11b7c1 --- website/generated-content/blog/index.html| 2 +- website/generated-content/blog/index.xml | 1 - website/generated-content/blog/scaling-streaming-workload/index.html | 2 +- website/generated-content/categories/blog/index.xml | 1 - website/generated-content/feed.xml | 1 - website/generated-content/sitemap.xml| 2 +- 6 files changed, 3 insertions(+), 6 deletions(-) diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html index 8c8cc152112..e56328e18db 100644 --- a/website/generated-content/blog/index.html +++ b/website/generated-content/blog/index.html @@ -60,7 +60,7 @@ capability sdk websiteblog & release - 2024/01/04Apache Beam 2.53.0Jack R. McCluskeyWe are happy to present the new 2.53.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.blog2024/01/032024/01/04Apache Beam 2.53.0Jack R. McCluskeyWe are happy to present the new 2.53.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.blog2024/01/032023/11/17Apache Beam 2.52.0Danny McCormickWe are happy to present the new 2.52.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.blog2023/11/112023/10/11Apache Beam 2.51.0Kenneth KnowlesWe are happy to present the new 2.51.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.blog2023/10/0 [...] Namita SharmaDIY GenAI Content Discovery Platform with Apache Beam Your digital assets, such as documents, PDFs, spreadsheets, and presentations, contain a wealth of valuable information, but sometimes itrsquo;s hard to find what yoursquo;re looking for.blog & release diff --git a/website/generated-content/blog/index.xml b/website/generated-content/blog/index.xml index 6de5ecc99c4..e110ceccf32 100644 --- a/website/generated-content/blog/index.xml +++ b/website/generated-content/blog/index.xml @@ -121,7 +121,6 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -h1 id="scaling-a-streaming-workload-on-apache-beam">Scaling a streaming workload on Apache Beam/h1> p>img class="center-block" src="/images/blog/scaling-streaming-workload/0-intro.png" alt="Streaming Processing">/p> diff --git a/website/generated-content/blog/scaling-streaming-workload/index.html b/website/generated-content/blog/scaling-streaming-workload/index.html index dd651c4f301..b577a563450 100644 --- a/website/generated-content/blog/scaling-streaming-workload/index.html +++ b/website/generated-content/blog/scaling-streaming-workload/index.html @@ -36,7 +36,7 @@ https://beam.apache.org/documentation/ml/overview/>
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 6dac02fde11 Updating config from bot 6dac02fde11 is described below commit 6dac02fde119bd484c8736da28fa787e075bad44 Author: github-actions AuthorDate: Tue Jan 16 15:34:43 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-29970.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29970.json b/scripts/ci/pr-bot/state/pr-state/pr-29970.json index b29414341ff..9afff59e2b5 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-29970.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-29970.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 403728021f5 Updating config from bot 403728021f5 is described below commit 403728021f52776d4d1d6cc7ff6745406bd585c3 Author: github-actions AuthorDate: Tue Jan 16 14:34:50 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-website.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-website.json b/scripts/ci/pr-bot/state/reviewers-for-label-website.json index 2f2925c2e0e..d008facc695 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-website.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-website.json @@ -4,7 +4,7 @@ "rszper": 1704558975280, "melap": 1704802432103, "damccorm": 1705407261416, -"liferoad": 1704303264925, +"liferoad": 1705415686820, "kennknowles": 1704400479165 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 151071a8aa6 Updating config from bot
151071a8aa6 is described below
commit 151071a8aa65f815bac8fa0422dc9cdb267df948
Author: github-actions
AuthorDate: Tue Jan 16 14:34:48 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-30021.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-30021.json
b/scripts/ci/pr-bot/state/pr-state/pr-30021.json
new file mode 100644
index 000..b42821bc7d4
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-30021.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"website": "liferoad"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated (dd5bbb2d77d -> c11b7c1f7cb)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from dd5bbb2d77d Add a read timeout and cache BigQueryIOMetadata (#29662) add c11b7c1f7cb Update scaling-streaming-workload.md (#29921) No new revisions were added by this update. Summary of changes: website/www/site/content/en/blog/scaling-streaming-workload.md | 2 -- 1 file changed, 2 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 97faca58c66 Updating config from bot
97faca58c66 is described below
commit 97faca58c668c8c9cc13744da3885d1d16dea29c
Author: github-actions
AuthorDate: Tue Jan 16 12:14:24 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-website.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-website.json
b/scripts/ci/pr-bot/state/reviewers-for-label-website.json
index 6c7400f5d4b..2f2925c2e0e 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-website.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-website.json
@@ -3,7 +3,7 @@
"dateOfLastReviewAssignment": {
"rszper": 1704558975280,
"melap": 1704802432103,
-"damccorm": 1703208510530,
+"damccorm": 1705407261416,
"liferoad": 1704303264925,
"kennknowles": 1704400479165
}
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 0314802d065 Updating config from bot
0314802d065 is described below
commit 0314802d06560e1f400c83d5541126eeb66f53ea
Author: github-actions
AuthorDate: Tue Jan 16 12:14:22 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-29921.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-29921.json
b/scripts/ci/pr-bot/state/pr-state/pr-29921.json
index a00c58524cd..19d93ede2f7 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-29921.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-29921.json
@@ -1,7 +1,7 @@
{
"commentedAboutFailingChecks": false,
"reviewersAssignedForLabels": {
-"website": "kennknowles"
+"website": "damccorm"
},
"nextAction": "Reviewers",
"stopReviewerNotifications": false,
(beam) branch master updated: Add a read timeout and cache BigQueryIOMetadata (#29662)
This is an automated email from the ASF dual-hosted git repository.
scwhittle pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new dd5bbb2d77d Add a read timeout and cache BigQueryIOMetadata (#29662)
dd5bbb2d77d is described below
commit dd5bbb2d77d7f3d057baad3d872677671c730345
Author: Sam Whittle
AuthorDate: Tue Jan 16 09:56:10 2024 +0100
Add a read timeout and cache BigQueryIOMetadata (#29662)
---
.../sdk/extensions/gcp/util/GceMetadataUtil.java | 1 +
.../sdk/io/gcp/bigquery/BigQueryIOMetadata.java| 38 --
2 files changed, 21 insertions(+), 18 deletions(-)
diff --git
a/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GceMetadataUtil.java
b/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GceMetadataUtil.java
index fd49b759fd6..e63aa7dc677 100644
---
a/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GceMetadataUtil.java
+++
b/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GceMetadataUtil.java
@@ -44,6 +44,7 @@ public class GceMetadataUtil {
int timeoutMillis = 5000;
final HttpParams httpParams = new BasicHttpParams();
HttpConnectionParams.setConnectionTimeout(httpParams, timeoutMillis);
+HttpConnectionParams.setSoTimeout(httpParams, timeoutMillis);
String ret = "";
try {
HttpClient client = new DefaultHttpClient(httpParams);
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java
index 9cce436fe35..f8d261d3bf6 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java
@@ -18,19 +18,25 @@
package org.apache.beam.sdk.io.gcp.bigquery;
import java.util.Map;
+import java.util.concurrent.TimeUnit;
import java.util.regex.Matcher;
import java.util.regex.Pattern;
import org.apache.beam.sdk.extensions.gcp.util.GceMetadataUtil;
+import
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.base.Supplier;
+import
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.base.Suppliers;
import org.checkerframework.checker.nullness.qual.Nullable;
/** Metadata class for BigQueryIO. i.e. to use as BQ job labels. */
final class BigQueryIOMetadata {
- private @Nullable String beamJobId;
+ private final @Nullable String beamJobId;
- private @Nullable String beamJobName;
+ private final @Nullable String beamJobName;
- private @Nullable String beamWorkerId;
+ private final @Nullable String beamWorkerId;
+
+ static final Supplier INSTANCE =
+ Suppliers.memoizeWithExpiration(() -> refreshInstance(), 5,
TimeUnit.MINUTES);
private BigQueryIOMetadata(
@Nullable String beamJobId, @Nullable String beamJobName, @Nullable
String beamWorkerId) {
@@ -47,25 +53,21 @@ final class BigQueryIOMetadata {
* being used.
*/
public static BigQueryIOMetadata create() {
-String dataflowJobId = GceMetadataUtil.fetchDataflowJobId();
-String dataflowJobName = GceMetadataUtil.fetchDataflowJobName();
-String dataflowWorkerId = GceMetadataUtil.fetchDataflowWorkerId();
+return INSTANCE.get();
+ }
+ private static BigQueryIOMetadata refreshInstance() {
+String dataflowJobId = GceMetadataUtil.fetchDataflowJobId();
// If a Dataflow job id is returned on GCE metadata. Then it means
// this program is running on a Dataflow GCE VM.
-boolean isDataflowRunner = !dataflowJobId.isEmpty();
-
-String beamJobId = null;
-String beamJobName = null;
-String beamWorkerId = null;
-if (isDataflowRunner) {
- if (BigQueryIOMetadata.isValidCloudLabel(dataflowJobId)) {
-beamJobId = dataflowJobId;
-beamJobName = dataflowJobName;
-beamWorkerId = dataflowWorkerId;
- }
+if (dataflowJobId.isEmpty() ||
!BigQueryIOMetadata.isValidCloudLabel(dataflowJobId)) {
+ return new BigQueryIOMetadata(null, null, null);
}
-return new BigQueryIOMetadata(beamJobId, beamJobName, beamWorkerId);
+
+return new BigQueryIOMetadata(
+dataflowJobId,
+GceMetadataUtil.fetchDataflowJobName(),
+GceMetadataUtil.fetchDataflowWorkerId());
}
public Map addAdditionalJobLabels(Map
jobLabels) {
