[beam] branch asf-site updated: Publishing website 2021/06/11 06:01:30 at commit f4430e6
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 4c9c273 Publishing website 2021/06/11 06:01:30 at commit f4430e6 4c9c273 is described below commit 4c9c273b76ff908987f78bf5d90a638e49ba0afd Author: jenkins AuthorDate: Fri Jun 11 06:01:31 2021 + Publishing website 2021/06/11 06:01:30 at commit f4430e6 --- .../documentation/basics/index.html| 18 +++- website/generated-content/documentation/index.xml | 24 ++ website/generated-content/sitemap.xml | 2 +- 3 files changed, 14 insertions(+), 30 deletions(-) diff --git a/website/generated-content/documentation/basics/index.html b/website/generated-content/documentation/basics/index.html index ee848cb..a1d78b7 100644 --- a/website/generated-content/documentation/basics/index.html +++ b/website/generated-content/documentation/basics/index.html @@ -31,15 +31,11 @@ processing engine.These concepts may be very similar to your proces Beam’s design is for cross-language operation and reusable libraries of transforms, there are some special features worth highlighting.PipelineA pipeline in Beam is a graph of PTransforms operating on PCollections. A pipeline is constructed by a user in their SDK of choice, and makes its way to -your runner either via the SDK directly or via the Runner API’s (forthcoming) -RPC interfaces.PTransformsIn Beam, a PTransform can be one of the five primitives or it can be a -composite transform encapsulating a subgraph. The primitives are:Read - parallel connectors to external -systemsParDo - per element processingGroupByKey - -aggregating elements per key and windowFlatten - union of PCollectionsWindow - set the windowing strategy -for a PCollectionWhen implementing a runner, these are the operations you need to implement. -Composite transforms may or may not be important to your runner. If you expose -a UI, maintaining some of the composite structure will make the pipeline easier -for a user to understand. But the result of processing is not changed.PCollectionsA PCollection is an unordered bag of elements. Your runner will be responsible +your runner either via the SDK directly or via the Runner API’s +RPC interfaces.PTransformsA PTransform represents a data processing operation, or a step, +in your pipeline. A PTransform can be applied to one or more +PCollection objects as input which performs some processing on the elements of that +PCollection and produces zero or more output PCollection objects.PCollectionsA PCollection is an unordered bag of elements. Your runner will be responsible for storing these elements. There are some major aspects of a PCollection to note:Bounded vs UnboundedA PCollection may be bounded or unbounded.Bounded - it is finite and you know it, as in batch use casesUnbounded - it may be never end, you don’t know, as in streaming use casesThese derive from the intuitions of batch and stream processing, but the two are unified in Beam and bounded and unbounded PCollections can coexist in the @@ -87,7 +83,7 @@ in side inputs)WindowMappingFn - maps one element’s wind bounds on how far in the past the result window will be (used in side inputs)CombineFn - associative and commutative aggregation (used in Combine and state)Coder - encodes user data; some coders have standard formats and are not really UDFsThe various types of user-defined functions will be described further alongside -the primitives that use them.RunnerThe term “runner” is used for a couple of things. It generally refers to the +the PTransforms that use them.RunnerThe term “runner” is used for a couple of things. It generally refers to the software that takes a Beam pipeline and executes it somehow. Often, this is the translation code that you write. It usually also includes some customized operators for your data processing engine, and is sometimes used to refer to @@ -96,7 +92,7 @@ use code font for proper nouns in our APIs, whether or not the identifiers match across all SDKs.The run(Pipeline) method should be asynchronous and results in a PipelineResult which generally will be a job descriptor for your data processing engine, providing methods for checking its status, canceling it, and -waiting for it to terminate.Last updated on 2021/02/05Have you found everything you were looking for?Was it all useful and clear? Is there anything that you would like to change? Let us know!mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACKmailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACKhttp://www.apache.org>The Apache Software Foundation | Privacy Policy | RSS FeedApache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apach
[beam] branch master updated: [BEAM-12459] Ensure that we use the min element timestamp for Watch watermark if no explicit watermark is provided.
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 2eb158d [BEAM-12459] Ensure that we use the min element timestamp for
Watch watermark if no explicit watermark is provided.
new f4430e6 Merge pull request #14968 from lukecwik/beam12459
2eb158d is described below
commit 2eb158d55291372a82a9d4960a8046b1ab4f0a7b
Author: Luke Cwik
AuthorDate: Tue Jun 8 11:20:36 2021 -0700
[BEAM-12459] Ensure that we use the min element timestamp for Watch
watermark if no explicit watermark is provided.
---
.../java/org/apache/beam/sdk/transforms/Watch.java | 22 +--
.../org/apache/beam/sdk/transforms/WatchTest.java | 74 ++
2 files changed, 90 insertions(+), 6 deletions(-)
diff --git
a/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Watch.java
b/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Watch.java
index 0729fff..0f96986 100644
--- a/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Watch.java
+++ b/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Watch.java
@@ -840,7 +840,8 @@ public class Watch {
}
@UnboundedPerElement
- private static class WatchGrowthFn
+ @VisibleForTesting
+ protected static class WatchGrowthFn
extends DoFn>>> {
private final Watch.Growth spec;
private final Coder outputCoder;
@@ -848,7 +849,7 @@ public class Watch {
private final Coder outputKeyCoder;
private final Funnel coderFunnel;
-private WatchGrowthFn(
+WatchGrowthFn(
Growth spec,
Coder outputCoder,
SerializableFunction outputKeyFn,
@@ -899,7 +900,6 @@ public class Watch {
priorPoll.getOutputs().size());
c.output(KV.of(c.element(), priorPoll.getOutputs()));
}
- watermarkEstimator.setWatermark(priorPoll.getWatermark());
}
return stop();
}
@@ -911,7 +911,8 @@ public class Watch {
PollingGrowthState pollingRestriction =
(PollingGrowthState) currentRestriction;
- // Produce a poll result that only contains never seen before results.
+ // Produce a poll result that only contains never seen before results in
timestamp
+ // sorted order.
Growth.PollResult newResults =
computeNeverSeenBeforeResults(pollingRestriction, res);
@@ -941,8 +942,13 @@ public class Watch {
c.output(KV.of(c.element(), newResults.getOutputs()));
}
+ Instant computedWatermark = null;
if (newResults.getWatermark() != null) {
-watermarkEstimator.setWatermark(newResults.getWatermark());
+computedWatermark = newResults.getWatermark();
+ } else if (!newResults.getOutputs().isEmpty()) {
+// computeNeverSeenBeforeResults returns the elements in timestamp
sorted order so
+// we can get the timestamp from the first element.
+computedWatermark = newResults.getOutputs().get(0).getTimestamp();
}
Instant currentTime = Instant.now();
@@ -955,11 +961,15 @@ public class Watch {
return stop();
}
- if (BoundedWindow.TIMESTAMP_MAX_VALUE.equals(newResults.getWatermark()))
{
+ if (BoundedWindow.TIMESTAMP_MAX_VALUE.equals(computedWatermark)) {
LOG.info("{} - will stop polling, reached max timestamp.",
c.element());
return stop();
}
+ if (computedWatermark != null) {
+watermarkEstimator.setWatermark(computedWatermark);
+ }
+
LOG.info(
"{} - will resume polling in {} ms.", c.element(),
spec.getPollInterval().getMillis());
return resume().withResumeDelay(spec.getPollInterval());
diff --git
a/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/WatchTest.java
b/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/WatchTest.java
index fbc0151..81873be 100644
--- a/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/WatchTest.java
+++ b/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/WatchTest.java
@@ -31,6 +31,7 @@ import static org.junit.Assert.assertFalse;
import static org.junit.Assert.assertNull;
import static org.junit.Assert.assertTrue;
import static org.junit.Assert.fail;
+import static org.mockito.Mockito.mock;
import java.io.IOException;
import java.io.Serializable;
@@ -48,6 +49,7 @@ import org.apache.beam.sdk.testing.NeedsRunner;
import org.apache.beam.sdk.testing.PAssert;
import org.apache.beam.sdk.testing.TestPipeline;
import org.apache.beam.sdk.testing.UsesUnboundedSplittableParDo;
+import org.apache.beam.sdk.transforms.DoFn.ProcessContinuation;
import org.apache.beam.sdk.transforms.Watch.Growth;
import org.apache.beam.sdk.transforms.Watch.Growth.PollFn;
import org.apache.beam.sdk.transforms.Watch.Growth.PollResult;
@@ -55,6 +57,10 @@ import org.apache.beam.sdk.transf
[beam] tag nightly-master updated (0b369a5 -> 6282f85)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag nightly-master was modified! *** from 0b369a5 (commit) to 6282f85 (commit) from 0b369a5 [BEAM-10982] Add linux aarch64 wheel build support #14832 add ce0040d Update tensorflow to the latest version add a12bf7a Update grpcio add 81808d1 Add license info for keras-nightly package. add 9cd7479 Merge pull request #14888: [BEAM-12411] Update Tensorflow to version 2.5.0 & grpcio to 1.34.0 add c13a0cc [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord. add 67164a1 Merge pull request #14964: [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord add 525d0f8 [BEAM-12471] Fixes NumberFormatException add 815e2c9 Merge pull request #14982: [BEAM-12471] Fixes NumberFormatException add 9afaed7 [BEAM-12442] Make sure that row renames work properly in nested rows: Make sure that row renames work properly in nested rows add 472bd17 Add a setting to enable dill byref pickling in Beam pickler. add bb0f249 Add a setting to enable dill byref pickling in Beam pickler. add f22e0d8 Merge remote-tracking branch 'origin/byref_setting' into byref_setting add 25c7a89 Merge remote-tracking branch 'origin/byref_setting' into byref_setting add 007f252 Add a setting to enable dill byref pickling in Beam pickler. add 9a2535e Merge remote-tracking branch 'origin/byref_setting' into byref_setting add 2e4bb50 Merge remote-tracking branch 'origin/byref_setting' into byref_setting add ce96473 Add a setting to enable dill byref pickling in Beam pickler. #14985 add 2aed67b Fix Doc for DatasetReference in ReadFromBigQuery (#14818) add abfa7f0 [BEAM-9547] Add initial implementation of sample (#14984) add 883db5c Warn on BigQuery Job failures add e3b6468 Merge pull request #14722 from ryanmcdowell/patch-1 add 94a46c8 Improve basic explanation of Beam PTransforms. add 930efef Merge pull request #14943 from robertwb/transforms-doc add efd32ff Fix spelling error when starting BigQuery jobs add 6282f85 Merge pull request #14931 from ajamato/patch-4 No new revisions were added by this update. Summary of changes: .../beam/sdk/schemas/transforms/RenameFields.java | 187 + .../apache/beam/sdk/schemas/utils/AvroUtils.java | 8 + .../sdk/schemas/transforms/RenameFieldsTest.java | 68 .../beam/sdk/schemas/utils/AvroUtilsTest.java | 7 + .../extensions/sql/impl/schema/BeamTableUtils.java | 9 +- .../beam/sdk/io/gcp/bigquery/BigQueryHelpers.java | 2 +- sdks/python/apache_beam/dataframe/frames.py| 80 - sdks/python/apache_beam/dataframe/frames_test.py | 134 +++ sdks/python/apache_beam/internal/pickler.py| 6 +- sdks/python/apache_beam/io/gcp/bigquery.py | 3 +- sdks/python/apache_beam/io/gcp/bigquery_tools.py | 2 +- sdks/python/container/base_image_requirements.txt | 4 +- .../container/license_scripts/dep_urls_py.yaml | 2 + .../www/site/content/en/documentation/basics.md| 24 +-- 14 files changed, 469 insertions(+), 67 deletions(-)
[beam] branch master updated: Fix spelling error when starting BigQuery jobs
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new efd32ff Fix spelling error when starting BigQuery jobs new 6282f85 Merge pull request #14931 from ajamato/patch-4 efd32ff is described below commit efd32ffd1da9f057663d726b9be173c0f85b34ff Author: Alex Amato AuthorDate: Wed Jun 2 11:45:16 2021 -0700 Fix spelling error when starting BigQuery jobs Fix spelling error when starting BigQuery jobs --- sdks/python/apache_beam/io/gcp/bigquery_tools.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sdks/python/apache_beam/io/gcp/bigquery_tools.py b/sdks/python/apache_beam/io/gcp/bigquery_tools.py index e1d310d..b3b5bbc 100644 --- a/sdks/python/apache_beam/io/gcp/bigquery_tools.py +++ b/sdks/python/apache_beam/io/gcp/bigquery_tools.py @@ -490,7 +490,7 @@ class BigQueryWrapper(object): upload = Upload.FromStream(stream, mime_type=UNKNOWN_MIME_TYPE) response = self.client.jobs.Insert(request, upload=upload) _LOGGER.info( - "Stated BigQuery job: %s\n " + "Started BigQuery job: %s\n " "bq show -j --format=prettyjson --project_id=%s %s", response.jobReference, response.jobReference.projectId,
[beam] branch master updated: Improve basic explanation of Beam PTransforms.
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 94a46c8 Improve basic explanation of Beam PTransforms. new 930efef Merge pull request #14943 from robertwb/transforms-doc 94a46c8 is described below commit 94a46c8d9b815908ee8dc75d33f2ae108763ebb6 Author: Robert Bradshaw AuthorDate: Thu Jun 3 17:25:32 2021 -0700 Improve basic explanation of Beam PTransforms. The existing definition is an (out-of-date) list of the primitives, and comments about implementing them as a runner author, but doesn't explain at all what they are from a user's point of view which is better suited for this page. --- .../www/site/content/en/documentation/basics.md| 24 ++ 1 file changed, 6 insertions(+), 18 deletions(-) diff --git a/website/www/site/content/en/documentation/basics.md b/website/www/site/content/en/documentation/basics.md index bccd2b9..f21ceda 100644 --- a/website/www/site/content/en/documentation/basics.md +++ b/website/www/site/content/en/documentation/basics.md @@ -42,27 +42,15 @@ transforms, there are some special features worth highlighting. A pipeline in Beam is a graph of PTransforms operating on PCollections. A pipeline is constructed by a user in their SDK of choice, and makes its way to -your runner either via the SDK directly or via the Runner API's (forthcoming) +your runner either via the SDK directly or via the Runner API's RPC interfaces. ### PTransforms -In Beam, a PTransform can be one of the five primitives or it can be a -composite transform encapsulating a subgraph. The primitives are: - - * [_Read_](#implementing-the-read-primitive) - parallel connectors to external - systems - * [_ParDo_](#implementing-the-pardo-primitive) - per element processing - * [_GroupByKey_](#implementing-the-groupbykey-and-window-primitive) - - aggregating elements per key and window - * [_Flatten_](#implementing-the-flatten-primitive) - union of PCollections - * [_Window_](#implementing-the-window-primitive) - set the windowing strategy - for a PCollection - -When implementing a runner, these are the operations you need to implement. -Composite transforms may or may not be important to your runner. If you expose -a UI, maintaining some of the composite structure will make the pipeline easier -for a user to understand. But the result of processing is not changed. +A `PTransform` represents a data processing operation, or a step, +in your pipeline. A `PTransform` can be applied to one or more +`PCollection` objects as input which performs some processing on the elements of that +`PCollection` and produces zero or more output `PCollection` objects. ### PCollections @@ -173,7 +161,7 @@ The UDFs of Beam are: * _Coder_ - encodes user data; some coders have standard formats and are not really UDFs The various types of user-defined functions will be described further alongside -the primitives that use them. +the [_PTransforms_](#ptransforms) that use them. ### Runner
[beam] branch master updated: Warn on BigQuery Job failures
This is an automated email from the ASF dual-hosted git repository.
altay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 883db5c Warn on BigQuery Job failures
new e3b6468 Merge pull request #14722 from ryanmcdowell/patch-1
883db5c is described below
commit 883db5cdd466b45b1ae02686de8349a9a64806b9
Author: Ryan McDowell
AuthorDate: Tue May 4 12:30:55 2021 -0500
Warn on BigQuery Job failures
Currently if a BigQuery job were to fail because of a data issue, the
failures are logged at INFO level. This makes it challenging for users to debug
because through the runner (e.g. Dataflow) everything appears fine. Logging at
WARN or ERROR will give users more indication that something is wrong with the
pipeline.
---
.../main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java
index 13d84bb..c7cda81 100644
---
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java
+++
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java
@@ -251,7 +251,7 @@ public class BigQueryHelpers {
case FAILED:
String oldJobId = currentJobId.getJobId();
currentJobId = BigQueryHelpers.getRetryJobId(currentJobId,
lookupJob).jobId;
-LOG.info(
+LOG.warn(
"Load job {} failed, {}: {}. Next job id {}",
oldJobId,
shouldRetry() ? "will retry" : "will not retry",
[beam] branch master updated (2aed67b -> abfa7f0)
This is an automated email from the ASF dual-hosted git repository. bhulette pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 2aed67b Fix Doc for DatasetReference in ReadFromBigQuery (#14818) add abfa7f0 [BEAM-9547] Add initial implementation of sample (#14984) No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/dataframe/frames.py | 80 +- sdks/python/apache_beam/dataframe/frames_test.py | 134 +++ 2 files changed, 213 insertions(+), 1 deletion(-)
[beam] branch master updated (ce96473 -> 2aed67b)
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ce96473 Add a setting to enable dill byref pickling in Beam pickler. #14985 add 2aed67b Fix Doc for DatasetReference in ReadFromBigQuery (#14818) No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/io/gcp/bigquery.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
[beam] branch master updated (9afaed7 -> ce96473)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 9afaed7 [BEAM-12442] Make sure that row renames work properly in nested rows: Make sure that row renames work properly in nested rows add 472bd17 Add a setting to enable dill byref pickling in Beam pickler. add bb0f249 Add a setting to enable dill byref pickling in Beam pickler. add f22e0d8 Merge remote-tracking branch 'origin/byref_setting' into byref_setting add 25c7a89 Merge remote-tracking branch 'origin/byref_setting' into byref_setting add 007f252 Add a setting to enable dill byref pickling in Beam pickler. add 9a2535e Merge remote-tracking branch 'origin/byref_setting' into byref_setting add 2e4bb50 Merge remote-tracking branch 'origin/byref_setting' into byref_setting add ce96473 Add a setting to enable dill byref pickling in Beam pickler. #14985 No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/internal/pickler.py | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-)
[beam] branch master updated (815e2c9 -> 9afaed7)
This is an automated email from the ASF dual-hosted git repository. reuvenlax pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 815e2c9 Merge pull request #14982: [BEAM-12471] Fixes NumberFormatException add 9afaed7 [BEAM-12442] Make sure that row renames work properly in nested rows: Make sure that row renames work properly in nested rows No new revisions were added by this update. Summary of changes: .../beam/sdk/schemas/transforms/RenameFields.java | 187 + .../sdk/schemas/transforms/RenameFieldsTest.java | 68 2 files changed, 220 insertions(+), 35 deletions(-)
svn commit: r48266 - /dev/beam/2.30.0/
Author: altay Date: Thu Jun 10 19:22:46 2021 New Revision: 48266 Log: Remove 2.30.0, now that it is released Removed: dev/beam/2.30.0/
svn commit: r48265 - /release/beam/2.29.0/
Author: altay Date: Thu Jun 10 19:22:15 2021 New Revision: 48265 Log: remove 2.29.0 release Removed: release/beam/2.29.0/
svn commit: r48264 - in /release/beam: ./ 2.30.0/ 2.30.0/python/
Author: altay Date: Thu Jun 10 19:21:48 2021 New Revision: 48264 Log: Add 2.30.0 release Added: release/beam/2.30.0/ release/beam/2.30.0/apache-beam-2.30.0-source-release.zip (with props) release/beam/2.30.0/apache-beam-2.30.0-source-release.zip.asc release/beam/2.30.0/apache-beam-2.30.0-source-release.zip.sha512 release/beam/2.30.0/python/ release/beam/2.30.0/python/apache-beam-2.30.0.zip (with props) release/beam/2.30.0/python/apache-beam-2.30.0.zip.asc release/beam/2.30.0/python/apache-beam-2.30.0.zip.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-macosx_10_9_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-macosx_10_9_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-macosx_10_9_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux1_i686.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux1_i686.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux1_i686.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux1_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux1_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux1_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux2010_i686.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux2010_i686.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux2010_i686.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux2010_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux2010_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-manylinux2010_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-win32.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-win32.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-win32.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-win_amd64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-win_amd64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp36-cp36m-win_amd64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-macosx_10_9_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-macosx_10_9_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-macosx_10_9_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux1_i686.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux1_i686.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux1_i686.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux1_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux1_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux1_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux2010_i686.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux2010_i686.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux2010_i686.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux2010_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux2010_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-manylinux2010_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-win32.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-win32.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-win32.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-win_amd64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-win_amd64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp37-cp37m-win_amd64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-macosx_10_9_x86_64.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-macosx_10_9_x86_64.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-macosx_10_9_x86_64.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-manylinux1_i686.whl (with props) release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-manylinux1_i686.whl.asc release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-manylinux1_i686.whl.sha512 release/beam/2.30.0/python/apache_beam-2.30.0-cp38-cp38-manylinux1_x86_64.whl (with props)
[beam] branch master updated (67164a1 -> 815e2c9)
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 67164a1 Merge pull request #14964: [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord add 525d0f8 [BEAM-12471] Fixes NumberFormatException new 815e2c9 Merge pull request #14982: [BEAM-12471] Fixes NumberFormatException The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../beam/sdk/extensions/sql/impl/schema/BeamTableUtils.java | 9 +++-- 1 file changed, 3 insertions(+), 6 deletions(-)
[beam] 01/01: Merge pull request #14982: [BEAM-12471] Fixes NumberFormatException
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 815e2c94bee24ef0c15c78876d6266618c238ba5 Merge: 67164a1 525d0f8 Author: Ismaël Mejía AuthorDate: Thu Jun 10 15:43:16 2021 +0200 Merge pull request #14982: [BEAM-12471] Fixes NumberFormatException .../beam/sdk/extensions/sql/impl/schema/BeamTableUtils.java | 9 +++-- 1 file changed, 3 insertions(+), 6 deletions(-)
[beam] 01/01: Merge pull request #14964: [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 67164a1d9a3715528e03507c792d1c89c4d5efac Merge: 9cd7479 c13a0cc Author: Ismaël Mejía AuthorDate: Thu Jun 10 15:03:46 2021 +0200 Merge pull request #14964: [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord .../main/java/org/apache/beam/sdk/schemas/utils/AvroUtils.java| 8 .../java/org/apache/beam/sdk/schemas/utils/AvroUtilsTest.java | 7 +++ 2 files changed, 15 insertions(+)
[beam] branch master updated (9cd7479 -> 67164a1)
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 9cd7479 Merge pull request #14888: [BEAM-12411] Update Tensorflow to version 2.5.0 & grpcio to 1.34.0 add c13a0cc [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord. new 67164a1 Merge pull request #14964: [BEAM-12460] Provide a simpler interface to convert Beam Row to GenericRecord The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../main/java/org/apache/beam/sdk/schemas/utils/AvroUtils.java| 8 .../java/org/apache/beam/sdk/schemas/utils/AvroUtilsTest.java | 7 +++ 2 files changed, 15 insertions(+)
[beam] branch master updated (0b369a5 -> 9cd7479)
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0b369a5 [BEAM-10982] Add linux aarch64 wheel build support #14832 add ce0040d Update tensorflow to the latest version add a12bf7a Update grpcio add 81808d1 Add license info for keras-nightly package. add 9cd7479 Merge pull request #14888: [BEAM-12411] Update Tensorflow to version 2.5.0 & grpcio to 1.34.0 No new revisions were added by this update. Summary of changes: sdks/python/container/base_image_requirements.txt | 4 ++-- sdks/python/container/license_scripts/dep_urls_py.yaml | 2 ++ 2 files changed, 4 insertions(+), 2 deletions(-)
