This is an automated email from the ASF dual-hosted git repository.
bhulette pushed a change to branch website-revamp
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 10328bc Fix committer trait links
add 5a6620d Revert 'become a committer' changes, remove 'attributes' page.
add c8cc2a3 [BEAM-11779] Fix dataflow URL printed by Go. (#13997)
add 130e60e [BEAM-11415] Fix misc. bugs affecting Go XLang tests.
add edeaf67 Merge pull request #13999: [BEAM-11415] Fix misc. bugs
affecting Go XLang tests.
add c758a0d [BEAM-9615] Register Schemas on Beam Init (#13940)
add ac5d258 Beam transform that uses DebeziumIO connector to support CDC
add 32a0ff1 Merge pull request #13983 from [BEAM-11818] DebeziumIO
connector to support CDC
add 8f87957 [BEAM-11626] Upgrading Guava to 30.1-jre while keeping
25.1-jre for Hadoop/Cassandra modules (#13804)
add 9c60fd5 Revert "[BEAM-2914] Add portable merging window support to
Python. (#12995)"
add 871e023 Merge pull request #14004 from ajamato/rollback
add 01258f1 [BEANM-11827] checkJavaLinkage task requires a spread
operator for args (#14006)
add 078a146 Fixing dashboard
add dd2e739 Merge pull request #14000 from [BEAM-11791] Fixing dashboard
for FnApiRunner benchmarks
add 4f78ab3 [BEAM-11805] Replace user-agent for spanner (#13990)
add 812149c [BEAM-10925] Support selecting Calc for ZetaSQL testing
add 788025e Merge pull request #14009: [BEAM-10925] Support selecting
Calc for ZetaSQL testing
add dbb19b0 [BEAM-11779] Use shuffle_mode=appliance when using dataflow
runner v2
add 292d788 Add comment to remove the patch
add c1530a6 minor fix to run_integration_test.sh in python sdk
add fc511f6 Merge pull request #13986: [BEAM-11779] Use
shuffle_mode=appliance when using dataflow runner v2
add 364a4a0 [BEAM-11211] Update pandas and pyarrow in python container
(#13987)
add b8dd9cb Update go version to 1.12.7 (#13996)
add 4178d26 [BEAM-11125] bump checkerframework to 3.10.0
add 88918f1 Merge pull request #13978: [BEAM-11125] bump checkerframework
to 3.10.0
add b6a59b3 Merge #13558. [BEAM-11494][BEAM-11821] FileIO stops
overwriting files on retries
add 3ede658 [BEAM-11801] Don't set useCachedDataPool if an emulator host
is set
add c76e835 Merge pull request #13964: [BEAM-11801] Don't set
useCachedDataPool if an emulator host is set
add cfe60aa [BEAM-11747] Better filters for BeamCalc
add 5828613 Merge pull request #13898: [BEAM-11747] Make BeamCalcRel safe
for ZetaSQL
add 6ab69f9 Fix IllegalArgumentException in Interval
add 8d5b7c7 Merge pull request #13993 from baeminbo/patch-1
add 5d3ffe7 [BEAM-11747] Disable BeamJavaUdfCalcRule by default.
add 3dfbaaf spotless
add 0c08687 Merge pull request #14010 from ibzib/disable-calcrule
add e9bdda9 [BEAM-11834] Enable arrays literals to have null values.
add 3a0a3b4 Merge pull request #14017 from ibzib/BEAM-11834
add 4cffb7d [BEAM-10708] Support SqlTransform in container (#13944)
add ef74412 Enable SideInput metrics for DF worker. These have been
launched on Dataflow
add ebafa0e Merge pull request #14018 from pabloem/enablesim
add fa3dddb [BEAM-11760] Cleanup interactive cache just once.
add 9297cf1 [BEAM-11760] Cleanup interactive cache just once.
add 3bb529c Merge remote-tracking branch 'origin/double_cache' into
double_cache
add f09f2af Merge pull request #13909 [BEAM-11760] Cleanup interactive
cache just once.
add 66a8a4c Adding performance improvements to ApproximateQuantiles.
(#13175)
add 425f5bb [BEAM-9547] Fill in some trivial compliance gaps (#13932)
add 276964f [BEAM-11589] Migrated vendor/bytebuddy build.gradle file to
Kotlin script (#14002)
add edae900 Merge pull request #14019 from [BEAM-11791] Fixing
FnApiRunner Microbenchmarks to export to influxDB
add 1c4b70e [BEAM-11120] bump Gradle License Report plugin to 1.16
add 6e4adca Merge pull request #14011: [BEAM-11120] bump Gradle License
Report plugin to 1.16
add a1577fb [BEAM-11779] Fix python pipeline options for CrossLanguage
tests
add ffc7699 Merge pull request #14023: [BEAM-11779] Fix python pipeline
options for CrossLanguage tests
add 31e1b84 [BEAM-11800] Support ARRAY_AGG fn for Zetasql dialect (#13483)
add d6313df Add null checks to FhirIO.Search for when the search results
are empty. (#14024)
add 9e3ab44 Remove side input combine examples that don't work on most
runners.
add 560610d Merge pull request #14022 Remove side input combine examples
that don't work on most runners.
add 8dfe302 [BEAM-11842] Add resource hints to model proto.
add 70335bb Merge pull request #14027 [BEAM-11842] Add resource hints to
model proto.
add aaad864 [BEAM-7372] remove aliases created for python 2 (#14012)
add 06b5746 Add AutoLoadedSqlTransform, which runs SQL queries using the
auto loading mechanisms.
add a3d375e Revert "Add AutoLoadedSqlTransform, which runs SQL queries
using the auto loading mechanisms."
add 8193329 Modify sql transform instead of creating a new transform
add 4899abb Modify sql transform instead of creating a new transform
add 050b642 Merge pull request #14014 [BEAM-11850] Add DDL support to SQL
Transform
add b60c9ce Merge remote-tracking branch 'origin/master' into
website-revamp
No new revisions were added by this update.
Summary of changes:
.../jenkins/job_LoadTests_Combine_Python.groovy | 3 +-
.../job_LoadTests_FnApiRunner_Python.groovy | 24 +-
.../jenkins/job_LoadTests_GBK_Python.groovy | 3 +-
.../job_LoadTests_GBK_Python_reiterate.groovy | 3 +-
.../jenkins/job_LoadTests_ParDo_Python.groovy | 3 +-
.../jenkins/job_LoadTests_SideInput_Python.groovy | 3 +-
.../jenkins/job_PerformanceTests_KafkaIO_IT.groovy | 6 +-
.../Python_FnApiRunner_ubenchmarks.json | 1 +
CHANGES.md | 5 +
build.gradle.kts | 5 +-
buildSrc/build.gradle.kts | 2 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 22 +-
.../pipeline/src/main/proto/beam_runner_api.proto | 5 +
runners/google-cloud-dataflow-java/build.gradle | 6 +-
.../dataflow/worker/DataflowWorkUnitClient.java | 8 +-
.../runners/dataflow/worker/ExperimentContext.java | 3 +-
.../dataflow/worker/IsmSideInputReader.java | 11 +-
.../dataflow/worker/IsmSideInputReaderTest.java | 6 +-
sdks/go/pkg/beam/artifact/materialize.go | 6 +-
sdks/go/pkg/beam/core/graph/coder/double_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/genx/genx.go | 2 -
.../core/runtime/graphx/schema/logicaltypes.go | 7 +
.../pkg/beam/core/runtime/graphx/schema/schema.go | 211 +++++-
.../beam/core/runtime/graphx/schema/schema_test.go | 40 +-
sdks/go/pkg/beam/core/runtime/xlangx/expand.go | 8 +-
sdks/go/pkg/beam/forward.go | 8 +
sdks/go/pkg/beam/pardo_test.go | 3 +-
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 3 +
.../beam/runners/dataflow/dataflowlib/execute.go | 2 +-
sdks/go/pkg/beam/transforms/stats/stats.shims.go | 151 +++--
sdks/go/test/integration/primitives/cogbk_test.go | 2 +
.../v1/gen.go => test/integration/xlang/xlang.go} | 5 +-
sdks/go/test/run_validatesrunner_tests.sh | 2 +-
sdks/java/container/build.gradle | 2 +-
.../container/license_scripts/dep_urls_java.yaml | 2 +-
.../java/org/apache/beam/sdk/io/FileBasedSink.java | 6 +-
.../java/org/apache/beam/sdk/io/FileSystems.java | 46 +-
.../org/apache/beam/sdk/io/fs/MatchResult.java | 6 +
.../org/apache/beam/sdk/io/fs/MoveOptions.java | 1 +
sdks/java/expansion-service/build.gradle | 2 +-
.../sdk/extensions/gcp/storage/GcsFileSystem.java | 3 +
.../schemaio-expansion-service/build.gradle | 4 +-
sdks/java/extensions/sql/build.gradle | 2 +-
.../beam/sdk/extensions/sql/SqlTransform.java | 83 ++-
.../udaf/ArrayAgg.java} | 50 +-
.../extensions/sql/impl/utils/CalciteUtils.java | 2 +-
.../sdk/extensions/sql/BeamSqlDslUdfUdafTest.java | 5 +-
.../sdk/extensions/sql/PubsubToBigqueryIT.java | 37 +-
.../meta/provider/avro/AvroTableProviderTest.java | 19 +-
.../meta/provider/text/TextTableProviderTest.java | 96 ++-
.../zetasql/SupportedZetaSqlBuiltinFunctions.java | 2 +-
.../sql/zetasql/ZetaSQLQueryPlanner.java | 76 ++-
.../zetasql/ZetaSqlCalciteTranslationUtils.java | 5 +-
.../translation/SqlOperatorMappingTable.java | 1 +
.../sql/zetasql/translation/SqlOperators.java | 7 +
.../sql/zetasql/ZetaSqlDialectSpecTest.java | 31 +
.../extensions/sql/zetasql/ZetaSqlJavaUdfTest.java | 11 +-
.../apache/beam/sdk/io/aws/s3/S3FileSystem.java | 24 +-
.../azure/blobstore/AzureBlobStoreFileSystem.java | 25 +-
sdks/java/io/cassandra/build.gradle | 7 +
sdks/java/io/debezium/build.gradle | 83 +++
sdks/java/io/debezium/src/README.md | 178 +++++
.../org/apache/beam/io/debezium/DebeziumIO.java | 515 +++++++++++++++
.../beam/io/debezium/KafkaSourceConsumerFn.java | 394 +++++++++++
.../apache/beam/io/debezium/SourceRecordJson.java | 287 ++++++++
.../beam/io/debezium/SourceRecordMapper.java} | 16 +-
.../org/apache/beam/io/debezium}/package-info.java | 7 +-
.../io/debezium/DebeziumIOMySqlConnectorIT.java | 108 ++++
.../apache/beam/io/debezium/DebeziumIOTest.java | 101 +++
.../io/debezium/KafkaSourceConsumerFnTest.java | 264 ++++++++
.../apache/beam/io/debezium/OffsetTrackerTest.java | 71 ++
.../beam/io/debezium/SourceRecordJsonTest.java | 113 ++++
sdks/java/io/google-cloud-platform/build.gradle | 3 +-
.../beam/sdk/io/gcp/bigtable/BigtableConfig.java | 7 +-
.../apache/beam/sdk/io/gcp/healthcare/FhirIO.java | 1 -
.../io/gcp/healthcare/HttpHealthcareApiClient.java | 2 +-
.../beam/sdk/io/gcp/spanner/SpannerAccessor.java | 106 ++-
.../beam/sdk/io/gcp/healthcare/FhirIOSearchIT.java | 32 +
sdks/java/io/hadoop-file-system/build.gradle | 7 +
sdks/java/io/hadoop-format/build.gradle | 7 +
sdks/python/apache_beam/dataframe/frame_base.py | 16 +-
sdks/python/apache_beam/dataframe/frames.py | 179 +++--
sdks/python/apache_beam/dataframe/frames_test.py | 51 ++
.../apache_beam/dataframe/pandas_doctests_test.py | 17 +-
sdks/python/apache_beam/internal/pickler.py | 10 +-
.../runners/interactive/interactive_environment.py | 10 +-
.../runners/portability/flink_runner_test.py | 3 -
.../runners/portability/fn_api_runner/execution.py | 241 +------
.../portability/fn_api_runner/fn_runner_test.py | 37 --
.../portability/fn_api_runner/worker_handlers.py | 11 +-
.../runners/portability/spark_runner_test.py | 3 -
.../apache_beam/runners/worker/bundle_processor.py | 43 --
sdks/python/apache_beam/transforms/stats.pxd | 60 ++
sdks/python/apache_beam/transforms/stats.py | 719 +++++++++++++--------
sdks/python/apache_beam/transforms/stats_test.py | 114 +++-
sdks/python/container/base_image_requirements.txt | 4 +-
sdks/python/scripts/run_integration_test.sh | 2 +
sdks/python/setup.py | 1 +
settings.gradle.kts | 1 +
.../{build.gradle => build.gradle.kts} | 24 +-
.../www/site/content/en/contribute/attributes.md | 66 --
.../content/en/contribute/become-a-committer.md | 83 ++-
.../python/aggregation/combineglobally.md | 62 +-
.../transforms/python/aggregation/combineperkey.md | 62 +-
.../transforms/python/aggregation/combinevalues.md | 62 +-
.../partials/section-menu/en/contribute.html | 1 -
106 files changed, 3987 insertions(+), 1325 deletions(-)
copy sdks/go/{pkg/beam/core/runtime/graphx/v1/gen.go =>
test/integration/xlang/xlang.go} (89%)
copy
sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/{meta/provider/UdfUdafProvider.java
=> impl/udaf/ArrayAgg.java} (50%)
create mode 100644 sdks/java/io/debezium/build.gradle
create mode 100644 sdks/java/io/debezium/src/README.md
create mode 100644
sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/DebeziumIO.java
create mode 100644
sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/KafkaSourceConsumerFn.java
create mode 100644
sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/SourceRecordJson.java
copy
sdks/java/{extensions/euphoria/src/main/java/org/apache/beam/sdk/extensions/euphoria/core/client/functional/VoidFunction.java
=>
io/debezium/src/main/java/org/apache/beam/io/debezium/SourceRecordMapper.java}
(71%)
copy sdks/java/io/{clickhouse/src/main/java/org/apache/beam/sdk/io/clickhouse
=> debezium/src/main/java/org/apache/beam/io/debezium}/package-info.java (87%)
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumIOMySqlConnectorIT.java
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumIOTest.java
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/KafkaSourceConsumerFnTest.java
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/OffsetTrackerTest.java
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/SourceRecordJsonTest.java
create mode 100644 sdks/python/apache_beam/transforms/stats.pxd
rename vendor/bytebuddy-1_10_8/{build.gradle => build.gradle.kts} (64%)
delete mode 100644 website/www/site/content/en/contribute/attributes.md
