This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 6649ccc (commit)
to 7aec62b (commit)
from 6649ccc Merge pull request #13283 from ihji/BEAM-11142
add 8cc104c fix: Fix split() logic for PubsubliteIO to split to
`desiredNumSplits` groups instead of groups of size `desiredNumSplits`
add c2b8c24 fix: Fix nit
add 4a378bf fix: run spotless
add 2ab6c8a Merge pull request #13161 from dpcollins-google/fix-lite-2
add 730e7c0 [BEAM-11172] Enable KafkaIO performance test for runner v2
with SDF.
add 17beb66 Merge pull request #13282: [BEAM-11172] Enable KafkaIO
performance test for Dataflow runner v2 with SDF.
add b0dd257 Squash, merge PR #13277 - [BEAM-10921] Add the
UserPipelineTracker to track user pipelines for derived pipelines
add 9107a12 Increase the deadline for CreateReadSession to 2 hours
add 4e0925b Merge pull request #13295: [BEAM-11226] Increase the deadline
for CreateReadSession to 2 hours
add 746cdfa Revert "Merge pull request #13321 from [BEAM-11255] Adding
upper bound on urllib3 dependency"
add d09768e [BEAM-11255] Revert "Merge pull request #13321 from
[BEAM-11255] Adding upper bound on urllib3 dependency" (#13328)
add fc4f1c7 add xvr dataflow badge
add beee718 Merge pull request #13336 from ihji/add_xvr_dataflow_badge
add 11c58f2 [BEAM-11211] Allow pyarrow up to 2.x, raise helpful error
when trying to write wit… (#13302)
add 8e70cf6 More helpful error when we can't find a way to construct a
POJO
add d9fe3f8 More helpful error when we can't construct a Java Bean
add 17c9d49 Add @SchemaCaseFormat, test with AutoValue beans and POJOs
add a6cd84c lint
add 47a6022 [BEAM-10989] Add @SchemaCaseFormat annotation (#13003)
add a8337b8 Update SDF related documentation.
add d2ff41e Merge pull request #13313 from [BEAM-10480] Update SDF
related documentation.
add 31fd516 [BEAM-9980] do not hardcode Python version for cross language
tests and make it switchable. (#13316)
add f46f050 use guava version specified in beam module
add 31bffe8 add guava dependency management to archetype
add a66c54d Merge pull request #13315: [BEAM-11228] Add guava to
dependency management in generated pom
add 656c21b [BEAM-11192] Add use_runner_v2 to experiments.
add 43e8b99 Merge pull request #13339 from [BEAM-11192] Add use_runner_v2
to experiments.
add 7a2e401 Allow null next index for last report.
add 53a0954 Merge pull request #13343 Allow null next index for last
report.
add 7aec62b Reshuffle in pd.read_* (#13346)
No new revisions were added by this update.
Summary of changes:
.github/PULL_REQUEST_TEMPLATE.md | 2 +-
.test-infra/jenkins/PythonTestProperties.groovy | 3 +
.../jenkins/job_PerformanceTests_KafkaIO_IT.groovy | 48 +++++-
...it_CrossLanguageValidatesRunner_Dataflow.groovy | 38 ++---
...mmit_CrossLanguageValidatesRunner_Direct.groovy | 23 ++-
...ommit_CrossLanguageValidatesRunner_Flink.groovy | 23 ++-
...ommit_CrossLanguageValidatesRunner_Spark.groovy | 23 ++-
.../kafka-cluster/05-kafka/configmap-config.yaml | 4 +
README.md | 2 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 75 ++++++---
runners/google-cloud-dataflow-java/build.gradle | 49 ++----
.../examples/build.gradle | 2 +-
.../dataflow/worker/WorkItemStatusClient.java | 2 +-
.../sdk/schemas/FieldValueTypeInformation.java | 32 +++-
.../apache/beam/sdk/schemas/JavaBeanSchema.java | 27 ++-
.../sdk/schemas/annotations/SchemaCaseFormat.java | 73 ++++++++
.../sdk/schemas/annotations/SchemaFieldName.java | 11 +-
.../beam/sdk/schemas/utils/JavaBeanUtils.java | 39 +++--
.../apache/beam/sdk/schemas/utils/POJOUtils.java | 5 +-
.../java/org/apache/beam/sdk/transforms/DoFn.java | 4 +-
.../splittabledofn/RestrictionTracker.java | 23 ++-
.../beam/sdk/schemas/AutoValueSchemaTest.java | 57 +++++++
.../beam/sdk/schemas/JavaBeanSchemaTest.java | 73 ++++++++
.../beam/sdk/schemas/JavaFieldSchemaTest.java | 55 +++++++
.../beam/sdk/schemas/utils/SchemaTestUtils.java | 22 +++
.../beam/sdk/schemas/utils/TestJavaBeans.java | 129 +++++++++++++++
.../apache/beam/sdk/schemas/utils/TestPOJOs.java | 56 +++++++
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 22 ++-
.../gcp/pubsublite/PubsubLiteUnboundedSource.java | 16 +-
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 14 +-
.../org/apache/beam/sdk/io/kafka/KafkaIOIT.java | 81 +++++++--
sdks/java/maven-archetypes/examples/build.gradle | 1 +
.../src/main/resources/archetype-resources/pom.xml | 8 +-
sdks/python/apache_beam/dataframe/io.py | 1 +
sdks/python/apache_beam/io/iobase.py | 12 +-
sdks/python/apache_beam/io/parquetio.py | 8 +
sdks/python/apache_beam/io/parquetio_test.py | 4 +
.../runners/interactive/user_pipeline_tracker.py | 135 +++++++++++++++
.../interactive/user_pipeline_tracker_test.py | 183 +++++++++++++++++++++
sdks/python/apache_beam/transforms/core.py | 28 +++-
sdks/python/setup.py | 4 +-
41 files changed, 1237 insertions(+), 180 deletions(-)
create mode 100644
sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/annotations/SchemaCaseFormat.java
create mode 100644
sdks/python/apache_beam/runners/interactive/user_pipeline_tracker.py
create mode 100644
sdks/python/apache_beam/runners/interactive/user_pipeline_tracker_test.py
