This is an automated email from the ASF dual-hosted git repository.
mwalenia pushed a change to branch BEAM-9147-use-ptransforms
in repository https://gitbox.apache.org/repos/asf/beam.git.
discard 4fe0d53 Remove abstract AnnotateVideo PTransform
discard dcc6dbd Add position to CHANGES.md
discard 3111795 [BEAM-9147] Make VideoIntelligence use PTransform on
user-facing API
add 494482f [BEAM-9147] Add @Experimental annotation to VideoIntelligence
related classes
add b8323c8 Add @Experimental to the package-info as well
add d2089bc Merge pull request #11463 from
apache/BEAM-9147-add-experimental-annotation
add 37bb50d [BEAM-9692]: Make CombineValues portable (#11335)
add dee5a0a Add release date for 2.20.0
add d55cab7 Merge pull request #11465 from apache/aaltay-patch-2
add 1e7d2ff Fix user distribution metric test by using less restricting
value.
add 1bae13b Apply yapf fix.
add a4e317a Replace all explicit validation.
add 5acd866 Merge pull request #11455 from HuangLED/testFix
add 30fa01f [BEAM-9773]: Update Dataflow Debug Capture to use Google API
client Jackson 2
add 1da7b98 Remove all Dataflow google-api-client-jackson(1) dependencies
add b99a3dd Missed cleanup
add 2d98f80 Merge pull request #11442 from stevekoonce/master
add 95db26d [BEAM-6860] Fix iobase non-global windows bug
add a7169f9 Merge pull request #11439: [BEAM-6860] Fix iobase non-global
windows bug
add b106e21 [BEAM-9788] Add RetainDockerContainers flag support to Go
SDK. (#11467)
add fbf1775 [BEAM-9775] Add Go support for SDF StandardRequirements.
(#11443)
add 6060d99 [BEAM-9496] Add to_dataframe and to_pcollection APIs. (#11264)
add 2a931a5 add display:block to datatable so that the columns can have
various lengths based on the contents in them.
add fc8d18a Merge pull request #11462 from KevinGG/master
add 37838f2 [BEAM-9569] Fix BeamSqlPojoExample logRecords method to not
require Row coder inference
add c7da1b5 Merge pull request #11460: [BEAM-9569] Fix BeamSqlPojoExample
logRecords method to not require Row coder inference
add 0988049 Renames run_test -> run_scenario so that nose test runner
does not think it's a test method.
add 033c1eb Merge pull request #11457 Rename test-framework-confusing
run_test.
add 1b47b2e [BEAM-6960] More sophisticated job server starting and
stopping.
add 5878373 Abort pipeline if docker containers die unexpectedly.
add 7181427 [BEAM-6960] Go ULR validates runner tests.
add 488232d lint
add de38f6d Merge pull request #11451 [BEAM-6960] Go ULR validates runner
tests.
add 46c8d2d [BEAM-9285] Add Postcommit ValidatesRunner CI Job for Flink
on Java 11
add b605c1c Merge pull request #11113: [BEAM-9285] Add Postcommit
ValidatesRunner CI Job for Flink on Java 11
add 44638c5 Revert "[BEAM-8131] Provide Kubernetes setup for Prometheus
(#9482)" (#11347)
add 1572d57 Merge pull request #11466 from [BEAM-9787] Clear error
message on UW + BQSource
add 1905dbd [BEAM-9791] Add precommit for dataflow runner v2
add 5c27e8b Merge pull request #11470 from angoenka/uw_precommit
add 561752b [BEAM-9662][BEAM-9663] Reject Null Limit and Offset
add 8fff6d0 Merge pull request #11471: [BEAM-9662][BEAM-9663] Reject Null
Limit and Offset
add 4a7f04c [BEAM-9764] multi threading & optional pulling (#11428)
add 8de324f [BEAM-9608] BundleManagers use BundleContextManager for
configuration
add abb7bcb [BEAM-9639] Saving side inputs after producer execution, not
before consumption.
add f7ae7f6 [BEAM-9639] Separate Stage and Bundle execution. Improve
typing annotations.
add cf821e5 [BEAM-9639][BEAM-9608] Addressing review comments.
add 1fe543e Merge pull request #11270 from [BEAM-9639][BEAM-9608]
Improvements for FnApiRunner
add af71782 Fix SplittableParDoNaiveBounded DoFnInvoker.
add c00dc4a Merge pull request #11475 from boyuanzz/fix
add 6e6ff61 [BEAM-9789] Fix lock error. Add test. (#11468)
add 6663da8 Revert "[BEAM-9014] CachingShuffleBatchReader use bytes to
limit cache size."
add 623c5ed Merge pull request #11483 from
apache/revert-10418-cachesizebytes
add fc37a04 Add a timeout to the TestStream GRPC and fix the Streaming
cache timeout
add 7acbff4 Merge pull request #11440 from [BEAM-9767] Add a timeout to
the TestStream GRPC and fix the Streaming cache timeout
add 880b062 [BEAM-7981] Correct ParDo(callable) test (#11446)
add d2f91a7 update release 2.20.0 blog post and added contributors name
add e13c1d6 Merge pull request #11476 from
mszb/updating_release_blogpost_2_20_0
add 781ff5b Log job id similar to Java and Go
add 75151e3 Merge pull request #11458 from apache/aaltay-patch-1
add 084ac14 [BEAM-6597, BEAM-6467] Add support for reporting monitoring
infos to the Java SDK harness. (#11487)
add b091db6 [BEAM-8831] Do not copy generated files for Python source copy
add 7ff0f5a Merge pull request #10230 [BEAM-8831] Exclude generated files
for Python source copy
add 6cc6360 Merge pull request #11489 [BEAM-9577] Ensure required
directories exist when staging.
add fe3241f [BEAM-9642] Enabling SDF exec runners and fixing small bug.
(#11474)
add 66e9040 [BEAM-9755] changed MAKE_ADD stack pop order according to
Python version
add 84a914b Merge pull request #11493: [BEAM-9755] changed MAKE_ADD stack
pop order according to Python version
add 48db942 [BEAM-9717] update future version to 0.18.2 for Python 3.8
(#11494)
add 76387d9 [BEAM-9577] Use new artifact API to stage go artifacts.
(#11490)
add 2f3edaf Force output names to be unicode-compatible on Python 2.
(#11485)
add f35cf08 Make license_script.sh tolerate directory already existing
(#11501)
add 8cfc8a8 [BEAM-9778] remove temp directory & add docker-pull-licenses
to release scripts (#11484)
add b3596b8 [BEAM-8603] Add Python SqlTransform (#10055)
add 5b4ca7b [BEAM-9794] Reduce state cells needed for BufferingDoFnRunner
add 7869d49 Merge pull request #11478: [BEAM-9794] Reduce state cells
needed for BufferingDoFnRunner
add ef267d9 [BEAM-9701] Increments fastavro version range upper bound to
0.24. (#11506)
add 93b3a0f [BEAM-2939] Expose HasProgress interface for restriction
trackers and use the progress value during splitting
add 7568b06 [BEAM-2939] Add the ability for SDK harness runners to
provide additional monitoring infos.
add 7ac97ea [BEAM-2939] Integrate progress reporting for splittable dofns.
add a02eb60 [BEAM-2939] Fold Sizes sub-interfaces into RestrictionTracker
add cfa6692 [BEAM-2939] Drop HasSize in favor of using
HasProgress#getProgress#getWorkRemaining as the default if the DoFn doesn't
override GetSize.
add 0291976 Merge pull request #11472 from lukecwik/splittabledofn
add f813a90 [BEAM-9577] New artifact staging and retrieval service for
Java.
add 9c8718e [BEAM-9577] Multi-threaded artifact staging service backend.
add 01af3aa Use futures, better error handling.
add ec67a93 Merge pull request #11342 [BEAM-9577] New artifact staging
and retrieval service for Java.
add 9867aab [BEAM-9812] Fixing bug causing pipelines requiring temp
tables to not work
add decccbe Merge pull request #11509 from [BEAM-9812] Fixing bug causing
pipelines requiring temp tables to not work
add 55b82fc [BEAM-9514] Ensure nullability passes through sum
add a905f69 Merge pull request #11488: [BEAM-9514] Ensure nullability
passes through aggregate
add 71ccd7a [BEAM-7405] Workaround for bad Docker config
add 5761e33 Merge pull request #11512: [BEAM-7405] Workaround for bad
Docker config on Jenkins nodes.
add 89958d8 [BEAM-8871] Support trySplit for ByteKeyRangeTracker
add 28fd597 Merge pull request #11454 from boyuanzz/restriction_tracker
add d8519dd [BEAM-9811] Nightly snapshot publish error
add e55a7b3 [BEAM-9775] Adding Go SDF example, adjusting GetProgress
signature. (#11499)
add d416fd1 [BEAM-9733] Always let ImpulseSourceFunction emit a final
watermark
add 643945a [BEAM-9733] Make up for timers set while processing the bundle
add 4797f31 Merge pull request #11362: [BEAM-9733] Improve watermark and
timer handling
add fd74d4d [BEAM-9813] Replace outputs with respect to the correct tag.
add 5262732 Merge pull request #11515: [BEAM-9813] Replace outputs with
respect to the correct tag.
add 5d350cb [BEAM-9761] Disable auto builds for tests that are currently
failing.
add 022fe5e Merge pull request #11519: [BEAM-9761] Disable auto builds
for tests that are currently failing.
add 6d29fb8 [BEAM-9811] Copy pom for all publishMavenJavaPublication tasks
add 1321104 add licenses and license types for zetasql packages (#11516)
add 24361d1 Added a batch example with covid tracking data for
interactive notebook. (#11469)
add 4a52fb4 [BEAM-9488] Ensure we pass through PCollection ids instead of
attempting to fix them up. (#11514)
add 3777b79 Fix invalid formatting specifier in verify
add 7fd4008 Merge pull request #11525: Fix invalid formatting specifier
in verify
add 5fab78a [BEAM-9820] Upgrade Flink 1.9.x to 1.9.3
add b8085ad Merge pull request #11526: [BEAM-9820] Upgrade Flink 1.9.x to
1.9.3
add 9ed5a92 [BEAM-9819] Relaxes the version range for httplib2 to
<0.16.0. (#11522)
add 610e18f [BEAM-9147] Make VideoIntelligence use PTransform on
user-facing API
add abe777c Add position to CHANGES.md
add d8baca4 Remove abstract AnnotateVideo PTransform
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4fe0d53)
\
N -- N -- N refs/heads/BEAM-9147-use-ptransforms (d8baca4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/PULL_REQUEST_TEMPLATE.md | 2 +-
.../jenkins/job_LoadTests_GBK_Flink_Python.groovy | 4 +-
.../job_LoadTests_coGBK_Flink_Python.groovy | 4 +-
...ommit_Java_ValidatesRunner_Flink_Java11.groovy} | 12 +-
.test-infra/metrics/README.md | 31 +-
.test-infra/metrics/apply_configmaps.sh | 26 -
.test-infra/metrics/beamprometheus-deploy.yaml | 125 -----
.test-infra/metrics/build.gradle | 13 +
.test-infra/metrics/docker-compose.yml | 28 +-
.../alertmanager/config/alertmanager.yml | 41 --
.../prometheus/prometheus/config/prometheus.yml | 40 --
.../metrics/prometheus/prometheus/config/rules.yml | 35 --
CHANGES.md | 5 +-
build.gradle | 2 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 32 +-
.../src/main/scripts/build_release_candidate.sh | 2 +-
.../construction/SplittableParDoNaiveBounded.java | 7 +-
.../core/metrics/MonitoringInfoConstants.java | 2 +
runners/flink/1.9/build.gradle | 2 +-
runners/flink/flink_runner.gradle | 5 +-
.../runners/flink/FlinkExecutionEnvironments.java | 4 +
.../beam/runners/flink/FlinkPipelineOptions.java | 7 +
.../functions/ImpulseSourceFunction.java | 12 +
.../wrappers/streaming/DoFnOperator.java | 216 +++++---
.../streaming/ExecutableStageDoFnOperator.java | 204 +++++--
.../wrappers/streaming/SplittableDoFnOperator.java | 4 +
.../streaming/stableinput/BufferingDoFnRunner.java | 97 ++--
.../runners/flink/FlinkPipelineOptionsTest.java | 1 +
.../beam/runners/flink/FlinkSavepointTest.java | 34 +-
.../runners/flink/PortableTimersExecutionTest.java | 35 +-
.../FlinkExecutableStageFunctionTest.java | 5 +
.../functions/ImpulseSourceFunctionTest.java | 17 +-
.../wrappers/streaming/DoFnOperatorTest.java | 5 +-
.../streaming/ExecutableStageDoFnOperatorTest.java | 278 ++++++++--
.../wrappers/streaming/WindowDoFnOperatorTest.java | 4 +-
.../stableinput/BufferingDoFnRunnerTest.java | 171 ++++++
.../google-cloud-dataflow-java/worker/build.gradle | 2 +-
.../worker/ApplianceShuffleEntryReader.java | 6 +-
.../worker/ChunkingShuffleBatchReader.java | 8 +-
.../dataflow/worker/status/DebugCapture.java | 9 +-
.../common/worker/CachingShuffleBatchReader.java | 61 +-
.../util/common/worker/ShuffleBatchReader.java | 5 +-
.../graph/LengthPrefixUnknownCodersTest.java | 2 +-
.../dataflow/worker/status/DebugCaptureTest.java | 2 +-
.../worker/BatchingShuffleEntryReaderTest.java | 18 +-
.../worker/CachingShuffleBatchReaderTest.java | 4 +-
.../artifact/ArtifactRetrievalService.java | 114 ++++
.../artifact/ArtifactStagingService.java | 616 +++++++++++++++++++++
.../control/DefaultJobBundleFactory.java | 5 +
.../runners/fnexecution/control/RemoteBundle.java | 8 +
.../fnexecution/control/SdkHarnessClient.java | 22 +
.../artifact/ArtifactRetrievalServiceTest.java | 132 +++++
.../artifact/ArtifactStagingServiceTest.java | 173 ++++++
.../fnexecution/control/RemoteExecutionTest.java | 301 +++++-----
.../SparkExecutableStageFunctionTest.java | 5 +
.../stringsplit/offsetrange/offsetrange.go | 119 ++++
sdks/go/examples/stringsplit/stringsplit.go | 246 ++++++++
sdks/go/pkg/beam/artifact/materialize.go | 4 +
sdks/go/pkg/beam/artifact/materialize_test.go | 19 +
sdks/go/pkg/beam/core/graph/fn_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 40 +-
.../beam/core/runtime/exec/sdf_invokers_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 7 +-
sdks/go/pkg/beam/core/runtime/exec/translate.go | 80 ++-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 39 +-
.../pkg/beam/core/runtime/graphx/translate_test.go | 54 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 13 +-
.../pkg/beam/core/runtime/harness/harness_test.go | 165 ++++++
sdks/go/pkg/beam/core/runtime/options.go | 9 +-
sdks/go/pkg/beam/core/runtime/pipelinex/clone.go | 3 +-
sdks/go/pkg/beam/core/sdf/sdf.go | 7 +-
sdks/go/pkg/beam/options/jobopts/options.go | 4 +
.../go/pkg/beam/runners/universal/runnerlib/job.go | 10 +-
.../pkg/beam/runners/universal/runnerlib/stage.go | 102 +++-
sdks/go/pkg/beam/runners/universal/universal.go | 7 +-
sdks/go/test/build.gradle | 24 +
sdks/go/test/run_integration_tests.sh | 86 +--
sdks/java/bom/build.gradle | 4 +-
sdks/java/container/build.gradle | 20 +-
.../container/license_scripts/dep_urls_java.yaml | 26 +-
.../container/license_scripts/license_script.sh | 32 +-
.../license_scripts/pull_licenses_java.py | 302 ++++++----
.../src/main/java/org/apache/beam/sdk/io/Read.java | 77 +--
.../org/apache/beam/sdk/io/range/ByteKeyRange.java | 2 +-
.../java/org/apache/beam/sdk/transforms/DoFn.java | 27 +-
.../reflect/ByteBuddyDoFnInvokerFactory.java | 13 +-
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 12 +-
.../splittabledofn/ByteKeyRangeTracker.java | 98 +++-
.../splittabledofn/OffsetRangeTracker.java | 15 +-
.../splittabledofn/RestrictionTracker.java | 76 ++-
.../beam/sdk/transforms/splittabledofn/Sizes.java | 54 --
.../apache/beam/sdk/io/range/ByteKeyRangeTest.java | 7 +-
.../splittabledofn/ByteKeyRangeTrackerTest.java | 132 ++++-
.../splittabledofn/OffsetRangeTrackerTest.java | 25 +-
.../sql}/expansion-service/build.gradle | 32 +-
.../beam/sdk/extensions/sql/SqlTransform.java | 39 +-
.../extensions/sql/example/BeamSqlPojoExample.java | 8 +-
.../sdk/extensions/sql/example/model/Customer.java | 34 +-
.../sdk/extensions/sql/example/model/Order.java | 5 +
.../translation/AggregateScanConverter.java | 28 +-
.../LimitOffsetScanToLimitConverter.java | 6 +
.../LimitOffsetScanToOrderByLimitConverter.java | 5 +
.../sql/zetasql/ZetaSQLDialectSpecTest.java | 41 ++
.../sdk/fn/splittabledofn/RestrictionTrackers.java | 18 +-
.../fn/splittabledofn/RestrictionTrackersTest.java | 14 +-
.../beam/fn/harness/BeamFnDataReadRunner.java | 1 +
.../beam/fn/harness/BeamFnDataWriteRunner.java | 1 +
.../beam/fn/harness/BoundedSourceRunner.java | 1 +
.../org/apache/beam/fn/harness/CombineRunners.java | 1 +
.../org/apache/beam/fn/harness/FlattenRunner.java | 1 +
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 144 +++--
.../java/org/apache/beam/fn/harness/FnHarness.java | 4 +-
.../org/apache/beam/fn/harness/HandlesSplits.java | 2 +-
.../org/apache/beam/fn/harness/MapFnRunners.java | 1 +
.../beam/fn/harness/PTransformRunnerFactory.java | 14 +
.../fn/harness/control/ProcessBundleHandler.java | 81 ++-
.../beam/fn/harness/AssignWindowsRunnerTest.java | 1 +
.../beam/fn/harness/BeamFnDataReadRunnerTest.java | 2 +
.../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 1 +
.../beam/fn/harness/BoundedSourceRunnerTest.java | 1 +
.../apache/beam/fn/harness/CombineRunnersTest.java | 35 +-
.../apache/beam/fn/harness/FlattenRunnerTest.java | 2 +
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 58 +-
.../apache/beam/fn/harness/MapFnRunnersTest.java | 3 +
.../harness/control/ProcessBundleHandlerTest.java | 17 +
sdks/python/apache_beam/dataframe/convert.py | 98 ++++
sdks/python/apache_beam/dataframe/convert_test.py | 64 +++
sdks/python/apache_beam/dataframe/expressions.py | 18 +-
sdks/python/apache_beam/dataframe/transforms.py | 138 +++--
.../apache_beam/dataframe/transforms_test.py | 14 +-
.../apache_beam/examples/wordcount_xlang_sql.py | 118 ++++
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 6 +-
.../hdfs_integration_test/hdfs_integration_test.sh | 5 +
sdks/python/apache_beam/io/iobase.py | 2 +-
sdks/python/apache_beam/io/textio_test.py | 23 +-
sdks/python/apache_beam/metrics/metric_test.py | 8 +-
.../python/apache_beam/metrics/monitoring_infos.py | 60 +-
sdks/python/apache_beam/pipeline.py | 29 +-
.../runners/dataflow/dataflow_runner.py | 31 +-
.../runners/dataflow/dataflow_runner_test.py | 26 +
.../runners/dataflow/internal/apiclient.py | 1 +
.../runners/dataflow/ptransform_overrides.py | 35 ++
.../apache_beam/runners/direct/test_stream_impl.py | 20 +-
.../runners/interactive/caching/streaming_cache.py | 5 +-
.../interactive/display/pcoll_visualization.py | 2 +-
.../interactive/examples/UsCovidDataExample.ipynb | 511 +++++++++++++++++
.../runners/portability/fn_api_runner/execution.py | 179 +++++-
.../runners/portability/fn_api_runner/fn_runner.py | 406 ++++++--------
.../portability/fn_api_runner/fn_runner_test.py | 24 +
.../portability/fn_api_runner/translations.py | 11 +
.../portability/fn_api_runner/worker_handlers.py | 50 +-
.../runners/portability/local_job_service.py | 1 +
.../runners/portability/local_job_service_main.py | 108 +++-
.../apache_beam/runners/worker/bundle_processor.py | 57 +-
.../apache_beam/runners/worker/operations.pxd | 4 +-
.../apache_beam/runners/worker/operations.py | 110 ++--
sdks/python/apache_beam/transforms/external.py | 2 +-
sdks/python/apache_beam/transforms/sql.py | 74 +++
sdks/python/apache_beam/transforms/sql_test.py | 131 +++++
sdks/python/apache_beam/typehints/opcodes.py | 10 +-
.../apache_beam/typehints/typed_pipeline_test.py | 5 +-
sdks/python/apache_beam/utils/subprocess_server.py | 2 +-
sdks/python/build-requirements.txt | 2 +-
sdks/python/setup.py | 6 +-
sdks/python/test-suites/dataflow/py2/build.gradle | 87 ++-
sdks/python/test-suites/dataflow/py37/build.gradle | 87 ++-
settings.gradle | 1 +
.../src/_includes/flink_java_pipeline_options.html | 5 +
.../_includes/flink_python_pipeline_options.html | 5 +
website/src/_posts/2020-04-15-beam-2.20.0.md | 5 +-
website/src/contribute/release-guide.md | 2 +-
171 files changed, 6240 insertions(+), 1920 deletions(-)
copy
.test-infra/jenkins/{job_PostCommit_Java_ValidatesRunner_Dataflow_Java11.groovy
=> job_PostCommit_Java_ValidatesRunner_Flink_Java11.groovy} (80%)
delete mode 100755 .test-infra/metrics/apply_configmaps.sh
delete mode 100644 .test-infra/metrics/beamprometheus-deploy.yaml
delete mode 100644
.test-infra/metrics/prometheus/alertmanager/config/alertmanager.yml
delete mode 100644
.test-infra/metrics/prometheus/prometheus/config/prometheus.yml
delete mode 100644 .test-infra/metrics/prometheus/prometheus/config/rules.yml
create mode 100644
runners/flink/src/test/java/org/apache/beam/runners/flink/translation/wrappers/streaming/stableinput/BufferingDoFnRunnerTest.java
create mode 100644
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/artifact/ArtifactRetrievalService.java
create mode 100644
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/artifact/ArtifactStagingService.java
create mode 100644
runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/artifact/ArtifactRetrievalServiceTest.java
create mode 100644
runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/artifact/ArtifactStagingServiceTest.java
create mode 100644 sdks/go/examples/stringsplit/offsetrange/offsetrange.go
create mode 100644 sdks/go/examples/stringsplit/stringsplit.go
create mode 100644 sdks/go/pkg/beam/core/runtime/harness/harness_test.go
delete mode 100644
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/splittabledofn/Sizes.java
copy sdks/java/{ => extensions/sql}/expansion-service/build.gradle (55%)
create mode 100644 sdks/python/apache_beam/dataframe/convert.py
create mode 100644 sdks/python/apache_beam/dataframe/convert_test.py
create mode 100644 sdks/python/apache_beam/examples/wordcount_xlang_sql.py
create mode 100644
sdks/python/apache_beam/runners/interactive/examples/UsCovidDataExample.ipynb
create mode 100644 sdks/python/apache_beam/transforms/sql.py
create mode 100644 sdks/python/apache_beam/transforms/sql_test.py
