See <https://builds.apache.org/job/beam_PreCommit_Python_Cron/2175/display/redirect?page=changes>
Changes: [ehudm] [BEAM-8269] Convert from_callable type hints to Beam types [ehudm] Fix _get_args for typing.Tuple in Py3.5.2 [ehudm] Fix cleanPython race with :clean [pabloem] Initialize logging configuration in Pipeline object [pabloem] Initialize logging configuration in PipelineOptions object. [heejong] [BEAM-8902] parameterize input type of Java external transform [ehudm] Dicts are not valid DoFn.process return values [angoenka] [BEAM-8944] Change to use single thread in py sdk bundle progress report ------------------------------------------ [...truncated 1.64 MB...] apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 apache_beam/runners/portability/fn_api_runner_test.py:1190 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner_test.py>:1190: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(DebugOptions).experiments.remove('beam_fn_api') apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 apache_beam/runners/portability/fn_api_runner_test.py:1220 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner_test.py>:1220: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(DebugOptions).experiments.remove('beam_fn_api') apache_beam/runners/portability/fn_api_runner_test.py:1550 apache_beam/runners/portability/fn_api_runner_test.py:1550 apache_beam/runners/portability/fn_api_runner_test.py:1550 apache_beam/runners/portability/fn_api_runner_test.py:1550 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner_test.py>:1550: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(DebugOptions).experiments.remove('beam_fn_api') apache_beam/io/fileio_test.py:72 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:72: FutureWarning: MatchFiles is experimental. | beam.Map(lambda x: x.path)) apache_beam/io/fileio_test.py:185 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:185: FutureWarning: MatchAll is experimental. | beam.Map(lambda rf: rf.open().readline())) apache_beam/io/fileio_test.py:185 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:185: FutureWarning: ReadMatches is experimental. | beam.Map(lambda rf: rf.open().readline())) apache_beam/io/fileio_test.py:163 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:163: FutureWarning: MatchAll is experimental. | beam.FlatMap(lambda rf: csv.reader(_get_file_reader(rf)))) apache_beam/io/fileio_test.py:163 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:163: FutureWarning: ReadMatches is experimental. | beam.FlatMap(lambda rf: csv.reader(_get_file_reader(rf)))) apache_beam/io/fileio_test.py:357 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:357: FutureWarning: WriteToFiles is experimental. | beam.io.fileio.WriteToFiles(path=dir)) apache_beam/io/fileio_test.py:364 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:364: FutureWarning: MatchFiles is experimental. | beam.Map(json.loads)) apache_beam/io/fileio_test.py:364 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:364: FutureWarning: ReadMatches is experimental. | beam.Map(json.loads)) apache_beam/io/parquetio_test.py:370 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:370: FutureWarning: The parameter chunksize is deprecated for pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize instead count=12000).to_batches(chunksize=1000) apache_beam/io/fileio_test.py:541 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:541: FutureWarning: WriteToFiles is experimental. | beam.ParDo(self.record_dofn())) apache_beam/io/fileio_test.py:545 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:545: FutureWarning: MatchFiles is experimental. files = (p | beam.io.fileio.MatchFiles(FileSystems.join(dir, '*'))) apache_beam/io/fileio_test.py:552 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/fileio_test.py>:552: FutureWarning: ReadMatches is experimental. | beam.Map(lambda rf: (rf.metadata.path, apache_beam/io/mongodbio_test.py:250 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/mongodbio_test.py>:250: FutureWarning: ReadFromMongoDB is experimental. uri='mongodb://test', db='db', coll='collection') apache_beam/io/mongodbio_test.py:318 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/mongodbio_test.py>:318: FutureWarning: WriteToMongoDB is experimental. | "Write" >> WriteToMongoDB(db='test', coll='test')) apache_beam/io/parquetio_test.py:360 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/io/parquetio_test.py>:360: FutureWarning: The parameter chunksize is deprecated for pyarrow.Table.to_batches as of 0.15, please use the parameter max_chunksize instead count=12000).to_batches(chunksize=1000) apache_beam/transforms/combiners.py:196 apache_beam/transforms/combiners.py:196 apache_beam/transforms/combiners.py:196 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/combiners.py>:196: DeprecationWarning: Compare not available in Python 3, use key instead. DeprecationWarning) apache_beam/transforms/ptransform_test.py:743 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/ptransform_test.py>:743: BeamDeprecationWarning: RemoveDuplicates is deprecated since 2.12. Use Distinct instead. result = pcoll.apply(beam.RemoveDuplicates()) apache_beam/transforms/combiners.py:285 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/combiners.py>:285: DeprecationWarning: Compare not available in Python 3, use key instead. DeprecationWarning) apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 apache_beam/transforms/trigger_test.py:916 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/trigger_test.py>:916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(StandardOptions).streaming = True apache_beam/transforms/util_test.py:587 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/util_test.py>:587: FutureWarning: GroupIntoBatches is experimental. | util.GroupIntoBatches(GroupIntoBatchesTest.BATCH_SIZE) apache_beam/transforms/util.py:747 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/util.py>:747: UserWarning: Use of GroupIntoBatches transform requires State/Timer support from the runner warnings.warn('Use of GroupIntoBatches transform requires State/Timer ' apache_beam/transforms/util_test.py:622 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/util_test.py>:622: FutureWarning: GroupIntoBatches is experimental. | util.GroupIntoBatches(GroupIntoBatchesTest.BATCH_SIZE) -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/pytest_py27-cython-pytest.xml> - ========== 2347 passed, 570 skipped, 213 warnings in 1841.97 seconds =========== ============================= test session starts ============================== platform linux2 -- Python 2.7.12, pytest-4.6.8, py-1.8.0, pluggy-0.13.1 cachedir: target/.tox-py27-cython-pytest/py27-cython-pytest/.pytest_cache rootdir: <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python,> inifile: pytest.ini plugins: requests-mock-1.7.0, forked-1.1.3, xdist-1.30.0 collected 2974 items / 2917 deselected / 57 selected apache_beam/coders/fast_coders_test.py ........................... [ 47%] apache_beam/coders/slow_coders_test.py ........................... [ 94%] apache_beam/io/gcp/tests/bigquery_matcher_test.py s [ 96%] apache_beam/runners/dataflow/dataflow_runner_test.py s [ 98%] apache_beam/runners/portability/stager_test.py . [100%] =============================== warnings summary =============================== apache_beam/__init__.py:84 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' target/.tox-py27-cython-pytest/py27-cython-pytest/local/lib/python2.7/site-packages/py/_code/_assertionold.py:3 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/target/.tox-py27-cython-pytest/py27-cython-pytest/local/lib/python2.7/site-packages/py/_code/_assertionold.py>:3: DeprecationWarning: The compiler package is deprecated and removed in Python 3.x. from compiler import parse, ast, pycodegen apache_beam/transforms/trigger_test.py:520 <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/apache_beam/transforms/trigger_test.py>:520: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. for spec in yaml.load_all(open(transcript_filename)): -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/pytest_py27-cython-pytest_no_xdist.xml> - ====== 55 passed, 2 skipped, 2917 deselected, 3 warnings in 6.60 seconds ======= py27-cython-pytest run-test-post: commands[0] | <https://builds.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py2/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> ___________________________________ summary ____________________________________ py27-cython-pytest: commands succeeded congratulations :) FAILURE: Build completed with 3 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:tox:py37:testPy37Gcp'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:tox:py36:testPy36Gcp'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:tox:py2:testPy2Gcp'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 41m 26s 78 actionable tasks: 74 executed, 4 from cache Publishing build scan... https://gradle.com/s/h75drdda7ropg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
