See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/40/display/redirect>
Changes:
------------------------------------------
[...truncated 119.47 KB...]
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:788
Waiting for docker to start up. Current status is running
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:792
Docker container is running. container_id =
b'21b6e2718f2fe50f9c5854b785856e1bf019302d36d355e4b4d98bd0e6cbacb4', worker_id
= worker_5
[32mINFO [0m root:environments.py:376 Default Python SDK image for
environment is apache/beam_python3.8_sdk:2.48.0.dev
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728245
nanos: 864000000
}
message: "Fn Harness started"
log_location: "org.apache.beam.fn.harness.FnHarness"
thread: "1"
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728246
nanos: 331000000
}
message: "Entering instruction processing loop"
log_location: "org.apache.beam.fn.harness.FnHarness"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1680728250
nanos: 267000000
}
message: "Application name is not set. Call Builder#setApplicationName."
instruction_id: "bundle_14"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/CreateTables/CreateTables/ParMultiDo(CreateTables)"
log_location: "com.google.api.client.googleapis.services.AbstractGoogleClient"
thread: "30"
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728252
nanos: 175000000
}
message: "Trying to create BigQuery table:
apache-beam-testing:python_xlang_storage_write1680728226a7c5c6.python_storage_write_nested_records_and_lists"
instruction_id: "bundle_14"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/CreateTables/CreateTables/ParMultiDo(CreateTables)"
log_location: "org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1680728252
nanos: 515000000
}
message: "Application name is not set. Call Builder#setApplicationName."
instruction_id: "bundle_14"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/Convert/Convert
to message"
log_location: "com.google.api.client.googleapis.services.AbstractGoogleClient"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1680728252
nanos: 674000000
}
message: "Application name is not set. Call Builder#setApplicationName."
instruction_id: "bundle_14"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/StorageApiWriteUnsharded/Write
Records"
log_location: "com.google.api.client.googleapis.services.AbstractGoogleClient"
thread: "30"
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728253
nanos: 667000000
}
message: "Reconnecting for
stream:projects/apache-beam-testing/datasets/python_xlang_storage_write1680728226a7c5c6/tables/python_storage_write_nested_records_and_lists/streams/Cic3M2YxZjM4Zi0wMDAwLTIyN2ItOGQ0OC0wODllMDgzMjYzM2M6czk
id: 0ce5ba98-7501-4562-ac4c-89750c0aba28"
log_location: "com.google.cloud.bigquery.storage.v1.StreamWriter"
thread: "48"
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728253
nanos: 675000000
}
message: "Reconnect done for
stream:projects/apache-beam-testing/datasets/python_xlang_storage_write1680728226a7c5c6/tables/python_storage_write_nested_records_and_lists/streams/Cic3M2YxZjM4Zi0wMDAwLTIyN2ItOGQ0OC0wODllMDgzMjYzM2M6czk
id: 0ce5ba98-7501-4562-ac4c-89750c0aba28"
log_location: "com.google.cloud.bigquery.storage.v1.StreamWriter"
thread: "48"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1680728254
nanos: 65000000
}
message: "Application name is not set. Call Builder#setApplicationName."
instruction_id: "bundle_16"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/StorageApiWriteUnsharded/Finalize
writes/ParMultiDo(StorageApiFinalizeWrites)"
log_location: "com.google.api.client.googleapis.services.AbstractGoogleClient"
thread: "30"
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728254
nanos: 314000000
}
message: "Finalize of stream
projects/apache-beam-testing/datasets/python_xlang_storage_write1680728226a7c5c6/tables/python_storage_write_nested_records_and_lists/streams/Cic3M2YxZjM4Zi0wMDAwLTIyN2ItOGQ0OC0wODllMDgzMjYzM2M6czk
finished with row_count: 1\n"
instruction_id: "bundle_16"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/StorageApiWriteUnsharded/Finalize
writes/ParMultiDo(StorageApiFinalizeWrites)"
log_location: "org.apache.beam.sdk.io.gcp.bigquery.StorageApiFinalizeWritesDoFn"
thread: "30"
[32mINFO [0m root:worker_handlers.py:415 severity: INFO
timestamp {
seconds: 1680728254
nanos: 772000000
}
message: "BatchCommit succeeded for tableId
projects/apache-beam-testing/datasets/python_xlang_storage_write1680728226a7c5c6/tables/python_storage_write_nested_records_and_lists
response commit_time {\n seconds: 1680728254\n nanos: 751471000\n}\n"
instruction_id: "bundle_16"
transform_id:
"WriteToBigQuery/StorageWriteToBigQuery/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigQueryIO.Write/StorageApiLoads/StorageApiWriteUnsharded/Finalize
writes/ParMultiDo(StorageApiFinalizeWrites)"
log_location: "org.apache.beam.sdk.io.gcp.bigquery.StorageApiFinalizeWritesDoFn"
thread: "30"
[32mINFO [0m root:environments.py:376 Default Python SDK image for
environment is apache/beam_python3.8_sdk:2.48.0.dev
[32mINFO [0m root:environments.py:376 Default Python SDK image for
environment is apache/beam_python3.8_sdk:2.48.0.dev
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1680728254
nanos: 921000000
}
message: "Hanged up for url: \"localhost:37497\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "25"
21b6e2718f2fe50f9c5854b785856e1bf019302d36d355e4b4d98bd0e6cbacb4
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to
perform query SELECT * FROM
python_xlang_storage_write1680728226a7c5c6.python_storage_write_nested_records_and_lists
to BQ
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:158 Result of
query is: [([1, 2, 3], {'nested_int': 1, 'nested_str': 'a'},
[{'nested_numeric': Decimal('1.23'), 'nested_bytes': b'a'}, {'nested_numeric':
Decimal('3.21'), 'nested_bytes': b'aa'}])]
[32mINFO [0m
apache_beam.io.external.xlang_bigqueryio_it_test:xlang_bigqueryio_it_test.py:117
Deleting dataset python_xlang_storage_write1680728226a7c5c6 in project
apache-beam-testing
[32mPASSED[0m
[33m=============================== warnings summary
===============================[0m
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2870:
18 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2870:
13 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2349
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2349:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_storage_write_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_storage_write_nested_records_and_lists
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2030:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_storage_write_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_storage_write_nested_records_and_lists
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2036:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml>
-
[33m==== [32m3 passed[0m, [33m[1m9 skipped[0m, [33m[1m6873
deselected[0m, [33m[1m47 warnings[0m[33m in 130.72s (0:02:10)[0m[33m
====[0m
> Task :sdks:python:test-suites:direct:py37:gcpCrossLanguageCleanup
Stopping expansion service pid: 4139562.
Skipping invalid pid: 4139563.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service_main.py";,>
line 170, in <module>
run(sys.argv)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service_main.py";,>
line 89, in run
os.unlink(options.pid_file)
FileNotFoundError: [Errno 2] No such file or directory:
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/local_job_service_main-42089.pid'>
Killing process at 4073359
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:xlang:fnApiJobServerCleanup'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 15m 7s
108 actionable tasks: 86 executed, 19 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/zadjhecks6bk4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
