See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3479/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Exclude IOs already split from Java Precommit job
[Kenneth Knowles] Move expansion services into appropriate precommits
[Kenneth Knowles] Split more IOs out of Java precommit
[Kenneth Knowles] Fix trigger paths for separated IOs
[noreply] Replaced finalize with DoFn Teardown in Neo4jIO (#24571)
[Kenneth Knowles] Simplify bug report templates
[Kenneth Knowles] Fix bugs in issue template yml
[noreply] Fix issue templates (#24597)
[noreply] [#24024] Stop wrapping light weight functions with Contextful as they
[noreply] Sample window size as well (#24388)
[noreply] Implement Kafka Write Schema Transform (#24495)
[Kenneth Knowles] Eliminate null errors from JdbcIO
[noreply] docs(fix): Filter.whereFieldName(s?) ->
------------------------------------------
[...truncated 1.28 MB...]
payload:
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\001.\307\003\360@\254\355\000\005sr\000&org.apache.beam.sdk.coders.SnappyCoder1\033\243\356\177\362\366,\002\000\001L\000\ninner\005\030
t\000\"Lorg/a\005B\000/\001B\020/sdk/\tB\000/\005$\020;xr\000*ng\000
tructured\005/8s\277\022\016\325\3246\021\002\000\000xr\000
j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000,j1\000,Serializable\005=
\010\364
\216\305ynl\002\001\327\\\004typet\000\021Ljava/lang/Class\001\300n'\001\024Custom\005PPj\260\010\235\013;\035\013\002\000\000xq\000~\000\003vr\000$N\221\000\\io.BoundedSource!`v\023\177\370QA\0019\010r\000\035Z3\000\t,0\020\213\372\020Y\214\347\323\002\000\000xp"
>
>
>
coders: <
key: "GDCqfzqKCKTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload:
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006\\\313\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000
j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000
schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215d\203\254\323C\026X\\\367\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000HL>\335\002
vendor/gu\0019Lv26_0_jre/com/google\001\0134mon/collect/Bi\tZ\000\006\005Z\014st\000\020\035u$List;L\000\007op\005\273\010t\000,R\267\001-\000M\004\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\236\222\235\350sr\000\021\001\342\000.\001\342\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ei\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\360\001b\020xsr\000J>\365\001)f\000.%f\000.5f\020.com.)f\001\013\014mon.-f\000.\001\334%j\001S\001\001(\003\000\000xpw\004\000\000\000\001A\251\000\027\001\005\000\032\001l\000\023\005\222%\021\020Array!\203
x\201\322\035\231\307a\235\003\001\274\024\004sizex\001I\000\001\t@\014sr\0002>\241\000\241A-\226\024.AutoV\241;\000_i\244\004_FAD\034\303\343i\345\363l$\364\205.\004\013dm\233\205*\000\022I\002!\026\030/String!\313\014name\001\246\010
L\000Q\020\001\017\014\022L\000\004a\335\010t\000.\216\034\002\005|a\340a\326\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\226\010t\000\000\001y\004\027sZ\267\005\021\370\rA\000OI\216\034\367\031\n\2336X\271\227\305\".\301\000\014\017xps\001P\004\025?IS\004\000wQS%\374\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001u(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024
\010metadata\001$\034\017L\000\010null\241\353\010t\000\023=\3604Boolean;L\000\trow)C\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\272Lions$EmptyMapY6\024\205Z\334\347\265\247\211WA\302\000.\r\3224\315
r\200\325\234\372\356\002\000\001Z\000\005\211\000\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\345\375\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\241\036x\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\255\023\206\325j1\214f6\000\276AU\333Co\005e\014\014sr\000Ro\001\005\364\004s.\001\313\371\212,s$9z\2164\213\005/\271\347\002\005\324\000)N\016\001R;\000\034x\237G[\330\210\240{eR
\005tokent\000LB\032\002\251,\212\222\006\010ref\305\222\001\241\000T\001N\000;\345r\000Z>\221\000\tQ\212}\005\rQ\005\362\005Q\024$Simple\026\005\020!\255\001\001\t\372\346\346\005Bi\000\0342{#\261\276\3768|%\033\030\013runtim\005w\010t\000\030}m\r8\005\362\030;xpvr\000\036>\355\000\241\311-~(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "GDCqfzqKCKVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload:
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\330\001\350\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xrr5\000\024Atomic\0055
\307\354\265\314\205tPF\002\0055\000*jj\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000
j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "GDCqfzqKCKVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload:
"\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055
\307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000
j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload:
"\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "GDCqfzqKCKbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.45.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.45.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\nL/tmp/artifacts/icedtea-sound-5xFkOD7aUmX8Jiw7lPqhn75zkNGCyUOfOuqi2rClWKM.jar\022@e71164383eda5265fc262c3b94faa19fbe7390d182c9439f3aeaa2dab0a558a3"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n=icedtea-sound-5xFkOD7aUmX8Jiw7lPqhn75zkNGCyUOfOuqi2rClWKM.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\nF/tmp/artifacts/jaccess-Rlp7GfuSFOBCBGdO8af2XxrTz5LqaQqwSMAXumdbHN0.jar\022@465a7b19fb9214e04204674ef1a7f65f1ad3cf92ea690ab048c017ba675b1cdd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n7jaccess-Rlp7GfuSFOBCBGdO8af2XxrTz5LqaQqwSMAXumdbHN0.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\nI/tmp/artifacts/localedata-Nuzln2shadVmT-PppqaNc7GHBbUyMUb9pXsJTjRiAzs.jar\022@36ece59f6b2169d5664fe3e9a6a68d73b18705b5323146fda57b094e3462033b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n:localedata-Nuzln2shadVmT-PppqaNc7GHBbUyMUb9pXsJTjRiAzs.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\nF/tmp/artifacts/nashorn-1iQRhJvU2nRCSB4ucg6f4b69TGiwE1yq0_LGG2MU5N0.jar\022@d62411849bd4da7442481e2e720e9fe1bebd4c68b0135caad3f2c61b6314e4dd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n7nashorn-1iQRhJvU2nRCSB4ucg6f4b69TGiwE1yq0_LGG2MU5N0.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\nG/tmp/artifacts/cldrdata-MTK3mMuUzlWYlYkweGQNzI7dFpuLG0_8F8oxT0khQDc.jar\022@3132b798cb94ce559895893078640dcc8edd169b8b1b4ffc17ca314f49214037"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\n8cldrdata-MTK3mMuUzlWYlYkweGQNzI7dFpuLG0_8F8oxT0khQDc.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\nD/tmp/artifacts/dnsns-YTF3f6B-OG4FmXLRf2ckHBi4VJnspBZTyIQCz-6Spwk.jar\022@6131777fa07e386e059972d17f67241c18b85499eca41653c88402cfee92a709"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-YTF3f6B-OG4FmXLRf2ckHBi4VJnspBZTyIQCz-6Spwk.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.45.0-SNAPSHOT-H50RVn48EsJB01JRFO23Nu-Wp4eL4RYY63htl7wKQtw.jar\022@1f9d11567e3c12c241d3525114edb736ef96a7878be11618eb786d97bc0a42dc"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.45.0-SNAPSHOT-H50RVn48EsJB01JRFO23Nu-Wp4eL4RYY63htl7wKQtw.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/12/08 23:23:27 Cross-compiling
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go>
as /tmp/worker-4-1670541807827936531
2022/12/08 23:23:29 Prepared job with id:
go-testjdbcio_postgresreadwrite-243-94c5b987-b6e7-4452-9df5-d6a61008192d and
staging token:
go-testjdbcio_postgresreadwrite-243-94c5b987-b6e7-4452-9df5-d6a61008192d
2022/12/08 23:23:30 Staged binary artifact with token:
2022/12/08 23:23:30 Submitted job:
go-testjdbcio_postgresreadwrite-243-94c5b987-b6e7-4452-9df5-d6a61008192d
2022/12/08 23:23:30 2022-12-08 23:23:30. (1): Default Python SDK image for
environment is apache/beam_python3.7_sdk:2.45.0.dev
2022/12/08 23:23:30 Job state: STOPPED
2022/12/08 23:23:30 Job state: STARTING
2022/12/08 23:23:30 Job state: RUNNING
2022/12/08 23:23:30 2022-12-08 23:23:30. (2): ==================== <function
annotate_downstream_side_inputs at 0x7efd3cae2b90> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (3): ==================== <function
fix_side_input_pcoll_coders at 0x7efd3cae2cb0> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (4): ==================== <function
pack_combiners at 0x7efd3cae4200> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (5): ==================== <function
lift_combiners at 0x7efd3cae4290> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (6): ==================== <function
expand_sdf at 0x7efd3cae4440> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (7): ==================== <function
expand_gbk at 0x7efd3cae44d0> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (8): ==================== <function
sink_flattens at 0x7efd3cae45f0> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (9): ==================== <function
greedily_fuse at 0x7efd3cae4680> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (10): ==================== <function
read_to_impulse at 0x7efd3cae4710> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (11): ==================== <function
impulse_to_input at 0x7efd3cae47a0> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (12): ==================== <function
sort_stages at 0x7efd3cae49e0> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (13): ==================== <function
add_impulse_to_dangling_transforms at 0x7efd3cae4b00> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (14): ==================== <function
setup_timer_mapping at 0x7efd3cae4950> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (15): ==================== <function
populate_data_channel_coders at 0x7efd3cae4a70> ====================
2022/12/08 23:23:30 2022-12-08 23:23:30. (16): starting control server on port
40245
2022/12/08 23:23:30 2022-12-08 23:23:30. (17): starting data server on port
34449
2022/12/08 23:23:30 2022-12-08 23:23:30. (18): starting state server on port
39223
2022/12/08 23:23:30 2022-12-08 23:23:30. (19): starting logging server on port
35375
2022/12/08 23:23:30 2022-12-08 23:23:30. (20): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7efd3c0661d0> for environment GDCqfzqKCKbeam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
2022/12/08 23:23:30 2022-12-08 23:23:30. (21): Attempting to pull image
apache/beam_java8_sdk:2.45.0.dev
2022/12/08 23:23:31 2022-12-08 23:23:31. (22): Unable to pull image
apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
2022/12/08 23:23:32 2022-12-08 23:23:32. (23): Waiting for docker to start up.
Current status is running
2022/12/08 23:23:32 2022-12-08 23:23:32. (24): Docker container is running.
container_id =
b'9ea389183d84cc093a8c8b83108d0306ad36f343ebb90ef7e2328a1b547997ad', worker_id
= worker_17
2022/12/08 23:23:34 2022-12-08 23:23:34. (25): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7efd3c078250> for environment go (beam:env:docker:v1,
b'\n\x16apache/beam_go_sdk:dev')
2022/12/08 23:23:36 2022-12-08 23:23:36. (26): Attempting to pull image
apache/beam_go_sdk:dev
2022/12/08 23:23:36 2022-12-08 23:23:36. (27): Unable to pull image
apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/12/08 23:23:40 2022-12-08 23:23:40. (28): Waiting for docker to start up.
Current status is running
2022/12/08 23:23:40 2022-12-08 23:23:40. (29): Docker container is running.
container_id =
b'72d4fb43254866b5b4a99346e961019a2fdc865c09176075153b6205585e9d8a', worker_id
= worker_19
2022/12/08 23:23:44 2022-12-08 23:23:44. (30): Completed job in
14.54659914970398 seconds with state DONE.
2022/12/08 23:23:44 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (42.05s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
101.054s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:307: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.031s
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:extensions:sql:compileJava'.
> Compilation failed; see the compiler error output for details.
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m 30s
241 actionable tasks: 182 executed, 47 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/urcx3qtaf44pe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
