See
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/1156/display/redirect>
------------------------------------------
[...truncated 296.47 KB...]
"step_name": "s19"
},
"serialized_fn":
"ref_AppliedPTransform_WriteUserScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)_34",
"user_name":
"WriteUserScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)"
}
}
],
"type": "JOB_TYPE_STREAMING"
}
root: INFO: Create job: <Job
createTime: '2019-06-17T06:02:00.579369Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2019-06-16_23_01_59-14443068769864933530'
location: 'us-central1'
name: 'beamapp-jenkins-0617060124-312752'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2019-06-17T06:02:00.579369Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
root: INFO: Created job with id: [2019-06-16_23_01_59-14443068769864933530]
root: INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_01_59-14443068769864933530?project=apache-beam-testing
root: INFO: Job 2019-06-16_23_01_59-14443068769864933530 is in state
JOB_STATE_RUNNING
root: INFO: 2019-06-17T06:02:03.133Z: JOB_MESSAGE_DETAILED: Checking
permissions granted to controller Service Account.
root: INFO: 2019-06-17T06:02:03.722Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-4 in us-central1-a.
root: INFO: 2019-06-17T06:02:04.153Z: JOB_MESSAGE_DETAILED: Expanding
SplittableParDo operations into optimizable parts.
root: INFO: 2019-06-17T06:02:04.155Z: JOB_MESSAGE_DETAILED: Expanding
CollectionToSingleton operations into optimizable parts.
root: INFO: 2019-06-17T06:02:04.163Z: JOB_MESSAGE_DETAILED: Expanding
CoGroupByKey operations into optimizable parts.
root: INFO: 2019-06-17T06:02:04.175Z: JOB_MESSAGE_DETAILED: Expanding
SplittableProcessKeyed operations into optimizable parts.
root: INFO: 2019-06-17T06:02:04.177Z: JOB_MESSAGE_DETAILED: Expanding
GroupByKey operations into streaming Read/Write steps
root: INFO: 2019-06-17T06:02:04.185Z: JOB_MESSAGE_DEBUG: Annotating graph with
Autotuner information.
root: INFO: 2019-06-17T06:02:04.197Z: JOB_MESSAGE_DETAILED: Fusing adjacent
ParDo, Read, Write, and Flatten operations
root: INFO: 2019-06-17T06:02:04.200Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateUserScores/LeaderboardUserGlobalWindows into AddEventTimestamps
root: INFO: 2019-06-17T06:02:04.202Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateTeamScores/LeaderboardTeamFixedWindows into AddEventTimestamps
root: INFO: 2019-06-17T06:02:04.204Z: JOB_MESSAGE_DETAILED: Fusing consumer
AddEventTimestamps into ParseGameEventFn
root: INFO: 2019-06-17T06:02:04.206Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets
into
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream
root: INFO: 2019-06-17T06:02:04.208Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateUserScores/ExtractAndSumScore/Map(<lambda at leader_board.py:147>)
into CalculateUserScores/LeaderboardUserGlobalWindows
root: INFO: 2019-06-17T06:02:04.210Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream
into CalculateTeamScores/ExtractAndSumScore/Map(<lambda at
leader_board.py:147>)
root: INFO: 2019-06-17T06:02:04.212Z: JOB_MESSAGE_DETAILED: Fusing consumer
WriteTeamScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn) into
WriteTeamScoreSums/WriteToBigQuery/AppendDestination
root: INFO: 2019-06-17T06:02:04.214Z: JOB_MESSAGE_DETAILED: Fusing consumer
WriteUserScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn) into
WriteUserScoreSums/WriteToBigQuery/AppendDestination
root: INFO: 2019-06-17T06:02:04.216Z: JOB_MESSAGE_DETAILED: Fusing consumer
WriteUserScoreSums/WriteToBigQuery/AppendDestination into
WriteUserScoreSums/ConvertToRow
root: INFO: 2019-06-17T06:02:04.218Z: JOB_MESSAGE_DETAILED: Fusing consumer
WriteUserScoreSums/ConvertToRow into FormatUserScoreSums
root: INFO: 2019-06-17T06:02:04.220Z: JOB_MESSAGE_DETAILED: Fusing consumer
FormatUserScoreSums into
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine
root: INFO: 2019-06-17T06:02:04.222Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine into
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets
root: INFO: 2019-06-17T06:02:04.224Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets
into
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream
root: INFO: 2019-06-17T06:02:04.226Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream
into CalculateUserScores/ExtractAndSumScore/Map(<lambda at
leader_board.py:147>)
root: INFO: 2019-06-17T06:02:04.228Z: JOB_MESSAGE_DETAILED: Fusing consumer
DecodeString into ReadPubSub/Read
root: INFO: 2019-06-17T06:02:04.230Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateTeamScores/ExtractAndSumScore/Map(<lambda at leader_board.py:147>)
into CalculateTeamScores/LeaderboardTeamFixedWindows
root: INFO: 2019-06-17T06:02:04.232Z: JOB_MESSAGE_DETAILED: Fusing consumer
WriteTeamScoreSums/WriteToBigQuery/AppendDestination into
WriteTeamScoreSums/ConvertToRow
root: INFO: 2019-06-17T06:02:04.234Z: JOB_MESSAGE_DETAILED: Fusing consumer
WriteTeamScoreSums/ConvertToRow into TeamScoresDict
root: INFO: 2019-06-17T06:02:04.236Z: JOB_MESSAGE_DETAILED: Fusing consumer
ParseGameEventFn into DecodeString
root: INFO: 2019-06-17T06:02:04.238Z: JOB_MESSAGE_DETAILED: Fusing consumer
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine into
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets
root: INFO: 2019-06-17T06:02:04.240Z: JOB_MESSAGE_DETAILED: Fusing consumer
TeamScoresDict into
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine
root: INFO: 2019-06-17T06:02:04.250Z: JOB_MESSAGE_DEBUG: Adding StepResource
setup and teardown to workflow graph.
root: INFO: 2019-06-17T06:02:04.264Z: JOB_MESSAGE_DEBUG: Adding workflow start
and stop steps.
root: INFO: 2019-06-17T06:02:04.275Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-06-17T06:02:04.481Z: JOB_MESSAGE_DEBUG: Executing wait step
start2
root: INFO: 2019-06-17T06:02:04.493Z: JOB_MESSAGE_DEBUG: Starting worker pool
setup.
root: INFO: 2019-06-17T06:02:04.497Z: JOB_MESSAGE_BASIC: Starting 1 workers...
root: INFO: 2019-06-17T06:02:06.795Z: JOB_MESSAGE_BASIC: Executing operation
CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream+CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets+CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine+TeamScoresDict+WriteTeamScoreSums/ConvertToRow+WriteTeamScoreSums/WriteToBigQuery/AppendDestination+WriteTeamScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)
root: INFO: 2019-06-17T06:02:06.795Z: JOB_MESSAGE_BASIC: Executing operation
ReadPubSub/Read+DecodeString+ParseGameEventFn+AddEventTimestamps+CalculateUserScores/LeaderboardUserGlobalWindows+CalculateTeamScores/LeaderboardTeamFixedWindows+CalculateUserScores/ExtractAndSumScore/Map(<lambda
at
leader_board.py:147>)+CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream+CalculateTeamScores/ExtractAndSumScore/Map(<lambda
at
leader_board.py:147>)+CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream
root: INFO: 2019-06-17T06:02:06.795Z: JOB_MESSAGE_BASIC: Executing operation
CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream+CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets+CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine+FormatUserScoreSums+WriteUserScoreSums/ConvertToRow+WriteUserScoreSums/WriteToBigQuery/AppendDestination+WriteUserScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)
root: INFO: 2019-06-17T06:09:47.965Z: JOB_MESSAGE_DETAILED: Workers have
started successfully.
root: INFO: 2019-06-17T06:10:28.492Z: JOB_MESSAGE_DEBUG: Executing input step
topology_init_attach_disk_input_step
root: WARNING: Timing out on waiting for job
2019-06-16_23_01_59-14443068769864933530 after 601 seconds
root: INFO: Start verify Bigquery data.
google.auth.transport._http_client: DEBUG: Making request: GET
http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/project/project-id
urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3,
connect=None, read=None, redirect=None, status=None)
google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1):
metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1"
200 144
google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/[email protected]/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/[email protected]/token
HTTP/1.1" 200 176
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1):
www.googleapis.com:443
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
root: WARNING: Retry with exponential backoff: waiting for 3.5155264799465935
seconds before retrying _query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset1560751282.leader_board_users was
not found in location US
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 99, in _query_with_retry
return [row.values() for row in query_job]
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2718, in __iter__
return iter(self.result())
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2685, in result
super(QueryJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 697, in result
return super(_AsyncJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/future/polling.py";,>
line 127, in result
raise self._exception
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
root: WARNING: Retry with exponential backoff: waiting for 5.844446220449995
seconds before retrying _query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset1560751282.leader_board_users was
not found in location US
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 99, in _query_with_retry
return [row.values() for row in query_job]
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2718, in __iter__
return iter(self.result())
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2685, in result
super(QueryJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 697, in result
return super(_AsyncJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/future/polling.py";,>
line 127, in result
raise self._exception
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
root: WARNING: Retry with exponential backoff: waiting for 11.149426701257905
seconds before retrying _query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset1560751282.leader_board_users was
not found in location US
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 99, in _query_with_retry
return [row.values() for row in query_job]
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2718, in __iter__
return iter(self.result())
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2685, in result
super(QueryJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 697, in result
return super(_AsyncJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/future/polling.py";,>
line 127, in result
raise self._exception
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
root: WARNING: Retry with exponential backoff: waiting for 32.25755198367236
seconds before retrying _query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset1560751282.leader_board_users was
not found in location US
Traceback for above exception (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 99, in _query_with_retry
return [row.values() for row in query_job]
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2718, in __iter__
return iter(self.result())
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 2685, in result
super(QueryJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py";,>
line 697, in result
return super(_AsyncJob, self).result(timeout=timeout)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/future/polling.py";,>
line 127, in result
raise self._exception
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
google.auth.transport._http_client: DEBUG: Making request: GET
http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/project/project-id
urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3,
connect=None, read=None, redirect=None, status=None)
google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1):
metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1"
200 144
google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/[email protected]/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/[email protected]/token
HTTP/1.1" 200 176
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1):
www.googleapis.com:443
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "DELETE
/bigquery/v2/projects/apache-beam-testing/datasets/leader_board_it_dataset1560751282?deleteContents=true
HTTP/1.1" 204 0
--------------------- >> end captured logging << ---------------------
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_02_02-14965100133707495157?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1137:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_18_14-12073976460982928669?project=apache-beam-testing.
method_to_use = self._compute_method(p, p.options)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_27_06-12110528385088146414?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_38_02-7303831159112871515?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_01_59-16598485350573509011?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:687:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_21_26-17460354543881218025?project=apache-beam-testing.
kms_key=transform.kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_30_23-5875532058912915099?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_39_51-11603432091224045499?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_01_59-14443068769864933530?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1137:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_17_37-12358201973833153476?project=apache-beam-testing.
method_to_use = self._compute_method(p, p.options)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_25_33-3849324606536796413?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/fileio_test.py>:232:
FutureWarning: MatchAll is experimental.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_33_50-15814578945105142364?project=apache-beam-testing.
| 'GetPath' >> beam.Map(lambda metadata: metadata.path))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_47_01-10456466724413211361?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243:
FutureWarning: MatchAll is experimental.
| 'Checksums' >> beam.Map(compute_hash))
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243:
FutureWarning: ReadMatches is experimental.
| 'Checksums' >> beam.Map(compute_hash))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_01_59-7759097983769349543?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_23_41-17709272568144757907?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_34_28-3392198888282207813?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_01_58-12010286862652563737?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:687:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=transform.kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_11_54-8747128677987976655?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:73:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_20_16-12967361405674714659?project=apache-beam-testing.
kms_key=kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_28_38-11241393188034656376?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_37_55-3845707482478464440?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_02_01-816901396532911575?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:687:
BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use
WriteToBigQuery instead.
kms_key=transform.kms_key))
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_09_29-11444658111099927387?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1137:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
method_to_use = self._compute_method(p, p.options)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_20_05-16258112791689526558?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_29_15-18224671668338717255?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:545:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
or p.options.view_as(GoogleCloudOptions).temp_location)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_02_00-8012100314274916533?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_12_42-17797643508125803588?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1137:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
method_to_use = self._compute_method(p, p.options)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_22_15-5829164133293325765?project=apache-beam-testing.
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:545:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_32_08-7646875938888919341?project=apache-beam-testing.
or p.options.view_as(GoogleCloudOptions).temp_location)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_01_58-13584005698084445842?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_11_40-1203074902613381613?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_18_51-17913192208961889191?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_31_22-9400007105320705693?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_39_47-6241375430412777025?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-16_23_48_39-11275199142343843545?project=apache-beam-testing.
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 42 tests in 3328.649s
FAILED (SKIP=5, errors=1)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/test-suites/dataflow/py35/build.gradle'>
line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 56m 29s
77 actionable tasks: 60 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/r2pvffqdwnxua
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
