[
https://issues.apache.org/jira/browse/BEAM-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16729929#comment-16729929
]
Andrew Pilloud edited comment on BEAM-5874 at 12/27/18 11:00 PM:
-----------------------------------------------------------------
Still failing, looks like there are logs now.
https://builds.apache.org/job/beam_PostCommit_Python_Verify/6935/consoleFull
{code}
13:35:13 ======================================================================
13:35:13 FAIL: test_big_query_new_types
(apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT)
13:35:13 ----------------------------------------------------------------------
13:35:13 Traceback (most recent call last):
13:35:13 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_it_test.py",
line 169, in test_big_query_new_types
13:35:13 big_query_query_to_table_pipeline.run_bq_pipeline(options)
13:35:13 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py",
line 67, in run_bq_pipeline
13:35:13 result = p.run()
13:35:13 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/testing/test_pipeline.py",
line 107, in run
13:35:13 else test_runner_api))
13:35:13 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/pipeline.py",
line 418, in run
13:35:13 return self.runner.run_pipeline(self, self._options)
13:35:13 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/runners/direct/test_direct_runner.py",
line 51, in run_pipeline
13:35:13 hc_assert_that(self.result, pickler.loads(on_success_matcher))
13:35:13 AssertionError:
13:35:13 Expected: (Test pipeline expected terminated in state: DONE and
Expected checksum is e1fbcb5ca479a5ca5f9ecf444d6998beee4d44c6)
13:35:13 but:
13:35:13
13:35:13 -------------------- >> begin captured logging << --------------------
13:35:13 root: DEBUG: Connecting using Google Application Default Credentials.
13:35:13 oauth2client.transport: INFO: Attempting refresh to obtain initial
access_token
13:35:13 root: INFO: Running pipeline with DirectRunner.
13:35:13 root: DEBUG: Connecting using Google Application Default Credentials.
13:35:13 oauth2client.transport: INFO: Attempting refresh to obtain initial
access_token
13:35:13 root: INFO: Using location u'US' from table <TableReference
13:35:13 datasetId: u'python_query_to_table_15459464963764'
13:35:13 projectId: u'apache-beam-testing'
13:35:13 tableId: u'python_new_types_table'> referenced by query SELECT bytes,
date, time FROM [python_query_to_table_15459464963764.python_new_types_table]
13:35:13 root: WARNING: Dataset
apache-beam-testing:temp_dataset_75e3764ef1ad43c4bd8f97e311e56ee5 does not
exist so we will create it as temporary with location=US
13:35:13 root: DEBUG: Connecting using Google Application Default Credentials.
13:35:13 oauth2client.transport: INFO: Attempting refresh to obtain initial
access_token
13:35:13 root: DEBUG: Created the table with id output_table
13:35:13 root: INFO: Writing 3 rows to
apache-beam-testing:python_query_to_table_15459464963764.output_table table.
13:35:13 root: INFO: Start verify Bigquery data.
13:35:13 google.auth.transport._http_client: DEBUG: Making request: GET
http://169.254.169.254
13:35:13 google.auth.transport._http_client: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/project/project-id
13:35:13 urllib3.util.retry: DEBUG: Converted retries value: 3 ->
Retry(total=3, connect=None, read=None, redirect=None, status=None)
13:35:13 google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
13:35:13 urllib3.connectionpool: DEBUG: Starting new HTTP connection (1):
metadata.google.internal:80
13:35:13 urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1"
200 144
13:35:13 google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/[email protected]/token
13:35:13 urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/[email protected]/token
HTTP/1.1" 200 176
13:35:13 urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1):
www.googleapis.com:443
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET
/bigquery/v2/projects/apache-beam-testing/queries/c1216af9-8dad-4dc1-af7a-40c5bd6be45c?location=US&maxResults=0
HTTP/1.1" 200 None
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET
/bigquery/v2/projects/apache-beam-testing/jobs/c1216af9-8dad-4dc1-af7a-40c5bd6be45c?location=US
HTTP/1.1" 200 None
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET
/bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anon6c051a0dce73614f16def7c570d6156ef10b8e88/data
HTTP/1.1" 200 None
13:35:13 root: INFO: Read from given query (SELECT date FROM
`python_query_to_table_15459464963764.output_table`;), total rows 0
13:35:13 root: INFO: Generate checksum: da39a3ee5e6b4b0d3255bfef95601890afd80709
13:35:13 root: INFO: Start verify Bigquery data.
13:35:13 google.auth.transport._http_client: DEBUG: Making request: GET
http://169.254.169.254
13:35:13 google.auth.transport._http_client: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/project/project-id
13:35:13 urllib3.util.retry: DEBUG: Converted retries value: 3 ->
Retry(total=3, connect=None, read=None, redirect=None, status=None)
13:35:13 google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
13:35:13 urllib3.connectionpool: DEBUG: Starting new HTTP connection (1):
metadata.google.internal:80
13:35:13 urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1"
200 144
13:35:13 google.auth.transport.requests: DEBUG: Making request: GET
http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/[email protected]/token
13:35:13 urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET
/computeMetadata/v1/instance/service-accounts/[email protected]/token
HTTP/1.1" 200 176
13:35:13 urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1):
www.googleapis.com:443
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST
/bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET
/bigquery/v2/projects/apache-beam-testing/queries/394bade1-2e3d-4c78-a72c-15cc6d8ccab4?location=US&maxResults=0
HTTP/1.1" 200 None
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET
/bigquery/v2/projects/apache-beam-testing/jobs/394bade1-2e3d-4c78-a72c-15cc6d8ccab4?location=US
HTTP/1.1" 200 None
13:35:13 urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET
/bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anonfa226c3f_c99e_4597_99a7_d734be30ff4b/data
HTTP/1.1" 200 None
13:35:13 root: INFO: Read from given query (SELECT date FROM
`python_query_to_table_15459464963764.output_table`;), total rows 3
13:35:13 root: INFO: Generate checksum: e1fbcb5ca479a5ca5f9ecf444d6998beee4d44c6
13:35:13 --------------------- >> end captured logging << ---------------------
13:35:13
13:35:13 ----------------------------------------------------------------------
13:35:13 XML:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/nosetests.xml
13:35:13 ----------------------------------------------------------------------
13:35:13 Ran 7 tests in 23.737s
13:35:13
13:35:13 FAILED (failures=1)
{code}
was (Author: apilloud):
https://builds.apache.org/job/beam_PostCommit_Python_Verify/6935/consoleFull
> Python BQ directRunnerIT test fails with half-empty assertion
> -------------------------------------------------------------
>
> Key: BEAM-5874
> URL: https://issues.apache.org/jira/browse/BEAM-5874
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Henning Rohde
> Assignee: Charles Chen
> Priority: Major
>
> https://scans.gradle.com/s/2fd5wbm7vkkna/console-log?task=:beam-sdks-python:directRunnerIT#L147
> ======================================================================
> FAIL: test_big_query_new_types
> (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_it_test.py",
> line 169, in test_big_query_new_types
> big_query_query_to_table_pipeline.run_bq_pipeline(options)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py",
> line 67, in run_bq_pipeline
> result = p.run()
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/testing/test_pipeline.py",
> line 107, in run
> else test_runner_api))
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/pipeline.py",
> line 416, in run
> return self.runner.run_pipeline(self)
> File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/apache_beam/runners/direct/test_direct_runner.py",
> line 51, in run_pipeline
> hc_assert_that(self.result, pickler.loads(on_success_matcher))
> AssertionError:
> Expected: (Test pipeline expected terminated in state: DONE and Expected
> checksum is e1fbcb5ca479a5ca5f9ecf444d6998beee4d44c6)
> but:
> ----------------------------------------------------------------------
> XML:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Verify/src/sdks/python/nosetests.xml
> ----------------------------------------------------------------------
> Ran 7 tests in 24.434s
> FAILED (failures=1)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
