[
https://issues.apache.org/jira/browse/BEAM-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872493#comment-16872493
]
Juta Staes commented on BEAM-7195:
----------------------------------
This could be related to a flaky Python Post commit test
{code:java}
14:03:18 ERROR: test_multiple_destinations_transform
(apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests)
14:03:18 ----------------------------------------------------------------------
14:03:18 Traceback (most recent call last):
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/io/gcp/bigquery_test.py",
line 620, in test_multiple_destinations_transform
14:03:18 equal_to([(full_output_table_1, bad_record)]))
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/pipeline.py",
line 426, in __exit__
14:03:18 self.run().wait_until_finish()
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/pipeline.py",
line 406, in run
14:03:18 self._options).run(False)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/pipeline.py",
line 419, in run
14:03:18 return self.runner.run_pipeline(self, self._options)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",
line 70, in run_pipeline
14:03:18 hc_assert_that(self.result, pickler.loads(on_success_matcher))
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/hamcrest/core/assert_that.py",
line 43, in assert_that
14:03:18 _assert_match(actual=arg1, matcher=arg2, reason=arg3)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/hamcrest/core/assert_that.py",
line 49, in _assert_match
14:03:18 if not matcher.matches(actual):
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/hamcrest/core/core/allof.py",
line 16, in matches
14:03:18 if not matcher.matches(item):
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/hamcrest/core/base_matcher.py",
line 28, in matches
14:03:18 match_result = self._matches(item)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py",
line 140, in _matches
14:03:18 response = self._query_with_retry(bigquery_client)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/utils/retry.py",
line 210, in wrapper
14:03:18 raise_with_traceback(exn, exn_traceback)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/future/utils/__init__.py",
line 419, in raise_with_traceback
14:03:18 raise exc.with_traceback(traceback)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/utils/retry.py",
line 197, in wrapper
14:03:18 return fun(*args, **kwargs)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py",
line 155, in _query_with_retry
14:03:18 return [row.values() for row in query_job]
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py",
line 2718, in __iter__
14:03:18 return iter(self.result())
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py",
line 2685, in result
14:03:18 super(QueryJob, self).result(timeout=timeout)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/bigquery/job.py",
line 697, in result
14:03:18 return super(_AsyncJob, self).result(timeout=timeout)
14:03:18 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python3_Verify_PR/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/future/polling.py",
line 127, in result
14:03:18 raise self._exception
14:03:18 google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:python_bq_streaming_inserts_15614628312730.output_table1
was not found in location US
{code}
> BigQuery - 404 errors for 'table not found' when using dynamic destinations -
> sometimes, new table fails to get created
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-7195
> URL: https://issues.apache.org/jira/browse/BEAM-7195
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.5.0
> Environment: Windows
> Reporter: Chris
> Priority: Critical
>
> See the following StackOverflow question, which describes the details:
>
> [https://stackoverflow.com/questions/55932291/apache-beam-for-google-cloud-dataflow-404-errors-when-using-bigqueryio-write-c]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
