[ https://issues.apache.org/jira/browse/BEAM-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Per Böckman closed BEAM-8851. ----------------------------- Fix Version/s: 2.16.0 Resolution: Invalid Probably not a bug. Overflow in client code. > Dataflow BiqQuery TimePartitioning integer overflow > --------------------------------------------------- > > Key: BEAM-8851 > URL: https://issues.apache.org/jira/browse/BEAM-8851 > Project: Beam > Issue Type: Bug > Components: io-java-gcp > Affects Versions: 2.16.0 > Environment: GCP > Reporter: Per Böckman > Priority: Minor > Fix For: 2.16.0 > > > BigQueryIO.writeTableRows()....withTimePartitioning() seems to fail to create > a new BQ table if TimePartitioning expirationMs is bigger than max int. > TimePartitioning.setExpirationMs accepts a long and if the expiry time is set > to one month (86400 * 1000 * 30 = 2592000000 ms) the BQ server responds with > a 400 and the error indicates an integer overflow. > > exception: "org.apache.beam.sdk.util.UserCodeException: > java.lang.RuntimeException: > com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad > Request \{ "code" : 400, "errors" : [ { "domain" : "global", "message" : "TTL > for interval partition must be a positive number.", "reason" : "invalid" } ], > "message" : "TTL for interval partition must be a positive number.", "status" > : "INVALID_ARGUMENT" } > > at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:34) > at > org.apache.beam.sdk.io.gcp.bigquery.CreateTables$CreateTablesFn$DoFnInvoker.invokeProcessElement(Unknown > Source) at > org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:218) -- This message was sent by Atlassian Jira (v8.3.4#803005)