Kyle Krueger created BAHIR-224: ---------------------------------- Summary: Blank Pubsub Subscription Strings result in unclear exceptions Key: BAHIR-224 URL: https://issues.apache.org/jira/browse/BAHIR-224 Project: Bahir Issue Type: Bug Components: Spark Streaming Connectors Reporter: Kyle Krueger
Expected: An exception to be thrown when a Pubsub subscription fails. Result: If a blank pubsub subscription string is accidentally passed to PubsubUtils.createStream(), the subscription does not fail in an easy to handle way: instead, it fails later at PubsubInputDStream.receive(). This throws a massive amount of errors to logs by repeating the following. {quote}20/02/10 17:23:29 WARN org.apache.spark.streaming.scheduler.ReceiverTracker: Error reported by receiver for stream 2: Failed to pull messages - com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found { "code" : 404, "errors" : [ Unknown macro: \{ "domain" } ], "message" : "Resource not found (resource=null).", "status" : "NOT_FOUND" } at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321) at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469) at org.apache.spark.streaming.pubsub.PubsubReceiver.receive(PubsubInputDStream.scala:258) at org.apache.spark.streaming.pubsub.PubsubReceiver$$anon$1.run(PubsubInputDStream.scala:247) {quote} -- This message was sent by Atlassian Jira (v8.3.4#803005)