Ire Sun created BAHIR-122:
-----------------------------

             Summary: [PubSub] Make "ServiceAccountCredentials" really 
broadcastable
                 Key: BAHIR-122
                 URL: https://issues.apache.org/jira/browse/BAHIR-122
             Project: Bahir
          Issue Type: Improvement
          Components: Spark Streaming Connectors
            Reporter: Ire Sun


The origin implementation broadcast the key file path to Spark cluster, then 
the executor read key file with the broadcasted path. Which is absurd, if you 
are using a shared Spark cluster in a group/company, you certainly not want to 
(and have no right to) put your key file on each instance of the cluster.

If you store the key file on driver node and submit your job to a remote 
cluster. You would get the following warning:
{{WARN ReceiverTracker: Error reported by receiver for stream 0: Failed to pull 
messages - java.io.FileNotFoundException}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to