[ 
https://issues.apache.org/jira/browse/BAHIR-122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102650#comment-16102650
 ] 

ASF GitHub Bot commented on BAHIR-122:
--------------------------------------

Github user ire7715 commented on the issue:

    https://github.com/apache/bahir/pull/48
  
    Thanks @ckadner for reviewing 😄 
    
    ### Re: not-force pushing
    Since it is preferable to push changes as other commit, and the PR will be 
squashed when merging. I had recovered the origin commits, and made the last 
changes as new commits (including 
[f538342](https://github.com/apache/bahir/pull/48/commits/f5383429de100c3edbb4ccd58602f3d088fceed8),
 
[a5fd1a3](https://github.com/apache/bahir/pull/48/commits/a5fd1a314b5eec6313f2aa42648849536959db0f)
 and 
[efc0cdd](https://github.com/apache/bahir/pull/48/commits/efc0cdde76edfb11ab595ce0098a159612ef35dc)).
    
    ### Re: Invalid paths suppose to be an error not an ignorant
    You are right, didn't think about it. I made the test case do not check if 
the file existence anymore, and instead let the `ServiceAccountCredentials` 
check the file existence at construction. If the file is not existed, just 
raise a FileNotFoundException.
    
    ### Generate a key file for Jenkins PR builder
    I would love to do it! But it might be a little absurd. Here is my points:
    1. There is `org.apache.spark.streaming.pubsub.PubsubTestUtils` which 
already uses environment variables to get the GCP project and json/p12 key 
files. I guess there is a set of key files are set on the Jenkins server 
already? Or the origin PubsubTestUtils didn't turned on by the environment 
variable `ENABLE_PUBSUB_TESTS`?
    2. I might be the wrong person to generate the key files. Since I am not a 
member in the project, if I generated the key files today, and somehow someday 
I accidentally deleted the key file (or my Google account just got banned). The 
key would be no use at all, and it could be hard for you to contact me. Maybe 
there is a Google account for this Jenkins server, that you may generate the 
key file with it?
    If I misunderstand you or there is anything wrong please tell me.
    
    #### To generate a service account key file
    1. Go to [Google API Console](console.developers.google.com)
    2. Choose the `Credentials` Tab> `Create credentials` button> `Service 
account key`
    3. Fill the form to create one. I did twice, one for JSON key file, another 
for P12.


> [PubSub] Make "ServiceAccountCredentials" really broadcastable
> --------------------------------------------------------------
>
>                 Key: BAHIR-122
>                 URL: https://issues.apache.org/jira/browse/BAHIR-122
>             Project: Bahir
>          Issue Type: Improvement
>          Components: Spark Streaming Connectors
>            Reporter: Ire Sun
>
> The origin implementation broadcast the key file path to Spark cluster, then 
> the executor read key file with the broadcasted path. Which is absurd, if you 
> are using a shared Spark cluster in a group/company, you certainly not want 
> to (and have no right to) put your key file on each instance of the cluster.
> If you store the key file on driver node and submit your job to a remote 
> cluster. You would get the following warning:
> {{WARN ReceiverTracker: Error reported by receiver for stream 0: Failed to 
> pull messages - java.io.FileNotFoundException}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to