Re: [easybuild] Github integration failing: could not read from remote repository

2021-02-08 Thread Loris Bennett
Hi,

This sorted itself out.  I had created a new Github token and thought
that I had installed for EB, but today when I tried --check-github it
the token check failed.  I then installed the new token with --force
and, hey presto, everything worked again.

I'm not sure quite how I goofed.  Possibly I got muddled due to tmux
window overload.

Anyway, sorry for the noise.

Cheers,

Loris

Loris Bennett  writes:

> Hi Alan,
>
> I just have a fork of
>
>   easybuild-easyconfigs
>
> Do I need anything else to submit an EB?
>
> Cheers,
>
> Loris
>
> Alan O'Cais  writes:
>
>> Hi Loris, 
>>
>> Are you sure you have forked the various EB repos on GitHub with the account 
>> you are trying to use?
>>
>> Alan
>>
>> On Mon, 1 Feb 2021 at 14:27, Loris Bennett  
>> wrote:
>>
>>  I tried regenerating the github token and registering it, but I am still
>>  getting the same error
>>
>>fatal: Could not read from remote repository.
>>Please make sure you have the correct access rights
>>
>>  The github token has the scopes repo, workflow and gist.  Is anything
>>  else needed?
>>
>>  Or is the problem that EB is using SSH rather than HTTPS?
>>
>>  Cheers,
>>
>>  Loris
>>
>>  Åke Sandgren  writes:
>>
>>  > Yeah, I might have misread the actual problem.
>>  > Concentrating too much on the ongoing EUM'21...
>>  >
>>  > On 1/29/21 2:44 PM, Loris Bennett wrote:
>>  >> Hi Åke,
>>  >> 
>>  >> Åke Sandgren  writes:
>>  >> 
>>  >>> Looks like a problem with your github token, not your ssh key.
>>  >> 
>>  >> You may well be right.  In the GitHub docs it says
>>  >> 
>>  >>   Personal access tokens can only be used for HTTPS Git operations. If
>>  >>   your repository uses an SSH remote URL, you will need to switch the
>>  >>   remote from SSH to HTTPS.
>>  >> 
>>  >> but the error message
>>  >> 
>>  >>   Checking out branch \'master\' from 
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed:
>>  >> 
>>  >> implies that SSH is being used.  
>>  >> 
>>  >> Can I force the check and/or --new-pr to use HTTPS?
>>  >> 
>>  >> Cheers,
>>  >> 
>>  >> Loris
>>  >> 
>>  >>> On 1/29/21 1:20 PM, Loris Bennett wrote:
>>   Hi Jakob,
>>  
>>   Jakob Schiøtz  writes:
>>  
>>  > Hi Loris,
>>  >
>>  > I have seen problems like that if the right modules are not installed 
>> in the
>>  > Python installation used by Easybuild, i.e. the system-wide Python 
>> installation
>>  > (possibly a Python 2 installation).  It is something related to a 
>> keyring, but I
>>  > can no longer remember what it was.
>>  >
>>  > However, the error message makes it more likely to be your private 
>> key missing.
>>  > That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the 
>> PRIVATE key
>>  > must be available on your computer, the public key is on GitHub).
>>  
>>   Thanks for the suggestion, but everything is just in the standard 
>> place:
>>  
>>     [build@admin ~]$ ls -l ~/.ssh/
>>     total 16
>>     -rw--- 1 build staff 1272 May 12  2020 authorized_keys
>>     -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
>>     -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
>>     -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts
>>  
>>   And the public key is indeed the one on GitHub.  Moreover, the 
>> following works:
>>  
>>     [build@admin ~]$ ssh -T g...@github.com
>>     Hi mygithubusername! You've successfully authenticated, but GitHub 
>> does not provide shell access
>>  
>>   So I think the SSH setup is OK.
>>  
>>   Cheers,
>>  
>>   Loris
>>  
>>  >
>>  > Jakob
>>  >
>>  >
>>  >
>>  >
>>  > --
>>  > Jakob Schiøtz, professor, Ph.D.
>>  > Department of Physics
>>  > Technical University of Denmark
>>  > DK-2800 Kongens Lyngby, Denmark
>>  > http://www.fysik.dtu.dk/~schiotz/
>>  >
>>  >
>>  >
>>  >> On 29 Jan 2021, at 08.55, Loris Bennett  
>> wrote:
>>  >>
>>  >> Hi,
>>  >>
>>  >> My GitHub integration is failing:
>>  >>
>>  >>  * GitHub user...mygithubusername => OK
>>  >>  Please enter password for encrypted keyring: * GitHub token...
>>  >>  18b..089 (len: 40) => OK (validated)
>>  >>  * git command...OK ("git version 1.8.3.1; ")
>>  >>  * GitPython module...OK (GitPython version 2.1.15)
>>  >>  * push access to mygithubusername/easybuild-easyconfigs repo @
>>  >> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' 
>> from
>>  >> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: 
>> "Failed to
>>  >> fetch branch \'master\' from
>>  >> g...@github.com:mygithubusername/easybuild-easyconfigs.git: 
>> Cmd(\'git\')
>>  >> failed due to: exit code(128)\\n cmdline: git fetch -v
>>  >> pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could 
>> not read
>>  >> from remote 

Re: [easybuild] Github integration failing: could not read from remote repository

2021-02-01 Thread Loris Bennett
Hi Alan,

I just have a fork of

  easybuild-easyconfigs

Do I need anything else to submit an EB?

Cheers,

Loris

Alan O'Cais  writes:

> Hi Loris, 
>
> Are you sure you have forked the various EB repos on GitHub with the account 
> you are trying to use?
>
> Alan
>
> On Mon, 1 Feb 2021 at 14:27, Loris Bennett  wrote:
>
>  I tried regenerating the github token and registering it, but I am still
>  getting the same error
>
>fatal: Could not read from remote repository.
>Please make sure you have the correct access rights
>
>  The github token has the scopes repo, workflow and gist.  Is anything
>  else needed?
>
>  Or is the problem that EB is using SSH rather than HTTPS?
>
>  Cheers,
>
>  Loris
>
>  Åke Sandgren  writes:
>
>  > Yeah, I might have misread the actual problem.
>  > Concentrating too much on the ongoing EUM'21...
>  >
>  > On 1/29/21 2:44 PM, Loris Bennett wrote:
>  >> Hi Åke,
>  >> 
>  >> Åke Sandgren  writes:
>  >> 
>  >>> Looks like a problem with your github token, not your ssh key.
>  >> 
>  >> You may well be right.  In the GitHub docs it says
>  >> 
>  >>   Personal access tokens can only be used for HTTPS Git operations. If
>  >>   your repository uses an SSH remote URL, you will need to switch the
>  >>   remote from SSH to HTTPS.
>  >> 
>  >> but the error message
>  >> 
>  >>   Checking out branch \'master\' from 
> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed:
>  >> 
>  >> implies that SSH is being used.  
>  >> 
>  >> Can I force the check and/or --new-pr to use HTTPS?
>  >> 
>  >> Cheers,
>  >> 
>  >> Loris
>  >> 
>  >>> On 1/29/21 1:20 PM, Loris Bennett wrote:
>   Hi Jakob,
>  
>   Jakob Schiøtz  writes:
>  
>  > Hi Loris,
>  >
>  > I have seen problems like that if the right modules are not installed 
> in the
>  > Python installation used by Easybuild, i.e. the system-wide Python 
> installation
>  > (possibly a Python 2 installation).  It is something related to a 
> keyring, but I
>  > can no longer remember what it was.
>  >
>  > However, the error message makes it more likely to be your private key 
> missing.
>  > That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the 
> PRIVATE key
>  > must be available on your computer, the public key is on GitHub).
>  
>   Thanks for the suggestion, but everything is just in the standard place:
>  
>     [build@admin ~]$ ls -l ~/.ssh/
>     total 16
>     -rw--- 1 build staff 1272 May 12  2020 authorized_keys
>     -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
>     -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
>     -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts
>  
>   And the public key is indeed the one on GitHub.  Moreover, the 
> following works:
>  
>     [build@admin ~]$ ssh -T g...@github.com
>     Hi mygithubusername! You've successfully authenticated, but GitHub 
> does not provide shell access
>  
>   So I think the SSH setup is OK.
>  
>   Cheers,
>  
>   Loris
>  
>  >
>  > Jakob
>  >
>  >
>  >
>  >
>  > --
>  > Jakob Schiøtz, professor, Ph.D.
>  > Department of Physics
>  > Technical University of Denmark
>  > DK-2800 Kongens Lyngby, Denmark
>  > http://www.fysik.dtu.dk/~schiotz/
>  >
>  >
>  >
>  >> On 29 Jan 2021, at 08.55, Loris Bennett  
> wrote:
>  >>
>  >> Hi,
>  >>
>  >> My GitHub integration is failing:
>  >>
>  >>  * GitHub user...mygithubusername => OK
>  >>  Please enter password for encrypted keyring: * GitHub token...
>  >>  18b..089 (len: 40) => OK (validated)
>  >>  * git command...OK ("git version 1.8.3.1; ")
>  >>  * GitPython module...OK (GitPython version 2.1.15)
>  >>  * push access to mygithubusername/easybuild-easyconfigs repo @
>  >> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' 
> from
>  >> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: 
> "Failed to
>  >> fetch branch \'master\' from
>  >> g...@github.com:mygithubusername/easybuild-easyconfigs.git: 
> Cmd(\'git\')
>  >> failed due to: exit code(128)\\n cmdline: git fetch -v
>  >> pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could 
> not read
>  >> from remote repository.\\n\\nPlease make sure you have the correct 
> access
>  >> rights\\nand the repository exists.\'"')
>  >>  * creating gists...OK
>  >>  * location to Git working dirs... OK (~/git)
>  >>
>  >> This has worked in the past.
>  >>
>  >> Any ideas?
>  >>
>  >> Cheers,
>  >>
>  >> Loris
>  >>
>  >> -- 
>  >> Dr. Loris Bennett (Hr./Mr.)
>  >> ZEDAT, Freie Universität Berlin Email 
> loris.benn...@fu-berlin.de
>  >
-- 
Dr. Loris Bennett (Hr./Mr.)
ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de


Re: [easybuild] Github integration failing: could not read from remote repository

2021-02-01 Thread Alan O'Cais
Hi Loris,

Are you sure you have forked the various EB repos on GitHub with the account 
you are trying to use?

Alan

On Mon, 1 Feb 2021 at 14:27, Loris Bennett 
mailto:loris.benn...@fu-berlin.de>> wrote:
I tried regenerating the github token and registering it, but I am still
getting the same error

  fatal: Could not read from remote repository.
  Please make sure you have the correct access rights

The github token has the scopes repo, workflow and gist.  Is anything
else needed?

Or is the problem that EB is using SSH rather than HTTPS?

Cheers,

Loris


Åke Sandgren mailto:ake.sandg...@hpc2n.umu.se>> 
writes:

> Yeah, I might have misread the actual problem.
> Concentrating too much on the ongoing EUM'21...
>
> On 1/29/21 2:44 PM, Loris Bennett wrote:
>> Hi Åke,
>>
>> Åke Sandgren mailto:ake.sandg...@hpc2n.umu.se>> 
>> writes:
>>
>>> Looks like a problem with your github token, not your ssh key.
>>
>> You may well be right.  In the GitHub docs it says
>>
>>   Personal access tokens can only be used for HTTPS Git operations. If
>>   your repository uses an SSH remote URL, you will need to switch the
>>   remote from SSH to HTTPS.
>>
>> but the error message
>>
>>   Checking out branch \'master\' from 
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed:
>>
>> implies that SSH is being used.
>>
>> Can I force the check and/or --new-pr to use HTTPS?
>>
>> Cheers,
>>
>> Loris
>>
>>> On 1/29/21 1:20 PM, Loris Bennett wrote:
 Hi Jakob,

 Jakob Schiøtz mailto:schi...@fysik.dtu.dk>> writes:

> Hi Loris,
>
> I have seen problems like that if the right modules are not installed in 
> the
> Python installation used by Easybuild, i.e. the system-wide Python 
> installation
> (possibly a Python 2 installation).  It is something related to a 
> keyring, but I
> can no longer remember what it was.
>
> However, the error message makes it more likely to be your private key 
> missing.
> That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the 
> PRIVATE key
> must be available on your computer, the public key is on GitHub).

 Thanks for the suggestion, but everything is just in the standard place:

   [build@admin ~]$ ls -l ~/.ssh/
   total 16
   -rw--- 1 build staff 1272 May 12  2020 authorized_keys
   -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
   -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
   -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts

 And the public key is indeed the one on GitHub.  Moreover, the following 
 works:

   [build@admin ~]$ ssh -T g...@github.com
   Hi mygithubusername! You've successfully authenticated, but GitHub does 
 not provide shell access

 So I think the SSH setup is OK.

 Cheers,

 Loris

>
> Jakob
>
>
>
>
> --
> Jakob Schiøtz, professor, Ph.D.
> Department of Physics
> Technical University of Denmark
> DK-2800 Kongens Lyngby, Denmark
> http://www.fysik.dtu.dk/~schiotz/
>
>
>
>> On 29 Jan 2021, at 08.55, Loris Bennett 
>> mailto:loris.benn...@fu-berlin.de>> wrote:
>>
>> Hi,
>>
>> My GitHub integration is failing:
>>
>>  * GitHub user...mygithubusername => OK
>>  Please enter password for encrypted keyring: * GitHub token...
>>  18b..089 (len: 40) => OK (validated)
>>  * git command...OK ("git version 1.8.3.1; ")
>>  * GitPython module...OK (GitPython version 2.1.15)
>>  * push access to mygithubusername/easybuild-easyconfigs repo @
>> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: 
>> "Failed to
>> fetch branch \'master\' from
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\')
>> failed due to: exit code(128)\\n cmdline: git fetch -v
>> pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could not 
>> read
>> from remote repository.\\n\\nPlease make sure you have the correct access
>> rights\\nand the repository exists.\'"')
>>  * creating gists...OK
>>  * location to Git working dirs... OK (~/git)
>>
>> This has worked in the past.
>>
>> Any ideas?
>>
>> Cheers,
>>
>> Loris
>>
>> --
>> Dr. Loris Bennett (Hr./Mr.)
>> ZEDAT, Freie Universität Berlin Email 
>> loris.benn...@fu-berlin.de
>


--
Dr. Alan O'Cais
E-CAM Software Manager
Juelich Supercomputing Centre
Forschungszentrum Juelich GmbH
52425 Juelich, Germany

Phone: +49 2461 61 5213
Fax: +49 2461 61 6656
E-mail: a.oc...@fz-juelich.de
WWW:http://www.fz-juelich.de/ias/jsc/EN




Re: [easybuild] Github integration failing: could not read from remote repository

2021-02-01 Thread Loris Bennett
I tried regenerating the github token and registering it, but I am still
getting the same error

  fatal: Could not read from remote repository.
  Please make sure you have the correct access rights

The github token has the scopes repo, workflow and gist.  Is anything
else needed?

Or is the problem that EB is using SSH rather than HTTPS?

Cheers,

Loris


Åke Sandgren  writes:

> Yeah, I might have misread the actual problem.
> Concentrating too much on the ongoing EUM'21...
>
> On 1/29/21 2:44 PM, Loris Bennett wrote:
>> Hi Åke,
>> 
>> Åke Sandgren  writes:
>> 
>>> Looks like a problem with your github token, not your ssh key.
>> 
>> You may well be right.  In the GitHub docs it says
>> 
>>   Personal access tokens can only be used for HTTPS Git operations. If
>>   your repository uses an SSH remote URL, you will need to switch the
>>   remote from SSH to HTTPS.
>> 
>> but the error message
>> 
>>   Checking out branch \'master\' from 
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed:
>> 
>> implies that SSH is being used.  
>> 
>> Can I force the check and/or --new-pr to use HTTPS?
>> 
>> Cheers,
>> 
>> Loris
>> 
>>> On 1/29/21 1:20 PM, Loris Bennett wrote:
 Hi Jakob,

 Jakob Schiøtz  writes:

> Hi Loris,
>
> I have seen problems like that if the right modules are not installed in 
> the
> Python installation used by Easybuild, i.e. the system-wide Python 
> installation
> (possibly a Python 2 installation).  It is something related to a 
> keyring, but I
> can no longer remember what it was.
>
> However, the error message makes it more likely to be your private key 
> missing.
> That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the 
> PRIVATE key
> must be available on your computer, the public key is on GitHub).

 Thanks for the suggestion, but everything is just in the standard place:

   [build@admin ~]$ ls -l ~/.ssh/
   total 16
   -rw--- 1 build staff 1272 May 12  2020 authorized_keys
   -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
   -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
   -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts

 And the public key is indeed the one on GitHub.  Moreover, the following 
 works:

   [build@admin ~]$ ssh -T g...@github.com
   Hi mygithubusername! You've successfully authenticated, but GitHub does 
 not provide shell access

 So I think the SSH setup is OK.

 Cheers,

 Loris

>
> Jakob
>
>
>
>
> --
> Jakob Schiøtz, professor, Ph.D.
> Department of Physics
> Technical University of Denmark
> DK-2800 Kongens Lyngby, Denmark
> http://www.fysik.dtu.dk/~schiotz/
>
>
>
>> On 29 Jan 2021, at 08.55, Loris Bennett  
>> wrote:
>>
>> Hi,
>>
>> My GitHub integration is failing:
>>
>>  * GitHub user...mygithubusername => OK
>>  Please enter password for encrypted keyring: * GitHub token...
>>  18b..089 (len: 40) => OK (validated)
>>  * git command...OK ("git version 1.8.3.1; ")
>>  * GitPython module...OK (GitPython version 2.1.15)
>>  * push access to mygithubusername/easybuild-easyconfigs repo @
>> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: 
>> "Failed to
>> fetch branch \'master\' from
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\')
>> failed due to: exit code(128)\\n cmdline: git fetch -v
>> pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could not 
>> read
>> from remote repository.\\n\\nPlease make sure you have the correct access
>> rights\\nand the repository exists.\'"')
>>  * creating gists...OK
>>  * location to Git working dirs... OK (~/git)
>>
>> This has worked in the past.
>>
>> Any ideas?
>>
>> Cheers,
>>
>> Loris
>>
>> -- 
>> Dr. Loris Bennett (Hr./Mr.)
>> ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de
>


Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Åke Sandgren
Yeah, I might have misread the actual problem.
Concentrating too much on the ongoing EUM'21...

On 1/29/21 2:44 PM, Loris Bennett wrote:
> Hi Åke,
> 
> Åke Sandgren  writes:
> 
>> Looks like a problem with your github token, not your ssh key.
> 
> You may well be right.  In the GitHub docs it says
> 
>   Personal access tokens can only be used for HTTPS Git operations. If
>   your repository uses an SSH remote URL, you will need to switch the
>   remote from SSH to HTTPS.
> 
> but the error message
> 
>   Checking out branch \'master\' from 
> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed:
> 
> implies that SSH is being used.  
> 
> Can I force the check and/or --new-pr to use HTTPS?
> 
> Cheers,
> 
> Loris
> 
>> On 1/29/21 1:20 PM, Loris Bennett wrote:
>>> Hi Jakob,
>>>
>>> Jakob Schiøtz  writes:
>>>
 Hi Loris,

 I have seen problems like that if the right modules are not installed in 
 the
 Python installation used by Easybuild, i.e. the system-wide Python 
 installation
 (possibly a Python 2 installation).  It is something related to a keyring, 
 but I
 can no longer remember what it was.

 However, the error message makes it more likely to be your private key 
 missing.
 That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the PRIVATE 
 key
 must be available on your computer, the public key is on GitHub).
>>>
>>> Thanks for the suggestion, but everything is just in the standard place:
>>>
>>>   [build@admin ~]$ ls -l ~/.ssh/
>>>   total 16
>>>   -rw--- 1 build staff 1272 May 12  2020 authorized_keys
>>>   -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
>>>   -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
>>>   -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts
>>>
>>> And the public key is indeed the one on GitHub.  Moreover, the following 
>>> works:
>>>
>>>   [build@admin ~]$ ssh -T g...@github.com
>>>   Hi mygithubusername! You've successfully authenticated, but GitHub does 
>>> not provide shell access
>>>
>>> So I think the SSH setup is OK.
>>>
>>> Cheers,
>>>
>>> Loris
>>>

 Jakob




 --
 Jakob Schiøtz, professor, Ph.D.
 Department of Physics
 Technical University of Denmark
 DK-2800 Kongens Lyngby, Denmark
 http://www.fysik.dtu.dk/~schiotz/



> On 29 Jan 2021, at 08.55, Loris Bennett  
> wrote:
>
> Hi,
>
> My GitHub integration is failing:
>
>  * GitHub user...mygithubusername => OK
>  Please enter password for encrypted keyring: * GitHub token...
>  18b..089 (len: 40) => OK (validated)
>  * git command...OK ("git version 1.8.3.1; ")
>  * GitPython module...OK (GitPython version 2.1.15)
>  * push access to mygithubusername/easybuild-easyconfigs repo @
> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from
> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: 
> "Failed to
> fetch branch \'master\' from
> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\')
> failed due to: exit code(128)\\n cmdline: git fetch -v
> pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could not 
> read
> from remote repository.\\n\\nPlease make sure you have the correct access
> rights\\nand the repository exists.\'"')
>  * creating gists...OK
>  * location to Git working dirs... OK (~/git)
>
> This has worked in the past.
>
> Any ideas?
>
> Cheers,
>
> Loris
>
> -- 
> Dr. Loris Bennett (Hr./Mr.)
> ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de


-- 
Ake Sandgren, HPC2N, Umea University, S-90187 Umea, Sweden
Internet: a...@hpc2n.umu.se   Phone: +46 90 7866134 Fax: +46 90-580 14
Mobile: +46 70 7716134 WWW: http://www.hpc2n.umu.se


Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Loris Bennett
Hi Åke,

Åke Sandgren  writes:

> Looks like a problem with your github token, not your ssh key.

You may well be right.  In the GitHub docs it says

  Personal access tokens can only be used for HTTPS Git operations. If
  your repository uses an SSH remote URL, you will need to switch the
  remote from SSH to HTTPS.

but the error message

  Checking out branch \'master\' from 
g...@github.com:mygithubusername/easybuild-easyconfigs.git failed:

implies that SSH is being used.  

Can I force the check and/or --new-pr to use HTTPS?

Cheers,

Loris

> On 1/29/21 1:20 PM, Loris Bennett wrote:
>> Hi Jakob,
>> 
>> Jakob Schiøtz  writes:
>> 
>>> Hi Loris,
>>>
>>> I have seen problems like that if the right modules are not installed in the
>>> Python installation used by Easybuild, i.e. the system-wide Python 
>>> installation
>>> (possibly a Python 2 installation).  It is something related to a keyring, 
>>> but I
>>> can no longer remember what it was.
>>>
>>> However, the error message makes it more likely to be your private key 
>>> missing.
>>> That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the PRIVATE 
>>> key
>>> must be available on your computer, the public key is on GitHub).
>> 
>> Thanks for the suggestion, but everything is just in the standard place:
>> 
>>   [build@admin ~]$ ls -l ~/.ssh/
>>   total 16
>>   -rw--- 1 build staff 1272 May 12  2020 authorized_keys
>>   -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
>>   -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
>>   -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts
>> 
>> And the public key is indeed the one on GitHub.  Moreover, the following 
>> works:
>> 
>>   [build@admin ~]$ ssh -T g...@github.com
>>   Hi mygithubusername! You've successfully authenticated, but GitHub does 
>> not provide shell access
>> 
>> So I think the SSH setup is OK.
>> 
>> Cheers,
>> 
>> Loris
>> 
>>>
>>> Jakob
>>>
>>>
>>>
>>>
>>> --
>>> Jakob Schiøtz, professor, Ph.D.
>>> Department of Physics
>>> Technical University of Denmark
>>> DK-2800 Kongens Lyngby, Denmark
>>> http://www.fysik.dtu.dk/~schiotz/
>>>
>>>
>>>
 On 29 Jan 2021, at 08.55, Loris Bennett  wrote:

 Hi,

 My GitHub integration is failing:

  * GitHub user...mygithubusername => OK
  Please enter password for encrypted keyring: * GitHub token...
  18b..089 (len: 40) => OK (validated)
  * git command...OK ("git version 1.8.3.1; ")
  * GitPython module...OK (GitPython version 2.1.15)
  * push access to mygithubusername/easybuild-easyconfigs repo @
 GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from
 g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: "Failed 
 to
 fetch branch \'master\' from
 g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\')
 failed due to: exit code(128)\\n cmdline: git fetch -v
 pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could not read
 from remote repository.\\n\\nPlease make sure you have the correct access
 rights\\nand the repository exists.\'"')
  * creating gists...OK
  * location to Git working dirs... OK (~/git)

 This has worked in the past.

 Any ideas?

 Cheers,

 Loris

 -- 
 Dr. Loris Bennett (Hr./Mr.)
 ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de
>>>
-- 
Dr. Loris Bennett (Hr./Mr.)
ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de


Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Åke Sandgren
Looks like a problem with your github token, not your ssh key.

On 1/29/21 1:20 PM, Loris Bennett wrote:
> Hi Jakob,
> 
> Jakob Schiøtz  writes:
> 
>> Hi Loris,
>>
>> I have seen problems like that if the right modules are not installed in the
>> Python installation used by Easybuild, i.e. the system-wide Python 
>> installation
>> (possibly a Python 2 installation).  It is something related to a keyring, 
>> but I
>> can no longer remember what it was.
>>
>> However, the error message makes it more likely to be your private key 
>> missing.
>> That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the PRIVATE 
>> key
>> must be available on your computer, the public key is on GitHub).
> 
> Thanks for the suggestion, but everything is just in the standard place:
> 
>   [build@admin ~]$ ls -l ~/.ssh/
>   total 16
>   -rw--- 1 build staff 1272 May 12  2020 authorized_keys
>   -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
>   -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
>   -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts
> 
> And the public key is indeed the one on GitHub.  Moreover, the following 
> works:
> 
>   [build@admin ~]$ ssh -T g...@github.com
>   Hi mygithubusername! You've successfully authenticated, but GitHub does not 
> provide shell access
> 
> So I think the SSH setup is OK.
> 
> Cheers,
> 
> Loris
> 
>>
>> Jakob
>>
>>
>>
>>
>> --
>> Jakob Schiøtz, professor, Ph.D.
>> Department of Physics
>> Technical University of Denmark
>> DK-2800 Kongens Lyngby, Denmark
>> http://www.fysik.dtu.dk/~schiotz/
>>
>>
>>
>>> On 29 Jan 2021, at 08.55, Loris Bennett  wrote:
>>>
>>> Hi,
>>>
>>> My GitHub integration is failing:
>>>
>>>  * GitHub user...mygithubusername => OK
>>>  Please enter password for encrypted keyring: * GitHub token...
>>>  18b..089 (len: 40) => OK (validated)
>>>  * git command...OK ("git version 1.8.3.1; ")
>>>  * GitPython module...OK (GitPython version 2.1.15)
>>>  * push access to mygithubusername/easybuild-easyconfigs repo @ 
>>> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from 
>>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: "Failed 
>>> to fetch branch \'master\' from 
>>> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\') 
>>> failed due to: exit code(128)\\n  cmdline: git fetch -v 
>>> pr_target_account_mygithubusername_qZpiz\\n  stderr: \'fatal: Could not 
>>> read from remote repository.\\n\\nPlease make sure you have the correct 
>>> access rights\\nand the repository exists.\'"')
>>>  * creating gists...OK
>>>  * location to Git working dirs... OK (~/git)
>>>
>>> This has worked in the past.
>>>
>>> Any ideas?
>>>
>>> Cheers,
>>>
>>> Loris
>>>
>>> -- 
>>> Dr. Loris Bennett (Hr./Mr.)
>>> ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de
>>

-- 
Ake Sandgren, HPC2N, Umea University, S-90187 Umea, Sweden
Internet: a...@hpc2n.umu.se   Phone: +46 90 7866134 Fax: +46 90-580 14
Mobile: +46 70 7716134 WWW: http://www.hpc2n.umu.se


Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Loris Bennett
Hi Jakob,

Jakob Schiøtz  writes:

> Hi Loris,
>
> I have seen problems like that if the right modules are not installed in the
> Python installation used by Easybuild, i.e. the system-wide Python 
> installation
> (possibly a Python 2 installation).  It is something related to a keyring, 
> but I
> can no longer remember what it was.
>
> However, the error message makes it more likely to be your private key 
> missing.
> That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the PRIVATE key
> must be available on your computer, the public key is on GitHub).

Thanks for the suggestion, but everything is just in the standard place:

  [build@admin ~]$ ls -l ~/.ssh/
  total 16
  -rw--- 1 build staff 1272 May 12  2020 authorized_keys
  -rw--- 1 build staff 1679 Mar 13  2020 id_rsa
  -rw-r--r-- 1 build staff  418 Mar 13  2020 id_rsa.pub
  -rw-r--r-- 1 build staff  799 Mar 16  2020 known_hosts

And the public key is indeed the one on GitHub.  Moreover, the following works:

  [build@admin ~]$ ssh -T g...@github.com
  Hi mygithubusername! You've successfully authenticated, but GitHub does not 
provide shell access

So I think the SSH setup is OK.

Cheers,

Loris

>
> Jakob
>
>
>
>
> --
> Jakob Schiøtz, professor, Ph.D.
> Department of Physics
> Technical University of Denmark
> DK-2800 Kongens Lyngby, Denmark
> http://www.fysik.dtu.dk/~schiotz/
>
>
>
>> On 29 Jan 2021, at 08.55, Loris Bennett  wrote:
>> 
>> Hi,
>> 
>> My GitHub integration is failing:
>> 
>>  * GitHub user...mygithubusername => OK
>>  Please enter password for encrypted keyring: * GitHub token...
>>  18b..089 (len: 40) => OK (validated)
>>  * git command...OK ("git version 1.8.3.1; ")
>>  * GitPython module...OK (GitPython version 2.1.15)
>>  * push access to mygithubusername/easybuild-easyconfigs repo @ 
>> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from 
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: "Failed 
>> to fetch branch \'master\' from 
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\') 
>> failed due to: exit code(128)\\n  cmdline: git fetch -v 
>> pr_target_account_mygithubusername_qZpiz\\n  stderr: \'fatal: Could not read 
>> from remote repository.\\n\\nPlease make sure you have the correct access 
>> rights\\nand the repository exists.\'"')
>>  * creating gists...OK
>>  * location to Git working dirs... OK (~/git)
>> 
>> This has worked in the past.
>> 
>> Any ideas?
>> 
>> Cheers,
>> 
>> Loris
>> 
>> -- 
>> Dr. Loris Bennett (Hr./Mr.)
>> ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de
>
-- 
Dr. Loris Bennett (Hr./Mr.)
ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de


Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Jakob Schiøtz
Hi Loris,

I have seen problems like that if the right modules are not installed in the 
Python installation used by Easybuild, i.e. the system-wide Python installation 
(possibly a Python 2 installation).  It is something related to a keyring, but 
I can no longer remember what it was.

However, the error message makes it more likely to be your private key missing. 
 That is the file ~/.ssh/id_rsa NOT the file ~/.ssh/id_rsa.pub (the PRIVATE key 
must be available on your computer, the public key is on GitHub).

Jakob




--
Jakob Schiøtz, professor, Ph.D.
Department of Physics
Technical University of Denmark
DK-2800 Kongens Lyngby, Denmark
http://www.fysik.dtu.dk/~schiotz/



> On 29 Jan 2021, at 08.55, Loris Bennett  wrote:
> 
> Hi,
> 
> My GitHub integration is failing:
> 
>  * GitHub user...mygithubusername => OK
>  Please enter password for encrypted keyring: * GitHub token...
>  18b..089 (len: 40) => OK (validated)
>  * git command...OK ("git version 1.8.3.1; ")
>  * GitPython module...OK (GitPython version 2.1.15)
>  * push access to mygithubusername/easybuild-easyconfigs repo @ GitHub...FAIL 
> (unexpected exception: 'Checking out branch \'master\' from 
> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: "Failed to 
> fetch branch \'master\' from 
> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\') 
> failed due to: exit code(128)\\n  cmdline: git fetch -v 
> pr_target_account_mygithubusername_qZpiz\\n  stderr: \'fatal: Could not read 
> from remote repository.\\n\\nPlease make sure you have the correct access 
> rights\\nand the repository exists.\'"')
>  * creating gists...OK
>  * location to Git working dirs... OK (~/git)
> 
> This has worked in the past.
> 
> Any ideas?
> 
> Cheers,
> 
> Loris
> 
> -- 
> Dr. Loris Bennett (Hr./Mr.)
> ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de



Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Loris Bennett
Dear Kenneth,

Kenneth Hoste  writes:

> Dear Loris,
>
> On 29/01/2021 08:55, Loris Bennett wrote:
>> Hi,
>>
>> My GitHub integration is failing:
>>
>>* GitHub user...mygithubusername => OK
>>Please enter password for encrypted keyring: * GitHub token...
>>18b..089 (len: 40) => OK (validated)
>>* git command...OK ("git version 1.8.3.1; ")
>>* GitPython module...OK (GitPython version 2.1.15)
>>* push access to mygithubusername/easybuild-easyconfigs repo @
>> GitHub...FAIL (unexpected exception: 'Checking out branch \'master\' from
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: "Failed to
>> fetch branch \'master\' from
>> g...@github.com:mygithubusername/easybuild-easyconfigs.git: Cmd(\'git\') 
>> failed
>> due to: exit code(128)\\n cmdline: git fetch -v
>> pr_target_account_mygithubusername_qZpiz\\n stderr: \'fatal: Could not read
>> from remote repository.\\n\\nPlease make sure you have the correct access
>> rights\\nand the repository exists.\'"')
>>* creating gists...OK
>>* location to Git working dirs... OK (~/git)
>>
>> This has worked in the past.
>>
>> Any ideas?
>
>
> First thing that comes to mind is the SSH public key that is tied to your 
> GitHub
> account (see https://github.com/yourgithubusername.keys).
>
> The corresponding private key has to be available, either in a standard 
> location
> or 'active' in your SSH agent (via ssh-add).

Thanks for the swift reply.  The key is

  ~/.ssh/id_rsa.pub

and  matches the one shown in the GitHub settings.  

Does this issue 

  https://github.com/easybuilders/easybuild-framework/issues/2109

about the scheme used for checking out have any relevance?  The code
referenced there seems to imply that HTTPS should by default be tried
first, IIUC.

Cheers,

Loris

-- 
Dr. Loris Bennett (Hr./Mr.)
ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de


Re: [easybuild] Github integration failing: could not read from remote repository

2021-01-29 Thread Kenneth Hoste

Dear Loris,

On 29/01/2021 08:55, Loris Bennett wrote:

Hi,

My GitHub integration is failing:

   * GitHub user...mygithubusername => OK
   Please enter password for encrypted keyring: * GitHub token...
   18b..089 (len: 40) => OK (validated)
   * git command...OK ("git version 1.8.3.1; ")
   * GitPython module...OK (GitPython version 2.1.15)
   * push access to mygithubusername/easybuild-easyconfigs repo @ GitHub...FAIL 
(unexpected exception: 'Checking out branch \'master\' from 
g...@github.com:mygithubusername/easybuild-easyconfigs.git failed: "Failed to fetch 
branch \'master\' from g...@github.com:mygithubusername/easybuild-easyconfigs.git: 
Cmd(\'git\') failed due to: exit code(128)\\n  cmdline: git fetch -v 
pr_target_account_mygithubusername_qZpiz\\n  stderr: \'fatal: Could not read from remote 
repository.\\n\\nPlease make sure you have the correct access rights\\nand the repository 
exists.\'"')
   * creating gists...OK
   * location to Git working dirs... OK (~/git)

This has worked in the past.

Any ideas?



First thing that comes to mind is the SSH public key that is tied to 
your GitHub account (see https://github.com/yourgithubusername.keys).


The corresponding private key has to be available, either in a standard 
location or 'active' in your SSH agent (via ssh-add).



regards,

Kenneth



Cheers,

Loris