Re: [go-cd] Managing Pipeline Permissions for Multiple Pipeline Groups

[Aravind SV]

Tricky. Yes, there is no mechanism I'm aware of to set default permissions
for new pipeline groups. :(

For the existing groups and your upcoming upgrade, I would suggest making
the implicit permission explicit, by adding a role permission to the 230
pipeline groups, and then giving that role view and operate permissions.

Of course, there are still two issues:

1. How to make sure every user is in the role? [If you use the LDAP
authorisation plugin, then you'd be able to set up a role which includes
everyone in an AD group]

2. How to make sure every new pipeline group created has that default role
[No great idea I can think of here, apart from having a script which uses
the GoCD APIs to do that -- and only that -- and allowing everyone to run
that. Maybe in a pipeline. :)]

Cheers,
Aravind

On Fri, 31 May 2024 at 21:51, Jason Smyth  wrote:

> Hi everyone,
>
> We are working on upgrading from GoCD 19.8.0 to the current version. One
> of the major changes we need to account for is the default permissions on
> pipeline groups.
>
> In 19.8.0, pipelines are open by default, i.e., if there are no
> permissions explicitly defined for a pipeline group, all users can view and
> operate the pipelines it contains. In current versions, pipelines are
> secure by default; if there are no permissions explicitly defined for a
> pipeline group then only system administrators can view/operate them.
>
> Our current model is this:
>
>- All pipelines are stored in a single config repo.
>- Pipeline groups are used to represent an individual application.
>- A pipeline group generally consists of a build pipeline and several
>deployment pipelines.
>- Production pipelines are separated into their own pipeline group
>because they already have some requirements around restricting their
>operability.
>
>
> This presents a couple of challenges:
>
>1. When moving from open-by-default to secure-by-default we will need
>to explicitly specify the permissions for ~230 pipeline groups, all of
>which have essentially the same permissions requirements.
>2. Post upgrade, we cannot restrict system administration privileges
>because anyone who has access to create a new pipeline group via the config
>repo will need sysadmin access to set the pipeline group permissions after
>the pipelines are imported.
>
> Does GoCD have any mechanism for grouping pipeline groups for the purpose
> of standardizing permissions across them? Alternately, is there a way that
> we can define permissions in the config repo instead of having to put them
> into cruise-config.xml post-import?
>
> Any thoughts or suggestions are welcome.
>
> Regards,
> Jason
>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/7a022c24-8d18-48dc-8909-2d6c5330e49bn%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychHfBx35npprPKZwutE%3DbUWoB2U5WOVH37ygX3wGmyyftw%40mail.gmail.com.

Re: [go-cd] Assign Administrator Permissions to Role Without Manually Modifying cruise-config.xml

[Aravind SV]

Hello!

Yes, what Chad says makes sense to me.


I don't recall discussing a UI for the  tag though. There is an
API, if that helps you,  Jason:
https://api.gocd.org/current/#update-system-admins

Cheers,
Aravind


On Sat, 1 Jun 2024 at 10:21, Chad Wilson  wrote:

> Interesting, had not noticed that limitation (didn't know you could assign
> a role to super-admin at all!). Personally I don't know a UI-driven way.
>
> Looks like it was vaguely discussed as part of
> https://github.com/gocd/gocd/issues/3712 but I cannot see that
> possibility to map that within the Role Management page, nor a specific
> open issue/feature request for that.
>
> I believe there were a number of aspects of more granular auth for global
> entities  that wasn't
> necessarily completed, but I think this work was intended to reduce the
> need for super-admins in general. Keep in mind this work was mainly
> happening in H2 2019 and Thoughtworks announced closure of studios for end
> 2020 on Nov 18 2019. I believe the focus went to open sourcing pieces in H1
> 2020 so this possibly never got to its full vision :-).
>
> Having said that, from your other post it appears you are on a very old
> GoCD version so I am not sure if what you are seeing is the same as what I
> am seeing now.
>
> In any case, you may wish to update to (or play with a trial of) a later
> version to see if a sufficient number of global entities can be directly
> delegated to roles such that the super-admin permissions are much less
> necessary than earlier, and perhaps less necessary to map to roles
> frequently. I believe it at least supports environments/cluster
> profiles/elastic profiles/pipeline groups.
>
> -Chad
>
> On Sat, Jun 1, 2024 at 4:22 AM Jason Smyth  wrote:
>
>> Hi everyone,
>>
>> We are looking to improve our GoCD permissions management by using more
>> role-based permissions.
>>
>>
>> The role-based security documentation
>> 
>>  states
>> that it is possible to add a role to the server's security node admin list
>> and that all users of the role will inherit admin permissions.
>>
>> We tested this and it seems to work as described, however I am unable to
>> find a mechanism for managing this within GoCD. I was only able to get it
>> working by manually editing the cruise-config.xml file.
>>
>> Am I missing something, or is this really the only way to manage
>> role-based administrative access to GoCD?
>>
>> Thanks in advance,
>> Jason
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "go-cd" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to go-cd+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/go-cd/15df8afb-fa71-4d37-aa5d-a1d01939cb5cn%40googlegroups.com
>> 
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/CAA1RwH-oabmFNK2aPWEE8hr2dXmnoX_oX6HBHsBsX1O%2BKXPeOw%40mail.gmail.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychEAS%3D2558NdLBpFNjFjJUssrgzZPSwknr%3DFM2Rs36nrbQ%40mail.gmail.com.

Re: [go-cd] Queries on Webhook

[Aravind SV]

On Thu, 15 Jun 2023 at 03:15, Chad Wilson  wrote:

> I'm personally not sure if it's 1:1 or not in the case of
> webhook-triggered material updates, but speaking generally I doubt GoCD
> gives this guarantee. e.g if a pipeline's *stage1* is already running,
> and then two webhooks are fired that affect that pipeline's materials, I
> would *guess* that they would end up batched into one pipeline instance
> when stage1 next triggers.
>

That’s correct. They will get batched. The next run will see commits from
both those triggers.

It’s just a normal material update check to GoCD.

Cheers,
Aravind

>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychGTW%3DdU2LoCTxCgW6tyk16ZzmOhvvX%2BvddHiXs20%2Bw4kA%40mail.gmail.com.

Re: [go-cd] Issues with saving xml on secure url with reverse proxy

[Aravind SV]

Hello,

> It's also possible that the reverse proxy is doing something to the Origin 
> headers, but I have not touched IIS for a very long time, and never used it 
> in a reverse proxy mode, so have no specific insight there - and to me 
> doesn't **seem** to explain the CSRF token errors. It also could be something 
> not working as intended within GoCD.

I think it is related to the reverse proxy setup. I've seen this happen when 
setups ignore the "X-Forwarded-For" header setup shown [in the 
documentation](https://docs.gocd.org/current/installation/configure-reverse-proxy.html).

How it ends up being related to CSRF tokens *seems* to be:

1.  Server sends a response with a session ID in the cookie, along with a CSRF 
token to be sent back with the form response.

2.  Due to the misconfiguration (could be secure site URL as you said), the 
cookie doesn't get set / sent back with the form response.

3.  Then, when the server tries to verify that the CSRF token sent back matches 
the one expected for the session, it doesn't work, since the session won't be 
the old session from point 1 above.

Something like that. I could be mistaken. Related issue which reminded me of 
this (no resolutions mentioned there, unfortunately, apart from "proxy 
configuration was the issue"): 

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m25yd5uly4.fsf%40arvindsv.com.

Re: [go-cd] GoCD database connection properties question

[Aravind SV]

What is the URL you're using / what's the full call? I've used it before,
yes.

On Tue, Nov 22, 2022 at 3:47 PM Tsanko Stoev  wrote:

> That's the first thing I tried but it seems that the API call is not
> working or I am doing something wrong as I am getting the following
> response:
> -- START --
>
> HTTP/1.1 404 Not Found
> Content-Type: text/plain;charset=utf-8
> Expires: Thu, 01 Jan 1970 00:00:00 GMT
> Set-Cookie: JSESSIONID=node01g8wiol63q14ljfilz086yxyo570.node0; Path=/go;
> Expires=Tue, 06-Dec-2022 15:43:28 GMT; Max-Age=1209600; Secure; HttpOnly
> X-XSS-Protection: 1; mode=block
> X-Content-Type-Options: nosniff
> X-Frame-Options: SAMEORIGIN
> X-UA-Compatible: chrome=1
> X-Powered-By: ARR/3.0
> X-Powered-By: ASP.NET
> Date: Tue, 22 Nov 2022 15:43:27 GMT
> Content-Length: 58
> Strict-Transport-Security: max-age=31536000; includeSubDomains
>
> The url you are trying to reach appears to be incorrect.
>
> -- END ---
>
> Have you successfully been able to use it?
> Thanks.
>
> Tsanko
>
>
> On Tue, Nov 22, 2022 at 4:00 AM Aravind SV 
> wrote:
>
>> Oh. Yes, Chad is right. That's a better way. :)
>>
>> On Tue, Nov 22, 2022 at 9:58 AM Chad Wilson 
>> wrote:
>>
>>> If seeking higher degrees of automation, I believe you can also use the
>>> API at https://api.gocd.org/current/#encrypt-a-plain-text-value for
>>> this, alongside a personal access token or another credential - but I
>>> haven't personally tried it for this purpose.
>>>
>>> I am sure Aravind can correct me if this is for a different purpose and
>>> encrypts differently. :-)
>>>
>>>
>>> On Tue, Nov 22, 2022 at 5:50 PM Aravind SV 
>>> wrote:
>>>
>>>> I would say the easiest way would be to add a secure environment
>>>> variable to any job or pipeline and copy the encrypted value off of the
>>>> config XML. I vaguely remember a command-line utility for it, but copying
>>>> it off the config XML is likely simpler at this time.
>>>>
>>>> Cheers,
>>>> Aravind
>>>>
>>>> On Mon, Nov 21, 2022 at 9:21 PM Tsanko Stoev  wrote:
>>>>
>>>>> Hello All,
>>>>>
>>>>> I was browsing the GoCD documentation and specifically database
>>>>> connection properties. There is a way to use an encrypted password for the
>>>>> connection (db.encryptedPassword). How does one go about creating an
>>>>> encrypted value from the plain text password?
>>>>> Thank you in advance.
>>>>>
>>>>> Sincerely,
>>>>> Tsanko Stoev
>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "go-cd" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to go-cd+unsubscr...@googlegroups.com.
>>>>> To view this discussion on the web visit
>>>>> https://groups.google.com/d/msgid/go-cd/CAGWsXCB3gagSK2jcfxkhQB9rJhxT41-UfkXZDZ8HXcvUb6X9tQ%40mail.gmail.com
>>>>> <https://groups.google.com/d/msgid/go-cd/CAGWsXCB3gagSK2jcfxkhQB9rJhxT41-UfkXZDZ8HXcvUb6X9tQ%40mail.gmail.com?utm_medium=email_source=footer>
>>>>> .
>>>>>
>>>> --
>>>> You received this message because you are subscribed to the Google
>>>> Groups "go-cd" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to go-cd+unsubscr...@googlegroups.com.
>>>> To view this discussion on the web visit
>>>> https://groups.google.com/d/msgid/go-cd/CACxychF1N%2Ba9aR1GaLobs%3Dh0ZHgpuLKWfE%3DarHg_x6T4gi5xGw%40mail.gmail.com
>>>> <https://groups.google.com/d/msgid/go-cd/CACxychF1N%2Ba9aR1GaLobs%3Dh0ZHgpuLKWfE%3DarHg_x6T4gi5xGw%40mail.gmail.com?utm_medium=email_source=footer>
>>>> .
>>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "go-cd" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to go-cd+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/go-cd/CAA1RwH-7ZNrFbwS8zMEY%3DiOwcVceJ2L49K-dHNzYDBP_bjewsQ%40mail.gmail.com
>>> <https://groups.google.com/d/msgid/go-cd/CAA1RwH-7ZNrFbwS8zMEY%3DiOwcVceJ2L49K-dHNzYDBP_bjewsQ%40mail.gmail.com?utm_medium=email_source=footer>
>&g

Re: [go-cd] GoCD database connection properties question

[Aravind SV]

Oh. Yes, Chad is right. That's a better way. :)

On Tue, Nov 22, 2022 at 9:58 AM Chad Wilson  wrote:

> If seeking higher degrees of automation, I believe you can also use the
> API at https://api.gocd.org/current/#encrypt-a-plain-text-value for this,
> alongside a personal access token or another credential - but I haven't
> personally tried it for this purpose.
>
> I am sure Aravind can correct me if this is for a different purpose and
> encrypts differently. :-)
>
>
> On Tue, Nov 22, 2022 at 5:50 PM Aravind SV 
> wrote:
>
>> I would say the easiest way would be to add a secure environment variable
>> to any job or pipeline and copy the encrypted value off of the config XML.
>> I vaguely remember a command-line utility for it, but copying it off the
>> config XML is likely simpler at this time.
>>
>> Cheers,
>> Aravind
>>
>> On Mon, Nov 21, 2022 at 9:21 PM Tsanko Stoev  wrote:
>>
>>> Hello All,
>>>
>>> I was browsing the GoCD documentation and specifically database
>>> connection properties. There is a way to use an encrypted password for the
>>> connection (db.encryptedPassword). How does one go about creating an
>>> encrypted value from the plain text password?
>>> Thank you in advance.
>>>
>>> Sincerely,
>>> Tsanko Stoev
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "go-cd" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to go-cd+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/go-cd/CAGWsXCB3gagSK2jcfxkhQB9rJhxT41-UfkXZDZ8HXcvUb6X9tQ%40mail.gmail.com
>>> <https://groups.google.com/d/msgid/go-cd/CAGWsXCB3gagSK2jcfxkhQB9rJhxT41-UfkXZDZ8HXcvUb6X9tQ%40mail.gmail.com?utm_medium=email_source=footer>
>>> .
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "go-cd" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to go-cd+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/go-cd/CACxychF1N%2Ba9aR1GaLobs%3Dh0ZHgpuLKWfE%3DarHg_x6T4gi5xGw%40mail.gmail.com
>> <https://groups.google.com/d/msgid/go-cd/CACxychF1N%2Ba9aR1GaLobs%3Dh0ZHgpuLKWfE%3DarHg_x6T4gi5xGw%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/CAA1RwH-7ZNrFbwS8zMEY%3DiOwcVceJ2L49K-dHNzYDBP_bjewsQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/go-cd/CAA1RwH-7ZNrFbwS8zMEY%3DiOwcVceJ2L49K-dHNzYDBP_bjewsQ%40mail.gmail.com?utm_medium=email_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychEGBMCkOJ89Fbykoe%2BPx3uhXaJvZ1ij%3Dz%3DeKr%2Bw-tugmg%40mail.gmail.com.

Re: [go-cd] GoCD database connection properties question

[Aravind SV]

I would say the easiest way would be to add a secure environment variable
to any job or pipeline and copy the encrypted value off of the config XML.
I vaguely remember a command-line utility for it, but copying it off the
config XML is likely simpler at this time.

Cheers,
Aravind

On Mon, Nov 21, 2022 at 9:21 PM Tsanko Stoev  wrote:

> Hello All,
>
> I was browsing the GoCD documentation and specifically database connection
> properties. There is a way to use an encrypted password for the connection (
> db.encryptedPassword). How does one go about creating an encrypted value
> from the plain text password?
> Thank you in advance.
>
> Sincerely,
> Tsanko Stoev
>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/CAGWsXCB3gagSK2jcfxkhQB9rJhxT41-UfkXZDZ8HXcvUb6X9tQ%40mail.gmail.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychF1N%2Ba9aR1GaLobs%3Dh0ZHgpuLKWfE%3DarHg_x6T4gi5xGw%40mail.gmail.com.

Re: [go-cd] gocd agent 18.10

[Aravind SV]

Hello!

On Tue, Nov 8, 2022 at 1:26 PM Sriram Narayanan  wrote:

> Could you just create that directory and file and configure the values
> there?
> The RPM does not deliver that directory.
>

I don't think that'll work. The person mentioned 18.10, which is over 4
years old. No one should really be using it. But, if they are, then they
should follow the correct documentation: https://docs.gocd.org/18.10.0/

I think wrapper-properties was introduced later.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychE1sxgyG8dpFYrw3MUNtJv6NKhf2hFheFbrBz4tAU7ZoA%40mail.gmail.com.

Re: [go-cd] Issues with GoCD db.properties file and LDAP after upgrade to 20.4.

[Aravind SV]

Hello,

 We alias them as a cname since our servernames are pretty complex so 
perhaps the issue is that its not properly authenticating/redirecting because 
it needs to have alternate site name bindings entered somewhere?

Hmm, I wonder if the site URL and secure site URL are set wrong, and the 
cookies are being set on the wrong domain? Worth checking.



Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2tu3j3z1j.fsf%40arvindsv.com.

Re: [go-cd] Issues with GoCD db.properties file and LDAP after upgrade to 20.4.

[Aravind SV]

Hello,

 Is there a way to increase logging or anything to provide more detail?

You can access:  (basically 
`/go/api/support`) to get more information about paths + much more. Search for: 
"loc.config.dir".

You can increase the logging levels (see 
[docs](https://docs.gocd.org/current/advanced_usage/logging.html)) but it can 
quickly get overwhelming. I'd suggest that the current level of logs *should* 
be enough.

I agree with Chad. I haven't ever seen `config/db.properties` not working.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2h6zp67ew.fsf%40arvindsv.com.

Re: [go-cd] Re: Dynamic agents are not getting terminated if the job is cancelled

[Aravind SV]

Hello,

Do you have any "On Cancel" tasks in that job? If you do, then the killing of 
running/stuck tasks is skipped by GoCD. You'll need to handle that in your on 
cancel tasks.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2o7uysezw.fsf%40arvindsv.com.

Re: [go-cd] config-repo rules

[Aravind SV]

Hello Laurence,

Yes, your understanding of the pipeline group vs. pipeline difference seems 
correct. I got confused too just now, and had to go find the GitHub issue which 
discussed this: 


You'll have to ignore the mention of the action "define" there, since it wasn't 
implemented (as you can see in the comments that followed the one above).

If you are able to improve the documentation, please do: 


Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2r0zusfjq.fsf%40arvindsv.com.

Re: [go-cd] A new elastic agent is created for every 2 mins.

[Aravind SV]

Is there any information in the elastic agent logs? Not the GoCD server logs.

It looks like the plugin you're using is: 


The author or someone there might know more. To me, it looks like some kind of 
a timing issue and the agent not identifying itself properly to the server, if 
it is able to connect.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m24jzj90ng.fsf%40arvindsv.com.

Re: [go-cd] How To Create Complex Work Flow

[Aravind SV]

Hello Nayan,

There are a few blog posts which might give you some ideas regarding pipeline 
modeling: 

I haven't looked into your specific case. You'll likely need to understand the 
principles based on the blog posts and [other 
documentation](https://docs.gocd.org/current/), and see how it applies to your 
case.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m27d4f919p.fsf%40arvindsv.com.

Re: [go-cd] Configure "Elastic agents" on standalone Go server (v21.1.0)

[Aravind SV]

I've updated
https://github.com/gocd/kubernetes-elastic-agents/blob/master/docs/install.md
to make it more clear where the plugin JAR file can be downloaded from.

Cheers,
Aravind

On Sat, Jul 2, 2022 at 10:15 PM Satya Elipe  wrote:

> Hi Chad
> Thank you for the input, appreciate it.
> So, as I mentioned, my server is neither dockerized nor running as a pod
> in the cluster, it's just an amzn2 box running on its own.
> So, I think the second approach in your email works for me; but I just
> wonder, where can I find this jar (
> build/libs/kubernetes-elastic-agent-plugin-VERSION.jar) to download onto
> amzn2 ? (Ii think I'm terribly missing something finding it )
>
>
> [>>You'd then need to follow
> https://github.com/gocd/kubernetes-elastic-agents/blob/master/docs/install.md
>  to configure a cluster profile and 1+ elastic profiles, and then change
> your pipeline jobs to tell them to use a particular elastic profile ID to
> essentially tell them which agent container image to run, and what k8s
> resources the agents need.]
>
> We are also planning to dockerize the GoCD+Agents soon, then I think
> the better approach would be the first point in your mail.
> [I would consider deploying a GoCD server as a pod and then elastic agents
> will be out of the box available and will be ready with the required
> configuration, I guess. ]
>
> Thanks Again
> Satya
>
> On Fri, Jul 1, 2022 at 5:17 PM Chad Wilson  wrote:
>
>> Hi Satya
>>
>> If you are deploying GoCD into Kubernetes itself via the Helm chart
>>  into
>> your cluster without overriding the plugin configuration the "Kubernetes
>> elastic agents" plugin is installed out-of-the-box, if your intent is to
>> run the agents as ephemeral containers inside a cluster.
>>
>> You'd then need to follow
>> https://github.com/gocd/kubernetes-elastic-agents/blob/master/docs/install.md
>> to configure a cluster profile and 1+ elastic profiles, and then change
>> your pipeline jobs to tell them to use a particular elastic profile ID to
>> essentially tell them which agent container image to run, and what k8s
>> resources the agents need.
>>
>> -Chad
>>
>> On Fri, Jul 1, 2022 at 11:53 PM Satya Elipe 
>> wrote:
>>
>>> Hi All
>>>
>>> I would like to know how can we configure elastic agents for a
>>> standalone Go server which is used to CI/CD for our k8s cluster ?
>>>
>>> Its been brought up long back with two static agents configured to it.
>>> As they are static they always run hence need guidence to turn the agents
>>> into elastic so to avoid idle costs.
>>>
>>> Let me know if more information is required.
>>>
>>> Thank you
>>> Satya
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "go-cd" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to go-cd+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/go-cd/e4a5098c-ed26-45e5-ac8c-d0ec5251da3dn%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "go-cd" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to go-cd+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/go-cd/CAA1RwH_vL3YW%3DGursKVBPC7E1Oz3b%2BOSdmfLX7L8FKYhzzz2TA%40mail.gmail.com
>> 
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/CADKEDRqB13wrvijiFYX0ma9e_JJse6M0Xhy57-c8tdKm154LsQ%40mail.gmail.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychFwmtdCWp59dLvWK7Lehp8ENXxjfdNg5C7E%2BNL9j8e44A%40mail.gmail.com.

Re: [go-cd] upgrade from version 19.8.0 to 20.1.0

[Aravind SV]

It’s just the path to the RPM file you download. You don’t need any braces
etc.

On Mon, 13 Jun 2022 at 17:44, Obiageli Adegbite  wrote:

> Hello,
>  I am trying to upgrade from version 19.8.0 to 20.1.0 on a centos server,
> the upgrade documentation states : sudo rpm -Uvh
> /path/to/go-server-${version}.rpm
> sudo yum upgrade go-server, but what is the path/to/go-server, is it
> /etc/go or /etc/default or /var/lib/go-server. In regard to version is it
> to be written as -${v20.1.0}.rpm or -${20.0.1}.rpm or -$20.0.1.rpm is the
> curly bracket needed.
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychHEQOxB3vSERe5t0k9ouY0nBo4a-k15_JyOFsCK0Y3jcg%40mail.gmail.com.

Re: [go-cd] H2 Database Backup

[Aravind SV]

Searching for “backup” in GoCD’s documentation should provide you all the
information regarding it.

https://docs.gocd.org


On Fri, 27 May 2022 at 15:57, Tim Stevens  wrote:

> From what tool do I perform the backup?  I don't see anything in Perforce
> to do this.  I am assuming it is performed through the GoCD user interface
> on the server?
>
> On Thursday, May 26, 2022 at 2:43:21 AM UTC-7 Aravind SV wrote:
>
>> There’s also the maintenance mode
>> <https://docs.gocd.org/current/advanced_usage/maintenance_mode.html>,
>> which helps make sure that nothing is running and no one is able to run
>> anything new. I don’t remmeber if you can run a backup during that time,
>> but it could be used to wind everything down in preparation.
>>
>> I second everything Chad said regarding the file system speed etc.
>>
>> Cheers,
>> Aravind
>>
>> * From*: Chad Wilson
>> * Subject*: Re: [go-cd] H2 Database Backup
>> * To*: go...@googlegroups.com
>> * Date*: Wed, 25 May 2022 10:43:31 +0800
>> Hi Tim
>>
>> Not sure if you are aware, but you can schedule GoCD's backup which will
>> prevent interactions temporarily while it takes a database backup, so not
>> sure you need to "schedule downtime" as much as schedule the backups in the
>> middle of the morning and set user expectations if the server is otherwise
>> expected to be up 24/7.
>>
>> For a rough rule of thumb, the build.gocd.org database is ~5GB and
>> anecdotally I think takes a minute or so to complete, zipping to a 1GB DB
>> file. This will likely vary depending on the resources your GoCD server has
>> (as the H2 BACKUP operation is done in memory) and the file system speed
>> for where your DB is stored and your output "artifacts" dir.
>>
>> -Chad
>>
>> On Tue, May 24, 2022 at 9:58 PM Tim Stevens  wrote:
>>
>>> Hello, I am new to GoCD and want to take a backup of our rather large H2
>>> database +4 gigs.  Has anyone done this before and remember about how long
>>> the backup took?  I want to schedule downtime for this, but want a ball
>>> park figure of how long to plan on.
>>>
>>> Thanks in advance!
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "go-cd" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to go-cd+un...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/go-cd/7e492020-871d-41e7-aea6-18fd31da5127n%40googlegroups.com
>>> <https://groups.google.com/d/msgid/go-cd/7e492020-871d-41e7-aea6-18fd31da5127n%40googlegroups.com?utm_medium=email_source=footer>
>>> .
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "go-cd" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to go-cd+un...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/go-cd/CAA1RwH_JnmbSRLXtZomyoTYLiXGKUp4bvL0e2WHdnTmhJu1Mug%40mail.gmail.com
>> <https://groups.google.com/d/msgid/go-cd/CAA1RwH_JnmbSRLXtZomyoTYLiXGKUp4bvL0e2WHdnTmhJu1Mug%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/96c0bc20-7c41-4b82-8d21-9e2c9924821fn%40googlegroups.com
> <https://groups.google.com/d/msgid/go-cd/96c0bc20-7c41-4b82-8d21-9e2c9924821fn%40googlegroups.com?utm_medium=email_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychFE91Wcu%3DkLmiONmvkn7tH7niRMGoBR0pCfYUc_cv7o3w%40mail.gmail.com.

Re: [go-cd] H2 Database Backup

[Aravind SV]

There's also the [maintenance 
mode](https://docs.gocd.org/current/advanced_usage/maintenance_mode.html), 
which helps make sure that nothing is running and no one is able to run 
anything new. I don't remmeber if you can run a backup during that time, but it 
could be used to wind everything down in preparation.

I second everything Chad said regarding the file system speed etc.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2r14gtyrv.fsf%40arvindsv.com.

Re: [go-cd] H2 error: "Database may be already in use" after upgrade

[Aravind SV]

Apologies if you all see duplicate messages. It's because some of these
messages were caught in a Spam filter, and marking these as not spam will
likely have re-sent them.

Cheers,
Aravind

On Sat, May 21, 2022 at 7:03 PM AquilaNiger  wrote:

> Hi everyone,
>
> I really need your help. Previously we were using GoCD 20.1.0 and we
> upgraded to 22.1.0 recently, including database migration. Everthing went
> well and the server is running as usual. However, every now and then (no
> clue how to reproduce that) the database is locked and errors like these
> add up:
>
> Hibernate operation: could not inspect JDBC autocommit mode; SQL [???];
> Database may be already in use: null. Possible solutions: close all other
> connection(s); use the server mode [90020-200]; nested exception is
> org.h2.jdbc.JdbcSQLNonTransientConnectionException: Database may be already
> in use: null. Possible solutions: close all other connection(s); use the
> server mode [90020-200]
>
> Hibernate operation: could not execute query; SQL [SELECT materials.id
> FROM pipelineMaterialRevisions INNER JOIN pipelines ON
> pipelineMaterialRevisions.pipelineId = pipelines.id INNER JOIN
> modifications on modifications.id  =
> pipelineMaterialRevisions.torevisionId INNER JOIN materials on
> modifications.materialId = materials.id WHERE materials.id = ? AND
> pipelineMaterialRevisions.toRevisionId >= ? AND
> pipelineMaterialRevisions.fromRevisionId <= ? AND pipelines.name = ?
> GROUP BY materials.id;]; Database may be already in use: null. Possible
> solutions: close all other connection(s); use the server mode [90020-200];
> nested exception is org.h2.jdbc.JdbcSQLNonTransientConnectionException:
> Database may be already in use: null. Possible solutions: close all other
> connection(s); use the server mode [90020-200]
>
> Could not open JDBC Connection for transaction; nested exception is
> org.h2.jdbc.JdbcSQLNonTransientConnectionException: Database may be already
> in use: null. Possible solutions: close all other connection(s); use the
> server mode [90020-200]
>
> Additionally I can see that in the database directory, two traces are
> written, the old and the new one. Is that "works as designed"?
>
> Both traces contain stacktraces like this one:
>
> 2022-05-19 06:39:25 database: flush
> org.h2.message.DbException: General error:
> "java.lang.IllegalStateException: The file is locked:
> nio:/var/lib/go-server/db/h2db/cruise.mv.db [1.4.200/7]" [5-200]
> at org.h2.message.DbException.get(DbException.java:194)
> at org.h2.message.DbException.convert(DbException.java:347)
> at
> org.h2.mvstore.db.MVTableEngine$1.uncaughtException(MVTableEngine.java:93)
>...
>
> What's wrong with the installation? Is there any option or setting in H2
> that we could change to fix the issue? Is it correct that two trace files
> are written? Any idea or help is highly appreciated, otherwise I don't
> think we can get rid of the issue without a complete new installation.
>
> Thanks in advance!
> Julia
>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/915480f5-af9f-4a12-b6db-acf16066bec6n%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychHQDPhv%3DvdoVoNJg%3DBbSgox7qF2mWbxd_cFcpq22Van2w%40mail.gmail.com.

Re: [go-cd] Artifact fetch URL is broken

[Aravind SV]

In this case, it looks like it should be `srcfile` not `srcdir` since `foo.tar` 
is a file.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m21r0cbahe.fsf%40arvindsv.com.

Re: [go-cd] Database migration dry run gone wrong

[Aravind SV]

Thank you. The trace file was helpful. Not sure, but you might need to 
seriously consider step 4 in my previous response. The DB file seems to be 
corrupted.

Did you forcibly quit the server by running something like `kill -9`? I don't 
see this happening via the migrator, but I can't be sure.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2ilugqa16.fsf%40arvindsv.com.

Re: [go-cd] Database migration dry run gone wrong

[Aravind SV]

Hello Jonathan,

 but with my limited knowledge of Java, I don't know what to make of it.

I was looking for the rest of the error message, which you showed in the 
pastebin. Thanks. Unfortunately, the stack-trace isn't too helpful. I tried 
running the migration tool on a running GoCD server and it was fine -- nothing 
happened.

I would try with DB and config in a fresh GoCD server:

1.  Get a fresh copy of the GoCD server (maybe the zip) of your version from 


2.  Unzip it. Copy over these files from the old / broken server instance to 
the new one:

-   ./db/h2db/cruise.h2.db
-   ./config/cruise-config.xml
-   ./config/cipher.aes

3.  Start the new server. If it starts successfully, then maybe there is an 
issue with something like the h2deltas folder. This *shouldn't* be the case 
unless you updated your GoCD server to 20.5.0.

4.  If it doesn't start, you might need to recreate that DB using [these 
instructions]()
 and try steps 1 to 3 again to see if it helps. If it does, it might mean that 
your DB has somehow got corrupted. I'd say it's very unlikely to be anything to 
do with the migrator -- it seemed to be harmless when I tried it. But, I cannot 
say for sure.

If none of these work ... I'm out of ideas. :(

Regards,
Aravind

PS: Please try all these on a copy in a separate directory. Not on the broken 
server.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2lezcqa8m.fsf%40arvindsv.com.

Re: [go-cd] Database migration dry run gone wrong

[Aravind SV]

Hello Jonathan,

Given that the message seems to be coming from [around 
here](https://github.com/gocd/gocd/blob/1278474dcd8b2e90c0f19fc15098c279274141cb/db-support/db-migration/src/main/java/com/thoughtworks/go/server/database/migration/DatabaseMigrator.java#L61),
 there could be more information in the logs. It's hard to say what the problem 
is without more information.

 My understanding was that running this tool would only write to the target 
database with no impact on the source.

That is a reasonable expectation, I feel. However, one of the reasons [the 
first steps in the 
documentation](https://docs.gocd.org/current/installation/upgrade_to_gocd_20.5.0.html)
 mentions backing up and stopping the server is to make recovery easier. I 
don't know what happens if you run this against a *running* GoCD server.

I wonder if permissions got changed, or something like that. Won't know without 
more information from the logs.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2tue1qf01.fsf%40arvindsv.com.

[go-cd] Release announcement - 21.4.0

[Aravind SV]

Hello,

A new release of GoCD (21.4.0) is out.

This is a release mainly in preparation for adding support for Java 17. To
know more about the features and bug fixes in this release, see the release
notes  or head to the downloads page
 to try it. Feedback and ideas are always
welcome.

As always, please take a backup before upgrading. Hope everyone has a
wonderful new year.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychES3sw8eLSSvop-AdLdFWRY6z5DLY%3DdW%3D90gfNbt7QbYQ%40mail.gmail.com.

[go-cd] Re: log4j CVE-2021-44228 vulnerability

[Aravind SV]

Wanted to redirect others coming across this to the other thread: 
https://groups.google.com/g/go-cd/c/d-uA9v760Bg/m/VAWsMPCCCwAJ

On Monday, December 13, 2021 at 12:50:12 PM UTC pranav...@contentstack.com 
wrote:

> Hi Team,
>  We are currently using gocd version of 20.6.0 and we found that it has a 
> vulnerability log4j CVE-2021-44228. And the latest release v21.3.0 has been 
> updated with log4j-over-slf4j  but even the vulnerability still exists . 
> How can we patch this from our side in both versions ? When can we expect 
> GoCD releasing fix for this? 
>
> Note: We are using gocd on AWS EKS v1.19 with gocd provided wrapper 
> scripts.
> Thanks,
> Pranav Joshi
> DevOps Engineer
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/c1b8f5c3-d575-4437-b5c0-6b0fd78569c7n%40googlegroups.com.

Re: [go-cd] Re: Regarding the log4j vulnerability

[Aravind SV]

Hello Pranav,

No, I can't confirm that, because I haven't looked into any old versions. After 
21.3.0 came out, it doesn't make sense to be on any older version, since 
anything less than 21.2.0 was directly vulnerable in a very bad way.

My *opinion* is that 20.6.0 is not vulnerable to this, since the log4j v1 to 
slf4j + logback change was done in 2016, as mentioned in the GitHub discussion: 


Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2v8zsa9hd.fsf%40arvindsv.com.

Re: [go-cd] Re: Regarding the log4j vulnerability

[Aravind SV]

Hello Pranav,

GoCD's underlying log implementation for slf4j is logback, and not log4j.
Have you been able to *exploit* this? That would be strange because there
is no log4j JAR bundled with GoCD at all.

However, we will check again and wait for your response (to the question
about the exploit).

Cheers,
Aravind


On Mon, Dec 13, 2021 at 12:58 PM Pranav Joshi 
wrote:

> Hey Aravind,
> We found this article http://slf4j.org/log4shell.html :
>
> The SLF4J API is just an API which lets message data go through. As such,
> using log4j 2.x even via SLF4J does not mitigate the vulnerability.
>
> However, as mentioned previously, log4j 1.x is safe with respect to
> CVE-2021-44228. Thus, if your SLF4J provider/binding is *slf4j-logj12.jar*,
> you are safe regarding CVE-2021-44228.
>
> If you are using *log4j-over-slf4j.jar* with SLF4J API, you are safe
> unless the underlying implementation is log4j 2.x.
>
> On Monday, December 13, 2021 at 6:25:03 PM UTC+5:30 Aravind SV wrote:
>
>> Ha. As I write this ... someone seems to have brought this up. Please
>> watch this or the discussion for updates.
>>
>> On Mon, Dec 13, 2021 at 12:53 PM Aravind SV 
>> wrote:
>>
>>> Hello,
>>>
>>> Just a quick note to say that there is a discussion happening around the
>>> log4j vulnerability and GoCD here
>>> <https://github.com/gocd/gocd/discussions/9931>.
>>>
>>> The current understanding is that GoCD (by itself) isn't vulnerable,
>>> since it doesn't use log4j directly. There is a TFS dependency which uses
>>> log4j, but it had been made to use log4j-over-slf4j and then logback from
>>> there -- and so, *shouldn't* be vulnerable.
>>>
>>> If things change, and more information is found, it might be in that
>>> discussion page instead of here.
>>>
>>> Cheers,
>>> Aravind
>>>
>> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/a1cc672b-e9d5-4496-86c6-35b173cba8dcn%40googlegroups.com
> <https://groups.google.com/d/msgid/go-cd/a1cc672b-e9d5-4496-86c6-35b173cba8dcn%40googlegroups.com?utm_medium=email_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychH_BpYWqgCqEmwPfXhzvTJFKVyashC80J2hhnKo4U67iQ%40mail.gmail.com.

[go-cd] Re: Regarding the log4j vulnerability

[Aravind SV]

Ha. As I write this ... someone seems to have brought this up. Please watch
this or the discussion for updates.

On Mon, Dec 13, 2021 at 12:53 PM Aravind SV  wrote:

> Hello,
>
> Just a quick note to say that there is a discussion happening around the
> log4j vulnerability and GoCD here
> <https://github.com/gocd/gocd/discussions/9931>.
>
> The current understanding is that GoCD (by itself) isn't vulnerable, since
> it doesn't use log4j directly. There is a TFS dependency which uses log4j,
> but it had been made to use log4j-over-slf4j and then logback from there --
> and so, *shouldn't* be vulnerable.
>
> If things change, and more information is found, it might be in that
> discussion page instead of here.
>
> Cheers,
> Aravind
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychGGmvAVqfY-T-oGg-ZB_9zzUB52oKSD7phz%2BWR%3DJ%2BPwpA%40mail.gmail.com.

[go-cd] Heads up about security issues and a release next week

[Aravind SV]

Hello everyone,

There will be a release of GoCD next week, on Tuesday Oct 26 (tentatively 
around mid-day UTC). This release will have important security fixes. There 
will be a *strong *recommendation for all users of GoCD to upgrade to 
21.3.0 to be protected.

Especially if you're in a hostile user environment or have a GoCD server 
exposed to the internet, please do upgrade as soon as possible.

The group who disclosed these issues responsibly will likely have a writeup 
about the findings soon.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/7f4f35d6-04e6-4619-b4c0-03bb26389190n%40googlegroups.com.

Re: [go-cd] Manually assigning an administrator role

[Aravind SV]

Hello Rob,

You should be able to edit the config XML file directly on the filesystem to 
get admin access. It's usually in `/etc/go/cruise-config.xml`. For other OSes, 
the [installation 
instructions](https://docs.gocd.org/current/installation/installing_go_server.html)
 can tell you where the config is. You would need to add yourself as an admin. 
Search for the `` tag.

Or, if you're locked out, this might help: 


Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m27dgggszz.fsf%40arvindsv.com.

Re: [go-cd] Re: Mulltiple GoCD build agents on Windows?

[Aravind SV]

That's right. I think it's possible to change the name (to be *any* name), only 
if using auto-registration. If not, it uses the hostname and you might have to 
use the agent work directory to differentiate it.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2y28ykd2w.fsf%40arvindsv.com.

Re: [go-cd] Mulltiple GoCD build agents on Windows?

[Aravind SV]

Hello Emil,

You should be able to just use the zip version of it to run multiple agents: 


That will work on any OS.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2bl5wkwq9.fsf%40arvindsv.com.

Re: [go-cd] error launching the go-agent

[Aravind SV]

Hello Satya,

As mentioned [in the 
documentation](https://docs.gocd.org/current/installation/install/agent/osx.html),
 the file is `./wrapper-config/wrapper-properties.conf`.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m21r77iugt.fsf%40arvindsv.com.

Re: [go-cd] ETA for GoCD 21.3.0

[Aravind SV]

Hello Dennis,

I think it might be worth waiting a week or two if possible. There is no strict 
ETA, but there is some activity (especially by Chad Wilson) in the codebase.

There is a change around the agent license keys that might need to happen as 
well, and it might make sense to release after that. The changes won't be 
drastic between 21.2.0 and 21.3.0.

If you don't see a release in a couple of week, I'd upgrade to 21.2.0.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m24kc3iwzd.fsf%40arvindsv.com.

Re: [go-cd] Hibernate issue with gocd

[Aravind SV]

Are you sure you're on 19.7.0? From the release notes, 
[20.5.0](https://www.gocd.org/releases/#20-5-0) introduced support for 
Postgres. There used to be a paid add-on previously, but it only supported 
version 9.6 of Postgres, if I remember correctly.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2a6nz125d.fsf%40arvindsv.com.

Re: [go-cd] Guidance needed on securing username and password on Gocd yaml

[Aravind SV]

Every API call [will need 
authentication](https://api.gocd.org/current/#authentication) (either 
`username:password` you use for logging in, or authentication tokens). Those 
two headers are constant. And yes, the `badger` is the value you want to 
encrypt. What happened when you tried it?

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2pmx1bv0w.fsf%40arvindsv.com.

Re: [go-cd] Not able to connect to private git repo using password

[Aravind SV]

I think the `ssh://` protocol doesn't work with `username:password`. So, I 
agree that option 2 (using SSH keys) is the right one to use.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2wnrbb7gy.fsf%40arvindsv.com.

Re: [go-cd] Java LTS Support in GoCD

[Aravind SV]

Hello,

There's also a similar conversation which happened over at: 


 Is it just too much work to test such an "old" version?

I think, partially, yes.

 Sorry if this is not the right place to raise this but it didn't seem 
appropriate to raise a GitHub Issue at this point. I would love to hear other 
people's thoughts on this.

No, this is the right place to bring it up.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m25yywco65.fsf%40arvindsv.com.

Re: [go-cd] How to setup password authentication on Windows GoCD

[Aravind SV]

> If there are further posts from you which are disrespectful, you will be 
banned from posting.

Narrator: They weren't.

Was put in a moderation queue. Banned once messages with direct abuse were 
received.


On Saturday, May 29, 2021 at 12:49:50 AM UTC+1 Marques Lee wrote:

> > The plugin repo site is just as useless.
>
> It’s not, and TBH, what actually seems to be useless is your ability to 
> use Google or any other reputable search engine.
>
>
> Everything we’ve posted is quite easily searchable.
>
>
> I mean googling “create htpasswd in windows” would have yielded results — 
> even online generators to create htpasswd files. It really doesn’t get much 
> easier, and had you spent the 20 seconds it took to find it, you’d be on 
> your way already if you had just done the basic due diligence expected on 
> the Internet. In any case, being negative to folks who have tried to help 
> you out won’t get you very far anywhere.
>
> On Fri, May 28, 2021 at 4:19 PM Marques Lee  
> wrote:
>
>> Also to add on top of that, it’s generally expected of users to do a 
>> *bare minimum* of effort to research things, especially if they are out of 
>> scope. If you saw a note about htpasswd and realized it what it is, it’s is 
>> *your responsibility* to at least try to find out how that works.
>>
>> You have to try too. Documentation is already at a reasonable level of 
>> hand-holding. We can’t spoon feed you all requisite knowledge. Otherwise 
>> we’d be teaching you how to use bash as well, which is clearly beyond the 
>> scope of GoCD.
>>
>> On Fri, May 28, 2021 at 1:56 PM Aravind SV  
>> wrote:
>>
>>> > andfor your info..YES it needs to say EXACTLY how to set it up.   
>>> Documentation needs to be complete with no guess work involved.
>>>
>>> Not really. Please stop acting so entitled. You don't "deserve" 
>>> anything. Here's a document that might help you: 
>>> http://catb.org/~esr/faqs/smart-questions.html#rtfm and maybe read 
>>> about open-source projects. I'd suggest being nicer to people who are 
>>> helping you out, for no gain whatsoever to themselves.
>>>
>>> Here is  the code of conduct for this forum: 
>>> https://github.com/gocd/gocd/blob/master/CODE_OF_CONDUCT.md
>>>
>>> If there are further posts from you which are disrespectful, you will be 
>>> banned from posting.
>>>
>>> Thank you,
>>> Aravind
>>>
>>> On Friday, May 28, 2021 at 8:11:16 PM UTC+1 Marques Lee wrote:
>>>
>>>> Overall, this is described here: 
>>>> https://docs.gocd.org/current/configuration/dev_authentication.html
>>>>
>>>> On Fri, May 28, 2021 at 12:10 PM Marques Lee  
>>>> wrote:
>>>>
>>>>> Here’s how to do it on Windows:
>>>>>
>>>>>
>>>>> https://github.com/gocd/gocd-filebased-authentication-plugin#htpasswd-on-windows
>>>>>
>>>>> Then configure the path to the file:
>>>>>
>>>>>
>>>>> https://github.com/gocd/gocd-filebased-authentication-plugin#configuration
>>>>>
>>>>>
>>>>> On Fri, May 28, 2021 at 9:54 AM 'smtechx5000' via go-cd <
>>>>> go...@googlegroups.com> wrote:
>>>>>
>>>>>> Yeah, already know that.  Is there a step by step process for 
>>>>>> creating the file, where to put the file, the format for the path in the 
>>>>>> authentication setup for Windows?  Im not seeing anything anywhere on 
>>>>>> how 
>>>>>> to set the password authentication up.  Also, I noticed that you cant 
>>>>>> use 
>>>>>> notifications, which I need unless you have the authentication enabled.  
>>>>>>  
>>>>>> Im blocked.
>>>>>>
>>>>>> On Thursday, May 27, 2021 at 11:29:37 PM UTC-4 Marques Lee wrote:
>>>>>>
>>>>>>> If you’re referring to the default password file, it’s in Apache 
>>>>>>> htpasswd format.
>>>>>>>
>>>>>>> On Thu, May 27, 2021 at 7:02 PM 'smtechx5000' via go-cd <
>>>>>>> go...@googlegroups.com> wrote:
>>>>>>>
>>>>>>>> Setting up password authentication on Windows.   What is a password 
>>>>>>>> file and how do I create one on Windows?
>>>>>>>>
>>>>>>>> -- 
>>>>>&g

Re: [go-cd] How to setup password authentication on Windows GoCD

[Aravind SV]

> andfor your info..YES it needs to say EXACTLY how to set it up.   
Documentation needs to be complete with no guess work involved.

Not really. Please stop acting so entitled. You don't "deserve" anything. 
Here's a document that might help you: 
http://catb.org/~esr/faqs/smart-questions.html#rtfm and maybe read about 
open-source projects. I'd suggest being nicer to people who are helping you 
out, for no gain whatsoever to themselves.

Here is  the code of conduct for this forum: 
https://github.com/gocd/gocd/blob/master/CODE_OF_CONDUCT.md

If there are further posts from you which are disrespectful, you will be 
banned from posting.

Thank you,
Aravind

On Friday, May 28, 2021 at 8:11:16 PM UTC+1 Marques Lee wrote:

> Overall, this is described here: 
> https://docs.gocd.org/current/configuration/dev_authentication.html
>
> On Fri, May 28, 2021 at 12:10 PM Marques Lee  
> wrote:
>
>> Here’s how to do it on Windows:
>>
>>
>> https://github.com/gocd/gocd-filebased-authentication-plugin#htpasswd-on-windows
>>
>> Then configure the path to the file:
>>
>> https://github.com/gocd/gocd-filebased-authentication-plugin#configuration
>>
>>
>> On Fri, May 28, 2021 at 9:54 AM 'smtechx5000' via go-cd <
>> go...@googlegroups.com> wrote:
>>
>>> Yeah, already know that.  Is there a step by step process for creating 
>>> the file, where to put the file, the format for the path in the 
>>> authentication setup for Windows?  Im not seeing anything anywhere on how 
>>> to set the password authentication up.  Also, I noticed that you cant use 
>>> notifications, which I need unless you have the authentication enabled.   
>>> Im blocked.
>>>
>>> On Thursday, May 27, 2021 at 11:29:37 PM UTC-4 Marques Lee wrote:
>>>
 If you’re referring to the default password file, it’s in Apache 
 htpasswd format.

 On Thu, May 27, 2021 at 7:02 PM 'smtechx5000' via go-cd <
 go...@googlegroups.com> wrote:

> Setting up password authentication on Windows.   What is a password 
> file and how do I create one on Windows?
>
> -- 
> You received this message because you are subscribed to the Google 
> Groups "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send 
> an email to go-cd+un...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/go-cd/bbce99d5-1394-4a57-9970-8672e6925124n%40googlegroups.com
>  
> 
> .
>
 -- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "go-cd" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to go-cd+un...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/go-cd/9edd3a39-9ed4-4a3c-9c41-0e579eb84685n%40googlegroups.com
>>>  
>>> 
>>> .
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/f5ddf3b0-4ed6-4ef4-b29d-4679de943e7an%40googlegroups.com.

Re: [go-cd] go server / agent upgraded to 21.2.0 and agent lost contact

[Aravind SV]

I agree with Ashwanth. It might also be a matter of trying to upgrade from a 
very old version to the latest, without considering changes in the versions in 
between.

For instance, [20.2.0](https://www.gocd.org/releases/#20-2-0) made some SSL/TLS 
changes which will need to be considered if upgrading from an old version. My 
suggestion would be to set up a test server and test agent and try the upgrade 
there, reading all the release notes in between for any major changes. The 
biggest changes usually will be Java version changes, one-time DB upgrade 
(around 20.5.0, I think) and SSL/TLS changes.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2o8cxetca.fsf%40arvindsv.com.

Re: [go-cd] Analytics plugin Mysql DB Setup

[Aravind SV]

I'd think using Postgres would be easier than making sure all the queries work 
properly and do what they're supposed to. Some of the queries are 
[here](https://github.com/gocd/gocd-analytics-plugin/tree/e6b0c514934169f68e82c91801c5ac5f0d9738ba/src/main/java/com/thoughtworks/gocd/analytics/mapper).

Though the queries are probably not complex, building the infrastructure (both 
code and test) to ensure that both DBs work, is likely much more work.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m21r9yfy18.fsf%40arvindsv.com.

Re: [go-cd] Downloading yaml config of UI configured jobs

[Aravind SV]

 There's a pipeline export function --- if you go to Admin  Pipelines 
you will see a list of your pipelines.

As with almost everything in the UI, there is also an API for this:



Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2fsypmux3.fsf%40arvindsv.com.

Re: [go-cd] Do we have HA (high availability) in GO CD, Such as a Load balancer

[Aravind SV]

Hello Hussein,

I believe it was brought into GoCD: 


Postgres support is also built into GoCD now.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m25yzya1bl.fsf%40arvindsv.com.

Re: [go-cd] Question about setting up postgres for 20.5.0

[Aravind SV]

Hello Jo,

These steps from some older documentation is what I believe works with RDS (and 
should really be part of the new documentation):

1.  Bring up a local PostgreSQL server. Using a database superuser account, 
perform the migration on this local PostgreSQL server.

2.  Once the migration is successful, take a database dump of the migrated DB:

``` shell
pg_dump --no-owner -h  -p  -U  
--dbname= .sql
```

3.  Create a PostgreSQL database on RDS and make the superuser (who is part of 
rds_superuser group), the owner of that database.

4.  Using the `.sql` created in step 2 above, restore the 
PostgreSQL database on your Amazon RDS instance:

psql -f .sql -h  -p 
 -U  --password --dbname=

The above command will prompt for the password. Once the database is restored 
you can point your GoCD server to that Amazon RDS instance. As always, please 
have a backup and test this before doing anything.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2k0onihfa.fsf%40arvindsv.com.

Re: [go-cd] Looking for Steering Committee updates

[Aravind SV]

Hello Thomas,

There is a slightly newer update from Dec 2020
. However,
as the designated "communicator" for the steering group, it's a miss from
my side that the bootstrap steering committee GitHub repo isn't up to date.
Apologies. Will fix that.

Beyond the update from Dec 2020, there isn't too much which has changed:

   - The AWS credits which were mentioned there did come through! That
   reduced the urgency a bit, since the infrastructure needed for GoCD
   continues, and there have been two releases of GoCD since then making use
   of that.

   - GoCD does need more engineering activity and help. Essentially people
   who can help support, extend, improve GoCD. Previous members of the team
   are all working on other things, with a small subset helping out when
   possible.

   - The call for statements of support mentioned in the Dec 2020 update is
   still open and any thoughts around the sustainable future mentioned there
   are welcome.

Reagrds,
Aravind


On Fri, Apr 16, 2021 at 1:22 PM Thomas Scully  wrote:

> Good morning!
>
> Yesterday, my team and I came across the announcement
>  that external community
> members will be supporting GoCD in the future. We noticed the steering
> committee but haven't seen any updates as of August 2020. Is there any
> documentation or roadmap we are missing? We are wondering if the steering
> committee is taking over ownership or if there is any information around
> that. Thanks!
>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/5b7a4a86-16d3-459c-8bb2-4310da412cedn%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychEsSD3Nto0gMdX_HbRSzXBMQ0uXX0%2ByUNosx%2BD6U-AoBg%40mail.gmail.com.

Re: [go-cd] Error when updating from 20.8.0 to 20.9.0

[Aravind SV]

Ooh. Once you start changing the DB manually ... all bets are off. Regarding 
the pipeline history page, it'll likely be joining a few tables. Here are some 
pointers that might help:

1.  See [this 
query](https://github.com/gocd/gocd/blob/fdbdbd4477cd8ae9b90b5dae883199f01fe00dce/server/src/main/resources/com/thoughtworks/go/server/dao/maps/Pipeline.xml#L282)
 and [this 
one](https://github.com/gocd/gocd/blob/fdbdbd4477cd8ae9b90b5dae883199f01fe00dce/server/src/main/resources/com/thoughtworks/go/server/dao/maps/Pipeline.xml#L296).
 These might not be the right ones, but will give you a sense of the kind of 
things being done. You'll need to follow the "include" tags to find the 
queries which will be merged into this one.

2.  [Outdated DB schema 
diagram](https://github.com/gocd/developer.go.cd/blob/a76dac9fbfd06e550b2558326ef91b40715f0729/source/4/images/database_schema.png):
 Might give you a sense of the connections. It's outdated though. So, don't 
rely on it too much.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2zgy1svsa.fsf%40arvindsv.com.

Re: [go-cd] Error when updating from 20.8.0 to 20.9.0

[Aravind SV]

Hello Nikolay, ,

That's strange. Can you [open an issue on 
GitHub](https://github.com/gocd/gocd/issues/)?

I think you should look for a row where the state column is "Passed". Looks 
like there's some data that is wrong (not sure how). The valid values of 
JobState [are 
here](https://github.com/gocd/gocd/blob/cccb4960bde1166ccd79277093295ed5a18573ed/domain/src/main/java/com/thoughtworks/go/domain/JobState.java#L18-L29).

Someone who looks at the issue there might be able to help more.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2a6q6vaww.fsf%40arvindsv.com.

Re: [go-cd] Add environment variables to config repository

[Aravind SV]

Hello,

Do you mean something more than / different from *using* environment variables 
within a config repository?



Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2y2e3pt4c.fsf%40arvindsv.com.

Re: [go-cd] Migrating a GoCD instance between instances, startup hanging on Hibernate task

[Aravind SV]

Good to know. Thank you for following up. I'm sure it'll help someone, at some 
point. :)

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m24khbgs8s.fsf%40arvindsv.com.

Re: [go-cd] Migrating a GoCD instance between instances, startup hanging on Hibernate task

[Aravind SV]

Yes, 17.11 is quite old and it's hard to say what the problem could be. A 
couple of things I'd look at:

1.  Run: `kill -3 go-server-process-id` and it will show you stack traces, 
which might tell you what the main thread is doing.

2.  The pipeline timeline update query is quite time consuming, but everything 
else being the same, it should be as fast as the older setup. Maybe some DB 
indexes are missing?

3.  You could see if the same behaviour is seen if you move to a new DB schema 
on the old DB server itself to remove any suspicion on the new DB server's 
performance.

> I notice a lot of the backup and restore docs speak about backup and 
> restoring the db but it isn't clear whether there is any data that would stop 
> you loading that dump up in a different location or not - something specific 
> to the 'old home' of the db data that you'd need to amend before you could 
> use that as the database for a newer system.

I don't think there is anything like that.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m28s6ogn44.fsf%40arvindsv.com.

Re: [go-cd] Pipeline as code not reflecting on dashboard

[Aravind SV]

Hello,

Maybe there is a problem accessing the repository? See if there is an error box 
(in red) in the top right. If not, see if you turned off polling for that 
repository (in its config).

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2sg56t05n.fsf%40arvindsv.com.

Re: [go-cd] Re: Using GoCD API withing a Pipeline

[Aravind SV]

Hello,

> One problem I have not worked out yet is this: Having a pipeline on one GoCD 
> server (via an agent) call a pipeline on another GoCD server (via the API). 
> The point of this would be to relieve the server-single-point-of-failure and 
> server-bottle-neck we are seeing at our site. I see that the server is not 
> horizontally scalable and think this is a big problem with the design. Some 
> things (such as polling GIT) can only happen on the server and if the server 
> locks up (ours does frequently) everything stops. Horizontally scaling the 
> server might help. Calling one server via the API from another might \"fake 
> it\".

You could see if setting up a post-commit notification 
() works for you. If it does, 
it usually reduces the load on your GoCD server (especially due to material 
polling) by a lot.

You should also be using Postgres as the DB for any large-ish instances of 
GoCD. It usually helps with performance and is easier to back up the data etc.

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m235xfcmwl.fsf%40arvindsv.com.

Re: [go-cd] Re: Could someone please help me understand using API?

[Aravind SV]

Marques: I think this post came through later, after being stuck in a spam 
check queue. I don\'t think this part of the question is valid any more.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m25z2ec7vy.fsf%40arvindsv.com.

Re: [go-cd] Re: About Gocd swag

[Aravind SV]

Hello,

I believe you\'re talking about ? If so, 
as I mentioned a couple of times, there is no bounty or swag. We used to give 
out swag (don\'t any more) but all the offices are closed. :/

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2sg5ks950.fsf%40arvindsv.com.

Re: [go-cd] Question: What happens to GoCD agent when the Java wrapper tanuki license expired?

[Aravind SV]

Hello Danny, ,

> Knowing that the end date here is this year June, what will happen when the 
> date arrived in 4 months time?  
> Will GoCD agent refuse to start when a restart occured?

No, nothing should happen. This license has been renewed every year for the 
last 10 to 12 years. It will be again. But, *even* if it doesn\'t, there is no 
issue. Existing applications continue to work.

You can read more about the license used here: 


As you can see in the section called \"License Term\", it is mentioned that the 
term end date has no effect on the working of the wrapper. The effect of not 
renewing it will be an inability to release *new* versions of GoCD with that 
wrapper. Since GoCD is open-source, ideally the [Community License 
Agreement](https://wrapper.tanukisoftware.com/doc/english/licenseCommunity.html)
 should apply. However, as you can see in a note on the [download 
page](https://wrapper.tanukisoftware.com/doc/english/download.jsp), \"64-bit 
Windows versions of the Java Service Wrapper are not currently being made 
available in the Community Edition\".

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2lfbn0z4b.fsf%40arvindsv.com.

Re: [go-cd] Pipeline files in subdirectory

[Aravind SV]

It *should* just work. The default file search pattern in mentioned here: 


-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2lfbxl097.fsf%40arvindsv.com.

Re: [go-cd] Re: Help! API returning 403 after upgrade to 20.10.0

[Aravind SV]

Hello Jeff,

*Usually*, when a change in behavior is made, it is behind a feature flag, to 
help in case anyone is affected a lot. If no one has a concern after a while, 
those flags are removed. It looks like this change also has a flag: 


Can you see if that does what you need? If it does, then we can keep it around 
as an option for you, but leave the default as it is now, since it is more 
secure.

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m235z69q4n.fsf%40arvindsv.com.

Re: [go-cd] Global Variable - GO CD

[Aravind SV]

Materials are part of a pipeline and so, they are updated using the "Edit 
pipeline config" API call: 

You'll need to do a GET and then a PUT with an `If-Match` header based on the 
GET response: 


-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2r1mrafdd.fsf%40arvindsv.com.

Re: [go-cd] Task Plugin: Web UI does not set number input value

[Aravind SV]

I think this is an issue with how AngularJS handles string values in the model 
provided to the `` field. See: 


If you do need to write some Javascript to change the type, I'm not sure 
whether you have access to `$scope`, but you should be able to write Javascript 
in the template after this change: 

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2sg86hqm0.fsf%40arvindsv.com.

Re: [go-cd] Re: Migrating (or simply reimplimenting) from Go Version: 18.9.0 to lateast and greatest

[Aravind SV]

Hello Brian,

This thread from the mailing list is relevant:  


About gomatic: Last I heard, it wasn't compatible with the latest versions of 
GoCD. I'd look into one of the pipelines as code plugins supported by GoCD 
instead:

  
  


Once you upgrade, you will even be able to programmatically export pipelines to 
one of those formats:  


Cheers,  
Aravind

PS: A full backup before you continue would be my recommendation.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m25z5hykq1.fsf%40arvindsv.com.

Re: [go-cd] Re: Tasks Plugin: Form help text & placeholders

[Aravind SV]

You certainly don’t need to pull it. :) You should submit a PR to get it
listed on the site too.

I’d urge you and others to not depend on task plugins, because it ties you
to the tool unnecessarily. That’s all.

I’ve seen others ask: “Why isn’t there a plug-in for X??” before and
understanding the reason for it helps sometimes.

Cheers,
Aravind

On Wed, 2 Dec 2020 at 22:03, Joel Bodenmann  wrote:

> Well, I literally just finished publishing the first version of my task
> plugin (see my other conversation announcing it). So this is a bit of a
> bummer now... :-(
> I guess I'm gonna sleep a night over it but I think pulling back the new
> plugin would be a bit of a shame.
>
> I fully understand where you come from and I am certainly far from
> qualified to take place in any kind of discussion like that as I am brand
> new to GoCD. I am coming from Jenkins so I might be a bit biased from that
> side as you also explained.
>
>
> Best regards,
> ~ Joel
>
> On Wednesday, December 2, 2020 at 7:49:07 PM UTC+1 Aravind SV wrote:
>
>> Yes, it's complicated because it's an Angular template with its own
>> syntax. This is so that a plugin can provide the template. If you have code
>> publicly available, I might be able to take a look in a couple of days.
>>
>> By the way: I'm a big opponent (is that the right word a non-proponent?)
>> of task plugins. I think they shouldn't exist / be used. I rant about them
>> often. Here's one of them:
>> https://groups.google.com/d/topic/go-cd/9bmEV3R7JBk/discussion. It's
>> very different from how (for instance) the Jenkins world thinks about
>> plugins. I'd really consider pipelines as code
>> <https://github.com/tomzo/gocd-json-config-plugin> or simple shell
>> scripts instead of task plugins.
>>
>> Cheers,
>> Aravind
>>
>> On Wed, Dec 2, 2020 at 5:40 PM Joel Bodenmann  wrote:
>>
>>> Never mind - got it working. I needed to specify *ng-true-value* and
>>> *ng-false-value* to strings that Java's *Boolean.parseBoolean()* can
>>> understand.
>>>
>>> Now the only thing left is fixing the issue that my *number* input is
>>> not set to the value from the XML (although it is being saved correctly)
>>> when opening the task config view. It's always empty (showing the
>>> placeholder) instead of displaying the value from the XML config.
>>>
>>>
>>> Best regards,
>>> ~ Joel
>>>
>>> On Wednesday, December 2, 2020 at 5:00:27 PM UTC+1 Joel Bodenmann wrote:
>>>
>>>> Aravind,
>>>>
>>>> I've come across that piece of documentation when starting to look at
>>>> the possibility of creating my own Task plugin. In my opinion the
>>>> documentation does a good job at giving a quick overview but I found that
>>>> some more advanced/complex examples might be helpful.
>>>> Once I gathered the necessary experience to finish my first plugin I'll
>>>> look into providing a PR extending the documentation.
>>>>
>>>> I am not a web developer so please forgive me if I should really not
>>>> ask this here but: I managed to get everything working so far. I've a task
>>>> plugin with the HTML config view that uses HTML input fields of type
>>>> *text *and *number * to configure my task. So far so good.
>>>> Next I wanted to add a checkbox for some conditional task behavior.
>>>> However, I can't manage to get the checkbox to save to the XML. I've copied
>>>> the fragments of my other *text* and *number* fields and simply
>>>> changed the type to *checkbox* and adjusted the *ng-model* attribute
>>>> to "link" to the new boolean setting.
>>>>
>>>> Is there anything special about getting back the checked/unchecked
>>>> state of a checkbox?
>>>>
>>>> This is my HTML fragment for the checkbox:
>>>>
>>>> 
>>>>   >>> ="false"/>
>>>>   Enable
>>>>   
>>>>
>>>> If I look at the config form using the inspector I can see that my
>>>> *text* and *number* input fields still have the *ng-** attributes but
>>>> the checkbox in question has been stripped of the *ng-model* and
>>>> *ng-required* attribute.
>>>>
>>>> I'd appreciate it a lot if somebody could help out an embedded C++
>>>> developer here not accustomed to work with AngularJS.
>>>>
>>>>
>>>> Best regards,
>>>> ~ Joel
>>>> On Wedne

Re: [go-cd] Re: Tasks Plugin: Form help text & placeholders

[Aravind SV]

Yes, it's complicated because it's an Angular template with its own syntax.
This is so that a plugin can provide the template. If you have code
publicly available, I might be able to take a look in a couple of days.

By the way: I'm a big opponent (is that the right word a non-proponent?) of
task plugins. I think they shouldn't exist / be used. I rant about them
often. Here's one of them:
https://groups.google.com/d/topic/go-cd/9bmEV3R7JBk/discussion. It's very
different from how (for instance) the Jenkins world thinks about plugins.
I'd really consider pipelines as code
<https://github.com/tomzo/gocd-json-config-plugin> or simple shell scripts
instead of task plugins.

Cheers,
Aravind

On Wed, Dec 2, 2020 at 5:40 PM Joel Bodenmann  wrote:

> Never mind - got it working. I needed to specify *ng-true-value* and
> *ng-false-value* to strings that Java's *Boolean.parseBoolean()* can
> understand.
>
> Now the only thing left is fixing the issue that my *number* input is not
> set to the value from the XML (although it is being saved correctly) when
> opening the task config view. It's always empty (showing the placeholder)
> instead of displaying the value from the XML config.
>
>
> Best regards,
> ~ Joel
>
> On Wednesday, December 2, 2020 at 5:00:27 PM UTC+1 Joel Bodenmann wrote:
>
>> Aravind,
>>
>> I've come across that piece of documentation when starting to look at the
>> possibility of creating my own Task plugin. In my opinion the documentation
>> does a good job at giving a quick overview but I found that some more
>> advanced/complex examples might be helpful.
>> Once I gathered the necessary experience to finish my first plugin I'll
>> look into providing a PR extending the documentation.
>>
>> I am not a web developer so please forgive me if I should really not ask
>> this here but: I managed to get everything working so far. I've a task
>> plugin with the HTML config view that uses HTML input fields of type
>> *text *and *number * to configure my task. So far so good.
>> Next I wanted to add a checkbox for some conditional task behavior.
>> However, I can't manage to get the checkbox to save to the XML. I've copied
>> the fragments of my other *text* and *number* fields and simply changed
>> the type to *checkbox* and adjusted the *ng-model* attribute to "link"
>> to the new boolean setting.
>>
>> Is there anything special about getting back the checked/unchecked state
>> of a checkbox?
>>
>> This is my HTML fragment for the checkbox:
>>
>> 
>>   > ="false"/>
>>   Enable
>>   
>>
>> If I look at the config form using the inspector I can see that my *text* and
>> *number* input fields still have the *ng-** attributes but the checkbox
>> in question has been stripped of the *ng-model* and *ng-required*
>>  attribute.
>>
>> I'd appreciate it a lot if somebody could help out an embedded C++
>> developer here not accustomed to work with AngularJS.
>>
>>
>> Best regards,
>> ~ Joel
>> On Wednesday, December 2, 2020 at 3:09:31 PM UTC+1 Aravind SV wrote:
>>
>>> Agree!
>>>
>>> The source of the current documentation is:
>>>
>>> https://github.com/gocd/plugin-api.go.cd/blob/master/source/includes/shared/_angular-templates.md
>>>
>>> It looks like this:
>>> https://plugin-api.gocd.org/current/tasks/
>>>
>>> Pull requests are always welcome. Not just from Joel. :) But, for anyone
>>> who finds that the documentation can be improved.
>>>
>>> Cheers,
>>> Aravind
>>>
>> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/e316992e-3e4a-44c9-aa4c-6c5cb36e6733n%40googlegroups.com
> <https://groups.google.com/d/msgid/go-cd/e316992e-3e4a-44c9-aa4c-6c5cb36e6733n%40googlegroups.com?utm_medium=email_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychH5LjuH8qJN7M5aQPtXEZBY0E5oq2q%2BVq35E_VW81TPJw%40mail.gmail.com.

Re: [go-cd] Re: Tasks Plugin: Form help text & placeholders

[Aravind SV]

Agree\!

The source of the current documentation is:  


It looks like this:  


Pull requests are always welcome. Not just from Joel. :) But, for anyone who 
finds that the documentation can be improved.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2lfegmh9n.fsf%40arvindsv.com.

Re: [go-cd] Cannot run agent in MSYS2

[Aravind SV]

Hello,

I completely agree with Jason about creating that boundary.

About the difference between the server and the agent, I'm not sure, but did 
you try downloading the zip "installer" option?

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2sg8tda5h.fsf%40arvindsv.com.

Re: [go-cd] Recommendations for multi-platform builds, tests & deployments

[Aravind SV]

Hello Joel,

I can't speak to a typical C++ build in GoCD, but some of the questions you 
bring up have been tackled in this blog post series:



In particular, these two:

  -   
  - 

Also see:

  -   
  - 

There's no correct answer for this, in my opinion. One thing I'd make sure to 
do is to keep most logic outside of the CD tool, and in scripts I control.

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m21rgge3zv.fsf%40arvindsv.com.

Re: [go-cd] can't start the server in develepment mode

[Aravind SV]

Hello Liang,


Did you follow all the steps in https://developer.gocd.org/current/ and then this happened in one of those steps? Can you provide more information?


Regards,
Aravind





-- 
You received this message because you are subscribed to the Google Groups "go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/go-cd/m2tutqed6v.fsf%40arvindsv.com.

Re: [go-cd] Elastic agent registration problem from Windows docker swarm plugin

[Aravind SV]

Hello,

I see. You're creating your own image.

The docker image provided by GoCD (on DockerHub) [does 
this](https://github.com/gocd/docker-gocd-agent-dind/blob/fd70ef0eb4c2ff750ad297b1810b08bd31f11229/docker-entrypoint.sh#L26-L36)
 to populate the `autoregister.properties` file correctly, based on environment 
variables passed in by the plugin when it wants to start an elastic agent. Do 
you do that in your image too? The values passed in should be used. That's how 
the server / plugin knows that the agent it was waiting for has come up.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2eel9xt9l.fsf%40arvindsv.com.

Re: [go-cd] Elastic agent registration problem from Windows docker swarm plugin

[Aravind SV]

Hello,

Elastic agents are not started by users. They're started automatically, using 
an elastic agent plugin. If you use one, you won't need to set agent 
properties, etc. That's the whole point of it being elastic, in that it creates 
an agent when needed and gets rid of it when it's not needed any more.

You'll need to create a cluster profile and an elastic agent profile, and 
associate the job with the elastic agent profile (which you mention you've 
done). Then, when the job needs to run, the information in the profile will be 
used to create an agent.



Not sure which documentation you're seeing. Also, I don't know if the Docker 
Swarm plugin works on Windows – maybe someone has used it on Windows. I don't 
have that experience.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2sg9qxvyo.fsf%40arvindsv.com.

Re: [go-cd] Batch file on Windows not exiting

[Aravind SV]

Hello Andy,

I'm not sure.

On Windows, GoCD should be running eveything with [`cmd 
/c`](https://github.com/gocd/gocd/blob/fa1c20b7450a60af1434b0dcb4f473f6fa14ff18/common/src/main/java/com/thoughtworks/go/domain/builder/CommandBuilder.java#L44-L48).
 So, you shouldn't have to do anything except use `start_docker.bat`. Maybe 
it's a `PATH` issue which is preventing you from using that?

Might be worth trying to use the whole path to `start_docker.bat` and checking. 
If it "hangs" as in when you used `start /k` etc, it usually means that a child 
process is keeping the standard output open and not exiting. You could try 
adding a message before the exit, to see if it reached there (it likely will).

If none of those work, someone with a Windows setup might need to help / might 
have more ideas.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2sg9zwsq7.fsf%40arvindsv.com.

Re: [go-cd] Batch file on Windows not exiting

[Aravind SV]

Hello Andy,

Have you tried just `start_docker.bat`? What happens with that?

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2v9evwvcg.fsf%40arvindsv.com.

Re: [go-cd] Spin up jails instead of containers for elastic agents in FreeBSD

[Aravind SV]

Elastic agent plugins are based on this plugin interface: 


It's possible to write your own, if you want.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2v9exxvmq.fsf%40arvindsv.com.

Re: [go-cd] Delete pipelines

[Aravind SV]

Hello Anouar,

\[Adding the group since it might be useful to others\]

> Do you have any suggestions to reduce the size of the database, we have more 
> than 600 popelines to delete because they are inactive and we dont want to 
> delete them and keep their data in our database. The database is H2, the .db 
> file is loaded in memory when starting GoCD and it’s causing a lot of 
> slowness because the file became voluminous.
> 
> What is the best practice to perform this clean up?
> 
> Migrating to 20.7 to take advantage of postgres is not an option for us 
> because the validation of the tool after the migration will be costly and 
> will take too much time and resources, and this validation is mondatory 
> because we work in -redacted-by-aravind- field.

Unfortunately there isn't a known way to delete pipeline history from the 
database. This was brought up in an early GoCD issue, [issue 
\#13](https://github.com/gocd/gocd/issues/13). There can be side effects on 
VSM, fan-in and other parts of GoCD by having "holes" in history.

I'd usually recommend moving to Postgres, but you say that's not possible. 
Given that validation is important, I don't see how deleting random content 
from the internal database can keep your existing validation … valid. That 
seems way more dangerous than using a documented database option (Postgres) 
which offers much better overall performance for the system.

The other option when slowness comes up in any system, I guess, is to see if 
increasing memory and CPU provided, or improving the speed of disk etc. will 
help. But, that's something that depends on your environment and setup.

Regards,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2ft6pxe3f.fsf%40arvindsv.com.

Re: [go-cd] Delete pipelines

[Aravind SV]

Hello Anouar,

It's not recommended to change the DB manually. All bets are off if you do. I'm 
sure there are dependencies etc. which will cause problems at a later time.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m27ds2ze9w.fsf%40arvindsv.com.

Re: [go-cd] Migrating and Upgrade GoCD Version

[Aravind SV]

Hello Carlos,

This questions keeps getting asked in the mailing list. Searching the archives 
might give you more ideas. Generally, as long as you have a backup and try it 
in a test setup, it should be fine.

Things I'd watch out for:

1.  Java versions supported by newer versions will have changed from 18.x. If 
using Docker, maybe it's not much of a problem.

2.  A couple of releases such as 
[20.2.0](https://www.gocd.org/releases/#20-2-0) (for its TLS changes) and 
[20.5.0](https://www.gocd.org/releases/#20-5-0) (for its database changes) come 
to mind. As [Ketan recommended in an old 
topic](https://groups.google.com/forum/#!topic/go-cd/MeQos8NXt0Q), you should 
read all the release notes for breaking changes.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2o8mfe2f9.fsf%40arvindsv.com.

Re: [go-cd] GoCD 19.1.0 Git material unwanted clean

[Aravind SV]

Hello Denis,

It's hard to say for sure, just from that, but these are some behaviors I 
believe are true:

1.  If there are files left behind *inside* a git repository checked out 
folder, then it will run a `git clean`. No way to stop that. It will need to 
make sure every job run starts with a clean slate.

2.  If you haven't asked it to clean working directory, then it won't delete 
and re-clone. So, timestamps of unmodified files should be the same (depending 
on how git handles them).

3.  If you're able to *use* the checked out files, but have your workspace 
(which gets "dirty") in a location outside the repository checkout location, 
then GoCD shouldn't touch those directories outside the repo location.

I mean: Suppose you configure the material to check out into folder "src1" and 
then run your build from the parent dir of "src1", then `git clean` should run 
only within "src1", leaving your workspace in the parent untouched. It isn't 
recommended to depend on something left behind, as I said, but that's one way 
that might work in this case, assuming it works for your build system to work 
that way.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2363x8vrh.fsf%40arvindsv.com.

Re: [go-cd] Material clone failed

[Aravind SV]

Hello,

GoCD doesn't do anything more than use the git (external) command. Maybe you 
can see the git config in the checkout folder and see what it looks like? Since 
it does accept username/password now for git materials, it does try to use that 
while cloning, but the git config should give you more information anyway.

On the GoCD server side, it'll be in the server directory, under 
"pipelines/flyweight". Something like `/var/lib/go-server/pipelines/flyweight` 
on Linux.

Cheers,  
Aravind

PS: If you have more information or a verified set of steps to reproduce it, 
please open an issue.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m25z8t8w5l.fsf%40arvindsv.com.

Re: [go-cd] GoCD crash after upgrading from 20.4 to 20.7

[Aravind SV]

Hello Luca,

Something seems wrong in your installation. I see lines like this:

> Failed to instantiate 
> \[com.thoughtworks.go.server.database.DatabaseStrategy\]: Constructor threw 
> exception; nested exception is java.lang.RuntimeException: Failed loading 
> database provider \[com.thoughtworks.go.postgresql.PostgresqlDatabase\]

The class DatabaseStrategy was removed in 20.5.0 in [PR 
\#7646](https://github.com/gocd/gocd/pull/7646) and so it shouldn't exist in 
20.7.0. Maybe the GoCD server upgrade didn't finish properly or something. I'd 
try with a normal zip "installer", point it to your PG DB and see if it's ok.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m28sdp8wjd.fsf%40arvindsv.com.

Re: [go-cd] GoCD 19.1.0 Git material unwanted clean

[Aravind SV]

Hello Denis,

It depends. GoCD just does a `git clean` as I mentioned, which shouldn't change 
modified times of your codebase, I mean, of files which haven't changed, right?

If you've asked it to clean working directory, it will remove and re-clone. 
Otherwise, it shouldn't change. Of course, if you have multiple agents, you 
can't guarantee that the same agent will pick up your job across days without 
using GoCD's job resources.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m21rjla4mk.fsf%40arvindsv.com.

Re: [go-cd] GoCD 19.1.0 Git material unwanted clean

[Aravind SV]

Hello Denis,

The working directory will always be cleaned using something like `git clean 
-dff` (or `git clean -dffx` maybe) before any job starts. If you really need 
something across runs, then you should move it out of the workspace directory. 
However, please note that this is not recommended. One of the concepts of CI is 
repeatability. It shouldn't depend on the environment of a previous run of a 
job or pipeline.

The GoCD way of keeping state across stages within a pipeline (for instance) is 
to use artifacts.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m24kopl0no.fsf%40arvindsv.com.

Re: [go-cd] Artifact Cleanup by Pipeline

[Aravind SV]

Hello Erik,

There's a pull request in this area, which is open: 


Maybe you can add to that conversation there, so that the PR can accommodate 
what you're thinking about.

Cheers,  
Aravind

PS: There isn't a pipeline-level config to retain a set number of artifacts.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2k0xnytqy.fsf%40arvindsv.com.

Re: [go-cd] Upgrade issue

[Aravind SV]

Hello Brent,

I don't see a broken link. Where did you see it?

I see: [Release notes](https://www.gocd.org/releases/#20-5-0) links to 
[Database migration 
documentation](https://docs.gocd.org/20.5.0/installation/upgrade_to_gocd_20.5.0.html)
 which links to the [migrator 
tool](https://github.com/gocd/gocd-database-migrator). The tool should be 
downloadable from [the GitHub releases 
page](https://github.com/gocd/gocd-database-migrator/releases) of that 
repository.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2wo1wqev3.fsf%40arvindsv.com.

Re: [go-cd] GoCD Docker Agent Installing Python3

[Aravind SV]

Hello Ryan,

This blog post might be useful: 


You'll need to maintain a custom image with extra dependencies, I believe.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m28seds8bo.fsf%40arvindsv.com.

Re: [go-cd] Private git for windows go agent

[Aravind SV]

Hello Jérôme,

This seems similar to: 


You need to see which user the GoCD Agent is running as and change it at the 
level of the service or run a zip agent as a different user. The "System" user 
services run under is not the same as the "Administrator" user.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2o8nesdd3.fsf%40arvindsv.com.

Re: [go-cd] Re: GoCD - Deploy using an artefact rather using git checkout - URGENT please

[Aravind SV]

Hello,

In case it helps, I see Jason had responded earlier to something like this:



Cheers,  
Aravind

PS: Thanks for helping people, Jason. :)

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2v9hqikzm.fsf%40arvindsv.com.

Re: [go-cd] Material update hung help

[Aravind SV]

Hello Krzysztof,

It sounds like a problem with the SSH key set up, especially since it is a 
private repo.

Could it be that the GoCD server is currently running as a user who is not you, 
and the SSH keys are not set up for that user? When you tried the "try out" 
version, it likely ran as your user, and your .ssh directory was set up right.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2o8nmiala.fsf%40arvindsv.com.

Re: [go-cd] Re: Help with more detailed logs from 400 bad request thrown by org.eclipse.jetty.http on GoCD Server

[Aravind SV]

Hello Bob,

> As I said earlier all of this worked just fine in version 19.9, so have there 
> been any changes to how the data is parsed for the config.yml endpoint? 
> Limitations on the field sizes or anything along those lines?

Nothing comes to mind in that area. There were likely some changes around Jetty 
/ TLS though, which might have had some effect.

If it is reproducible though, via a gomatic script you have, we can open an 
issue and look into it. Or, we can reopen: 


If you have such a script, please add a comment in 
 and I will reopen it. Or, open a new 
issue.

Thank you,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2tuxeimb0.fsf%40arvindsv.com.

Re: [go-cd] Re: Help with more detailed logs from 400 bad request thrown by org.eclipse.jetty.http on GoCD Server

[Aravind SV]

Hello Bob, ,

> Actually I don't think this is the issue, Gomatic dumps the XML that it is  
> going to post, I can take this XML and enter it directly into GoCD via the  
> UI without error, it just doesn't work when POST'd to the config.yml  
> endpoint.

Yes, I found something similar in . 
But, I found that I could post it via curl as well, and it was ok.

It doesn't look like a GoCD issue but something wrong with *how* it is POSTed? 
Can you make sure that you used the POST just as I did in that issue, using the 
md5 param, etc.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2wo2aivxq.fsf%40arvindsv.com.

Re: [go-cd] Can not show GoCD Aanalytics Dashboard

[Aravind SV]

Hello,

This is mentioned in the installation documentation as a pre-requisite:



Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2zh78i0p2.fsf%40arvindsv.com.

Re: [go-cd] Edit config repo pipeline via API?

[Aravind SV]

> we have pipelines defined via config repositories and we have a ruby script 
> triggering API calls on demand to reconfigure some parameters and environment 
> variables. Can this even work with config repositories? I'm wondering now, 
> because we are getting an error when editing some parameters via a call to 
> .

No, it's not possible to edit pipelines defined outside of GoCD via the API. If 
that worked, then a subsequent restart of GoCD or even a new commit to the 
repository would overwrite your changes. The repository is the only source of 
truth for those pipelines.

It seems like the error message is quite self-explanatory.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m24kpgjfea.fsf%40arvindsv.com.

Re: [go-cd] Pipeline templates as Code

[Aravind SV]

Hello Helge,

Yes, there has been a lot of discussion around templates in config repos. I'll 
link to some more conversations below.

Unfortunately, there is no plan to incorporate GoCD's templates into config 
repos. Tomasz, the author of configuration repositories, has mentioned a few 
times that he thinks that the GoCD templates are not flexible enough and he 
believes that it's better to have a separate templating mechanism.

Some relevant conversations are here:

  -   
  - 

The one that is closest to templates and a work in progress that is coming 
along well is:  – This is about 
branch support, but it considers templating as a way to get to it.

Another approach for templating might be to look into the [Groovy DSL 
plugin](https://github.com/gocd-contrib/gocd-groovy-dsl-config-plugin).

Cheers,  
Aravind

PS: Apologies for the link spam. :)

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2ft9ry7ps.fsf%40arvindsv.com.

Re: [go-cd] Re: How to use managed secret for Github password

[Aravind SV]

Hello Helge,

> A question regarding Pipelines as code: When exporting the pipeline, e.g. as 
> JSON, the password (or the placeholder) is exported as encrypted string. This 
> is not portable between GoCD instances. Is it somehow possible to specify it 
> in JSON as plain text?

I think not. At the time the export happens, the pipeline does not even know 
that the secret is defined using a secret parameter. Same with templates. So, 
you'll need to replace is after the export. :(

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2imenyaxv.fsf%40arvindsv.com.

Re: [go-cd] Query on upgrading gocd server 19.12 running in a docker container

[Aravind SV]

Hello Steve,

I'm not the best person to answer this. I think there are others here who would 
be using GoCD in this way. I would lean heavily towards approach 2, and not 
messing around with docker exec, etc.

You should still take a full backup before you do anything. You should be able 
to copy everything that matters (DB, config) and try out the second approach 
you mentioned, without too much risk I think.

Cheers,  
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/m2k0ze8738.fsf%40arvindsv.com.

Re: [go-cd] Re: Changes to GoCD in 2020

[Aravind SV]

Hello Roberto,

On Wed, Jun 24, 2020 at 20:00:00 -0700, Roberto Yudice wrote:
> Hi, was the S3 artifact storage plugin going to be open sourced as well?

Not sure which one you're talking about. There wasn't a commercial S3 artifact 
storage plugin.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/20200625083301.3fpfj6ygsvvlsdj6%40arvindsv.com.

Re: [go-cd] Re: Changes to GoCD in 2020

[Aravind SV]

Hello!

Just a quick (and probably final) update from me regarding open-sourcing of
the plugins:

1. GoCD 20.5.0 was released <https://www.gocd.org/releases/#20-5-0> a
couple of days ago. It has support for PostgreSQL built in. The
recommendation is for all production instances of GoCD to make use of
PostgreSQL support. You'll likely see better performance. Please note that
upgrading to 20.5.0 (even if you are not planning to switch to PostgreSQL)
requires a one-time data migration, since the underlying database
technology was changed.

2. GoCD Analytics plugin: This plugin has now been open-sourced at
https://github.com/gocd/gocd-analytics-plugin/ and a release is available
on GitHub releases.

3. Business continuity addon: This will either be bundled with GoCD or made
available as a separate addon. Either way this will be mentioned in the
release notes of the release that happens in. I'm not planning to send an
update to this group when that happens.


*Also*: There is an update about the bootstrap steering committee here:
https://groups.google.com/d/msg/go-cd/0FiZnt0is0Y/ys_9iHK9AQAJ -- please
take a look.

Cheers,
Aravind


On Fri, May 29, 2020 at 7:34 AM Aravind SV 
wrote:

> Hello everyone,
>
> Hope you're all safe in these times.
>
> When the original announcement about the changes to GoCD was made, I had
> said that we would open-source GoCD's commercial plugins in Q2 of 2020.
> Here is an update regarding each of those plugins:
>
> 1. ECS Elastic Agent plugin: This is now available at
> https://github.com/gocd/gocd-ecs-elastic-agent
>
> 2. LDAP Authorization plugin: This is now available at
> https://github.com/gocd/gocd-ldap-authorization-plugin
>
> 3. Azure Elastic Agent plugin: This is now available at
> https://github.com/gocd/azure-elastic-agent-plugin/
>
> 4. PostgreSQL support: We are trying to incorporate it into GoCD core
> itself. The pull request for this is in progress and you can see it here (
> https://github.com/gocd/gocd/pull/7646). In fact, this change should add
> support for multiple databases. The reason it is taking time is because we
> needed to change the underlying database-related technology to use
> Liquibase, which helps provide support for different databases. This should
> come out in GoCD 20.5.0, the next release of GoCD. Note: Release 20.4.0 was
> finished today.
>
> 5. GoCD Analytics plugin: This is a work in progress, and you should get
> an update soon. The challenge there is that it uses Highcharts, which is
> incompatible with any open-source license
> <https://shop.highsoft.com/faq#Non-Commercial-6>. So, we need to make
> changes to remove Highcharts from being bundled, while allowing it to be
> put back in place by users who have procured a license from Highsoft or
> have a reason to believe that they don't need one. You can see the original 
> documentation
> for the analytics plugin
> <https://extensions-docs.gocd.org/analytics/current/> in case you don't
> know about it.
>
> 6. Business continuity addon: This depends on the work around Postgres
> mentioned above, and will likely be the last one to be open-sourced. We
> haven't given this a lot of thought at this time.
>
> --
>
> Also: I had mentioned setting up a bootstrap steering committee. There is
> some work going on towards it. Please wait for an update here soon. Thank
> you for your patience.
>
> Regards,
> Aravind
>
> --
> You received this message because you are subscribed to the Google Groups
> "go-cd" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to go-cd+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/go-cd/55426b52-47e3-4d2f-b638-77e79564c349n%40googlegroups.com
> <https://groups.google.com/d/msgid/go-cd/55426b52-47e3-4d2f-b638-77e79564c349n%40googlegroups.com?utm_medium=email_source=footer>
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/CACxychEdArOb-rZ-_EMmpWZMnB_KR6xt_DbNzKBhswGkk0QWaw%40mail.gmail.com.

Re: [go-cd] Re: Staging von Pipelines as Code

[Aravind SV]

Hello Helge,

On Thu, Jun 11, 2020 at 03:00:28 -0700, Helge Walter wrote:
> Thank you for your advice.
> I think the groovy config-repo plugin is worth a look. There it would be 
> possible to read such parameters programmatically, e.g. from a file.

As Ketan mentioned, please think about the security implications of it. If 
you're using it publicly, you need to be careful since it can be powerful and 
(so) dangerous.


> Another idea is some kind of instance specific parameters as used in 
> pipelines but defined on GoCD instance level -- maybe provided by some kind 
> of parameter plugin like secret plugins.

> I reviewed the secrets management page and found it very useful. So would it 
> be possible to abuse the secrets plugin to provide the branch for the 
> materials and configuration repositories? Can all configuration values use 
> the secrets from secret manager plugins?

I thought about that. However, based on the documentation, the only places 
secrets can be used are the password field of a material and environment 
variables (and so, within a task in a job as well). So, it doesn't seem like 
you can use it arbitrarily, which should mean that you can't use it to provide 
the branch, unfortunately.

Another piece of work that is going on now which might be relevant to you: 
https://github.com/gocd/gocd/issues/6123

It implements some form of templating which might be useful to you. It's a work 
in progress though and you'll need to wait.

Cheers,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/20200611103227.eorl2225eoxdglhp%40arvindsv.com.

Re: [go-cd] (Azure elastic agent)Failed to install go agent on gocd-azure-c413d70b

[Aravind SV]

Hello Robert,

Since there were changes made to open-source it, maybe there was a mistake 
somewhere. If you want, I can try and work with you to make sure it works. If 
that's ok, please open an issue on the repo and we can collaborate there.

I can spend time in my evenings though. So, you might not get an immediate 
response.

Cheers,
Aravind

On Tue, Jun 09, 2020 at 06:25:57 -0700, Robert Lounsberry wrote:
> Has anyone run into this error with the Go Azure Elastic Agent not 
> installing the agent on the VM that it spins up? I'm not even sure where to 
> look to find this information for it to be edited. 
> 
> Failed to install go agent on 
> gocd-azure-c413d70b-f776-4d01-8435-5b77799a3ddf for job 
> settingsrouter_experiment/2/build/1/windows due to error: 
> freemarker.core.InvalidReferenceException: The following has evaluated to 
> null or missing:
> ==> plugin_id  [in template "windows_install_go_agent.template.flth" at 
> line 20, column 17]
> 
> 
> Tip: If the failing expression is known to legally refer to something 
> that's sometimes null or missing, either specify a default value like 
> myOptionalVar!myDefault, or use <#if 
> myOptionalVar??>when-present<#else>when-missing. (These only cover 
> the last step of the expression; to cover the whole expression, use 
> parenthesis: (myOptionalVar.foo)!myDefault, (myOptionalVar.foo)??
> 
> FTL stack trace ("~" means nesting-related):
> - Failed at: ${plugin_id}  [in template 
> "windows_install_go_agent.template.flth" at line 20, column 15]

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/20200609134016.jzyc4vfxl76i5hwa%40arvindsv.com.

Re: [go-cd] Re: Changes to GoCD in 2020

[Aravind SV]

Hello everyone,

Hope you're all safe in these times.

When the original announcement about the changes to GoCD was made, I had 
said that we would open-source GoCD's commercial plugins in Q2 of 2020. 
Here is an update regarding each of those plugins:

1. ECS Elastic Agent plugin: This is now available at 
https://github.com/gocd/gocd-ecs-elastic-agent

2. LDAP Authorization plugin: This is now available at 
https://github.com/gocd/gocd-ldap-authorization-plugin

3. Azure Elastic Agent plugin: This is now available at 
https://github.com/gocd/azure-elastic-agent-plugin/

4. PostgreSQL support: We are trying to incorporate it into GoCD core 
itself. The pull request for this is in progress and you can see it here (
https://github.com/gocd/gocd/pull/7646). In fact, this change should add 
support for multiple databases. The reason it is taking time is because we 
needed to change the underlying database-related technology to use 
Liquibase, which helps provide support for different databases. This should 
come out in GoCD 20.5.0, the next release of GoCD. Note: Release 20.4.0 was 
finished today.

5. GoCD Analytics plugin: This is a work in progress, and you should get an 
update soon. The challenge there is that it uses Highcharts, which is 
incompatible with any open-source license 
. So, we need to make 
changes to remove Highcharts from being bundled, while allowing it to be 
put back in place by users who have procured a license from Highsoft or 
have a reason to believe that they don't need one. You can see the original 
documentation 
for the analytics plugin 
 in case you don't 
know about it.

6. Business continuity addon: This depends on the work around Postgres 
mentioned above, and will likely be the last one to be open-sourced. We 
haven't given this a lot of thought at this time.

--

Also: I had mentioned setting up a bootstrap steering committee. There is 
some work going on towards it. Please wait for an update here soon. Thank 
you for your patience.

Regards,
Aravind

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/55426b52-47e3-4d2f-b638-77e79564c349n%40googlegroups.com.

Re: [go-cd] How do we use Postgresql, in GOCD, Since now it's no more as part of the commercial offering

[Aravind SV]

Hello Ajay,

On Tue, May 12, 2020 at 13:34:32 -0700, Ajay Choudhary wrote:
> I wanted to use Postgresql as DB for GOCD since we have large amount of 
> pipelines and it needs frequent Data cleanup and some time they are very 
> slow... How do we configure Postgresql and use as backed DB for GOCD, 
> instead H2DB... any documentaion or steps to perform this

We had said all commercial plugins would be open-sourced. With Postgres 
support, there is an attempt do something a little different by adding support 
for it within GoCD directly. The database access and migration part of GoCD is 
also being changed to make it be possible to use other database systems such as 
MySQL.

The pull request is here: https://github.com/gocd/gocd/pull/7646

It is a work in progress and will likely be released in the next release or 
two. Please note that anyone who upgrades after it is released will need to run 
a data migration, even if they want to continue using H2. There will be 
documentation and tooling to help with it.

Cheers,
Aravind

PS: You should also see the rest of the plugins open-sourced starting this 
month. The first one will likely be the AWS elastic agent plugin.

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/20200513063514.fobcsbzxvmj72fy3%40arvindsv.com.

Re: [go-cd] unable to find valid certification path to requested target

[Aravind SV]

Which release of GoCD is this?

A lot has changed around this in 20.2.0: 
https://github.com/gocd/gocd/issues/7872

tl; dr: Port 8154 won't be available any more soon and TLS termination will 
have to be done via something like nginx.

In your case, the certificate for LDAPs is unlikely to be the one causing this 
issue. Maybe rename the config/ directory in the agent, so that any old keys it 
has downloaded are removed, to see if it helps?

Cheers,
Aravind

On Tue, May 12, 2020 at 00:27:47 -0700, Nikos Skalis wrote:
> I have go-server and go-agent running on the same server, I wanted to add a 
> second agent, and I noticed that the *GO_SERVER_URL* had been renamed to
> 
> wrapper.app.parameter.100=-serverUrl
> wrapper.app.parameter.101=https://x.x.x.x:8154/go
> 
> 
> what I don't know is from where the https came from, I have used two 
> certificates 
> 
>1. for nginx serving the web app (agnostic to GoCD) 
>2. for the ldaps authentication part (using keytool)
>
> when trying to add the second agent I see the following error:
> 
> 2020-05-11 21:02:10,140 ERROR [WrapperJarAppMain] ServerBinaryDownloader:88 
> - Couldn't update admin/agent-launcher.jar. Sleeping for 1m. Error: 
> javax.net.ssl.SSLHandshakeException: PKIX path building failed: 
> sun.security.provider.certpath.SunCertPathBuilderException: unable to find 
> valid certification path to requested target
> 
> 
> can you advise where to look and how to fix this ?
> 
> with kind regards,
> Nikos

-- 
You received this message because you are subscribed to the Google Groups 
"go-cd" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to go-cd+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/go-cd/20200512151019.umoktlxrhxzlpozt%40arvindsv.com.