On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <[email protected]>
wrote:

> Congratulations!  But does that mean that JAVA_HOME is pointing at a JRE
> instead of a JDK?  If you have other issues that might be a factor.
>

Yeah, I messed up initially by getting the JRE instead of JDK.  I have
since corrected it.  But for some reason Ant still thinks that JAVA_HOME is
the jre directory.
I don't know how to fix this, hence the hack :-|




>
> HTH,
> -Alex
>
> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <[email protected]> wrote:
>
>     I copied tools.jar from  jdk/lib to the jre/lib.  That seems to have
> fixed
>     the issue.
>     We now have a successful build of the royale-compiler on the new Agent
>     machine!!
>
>     On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> [email protected]>
>     wrote:
>
>     > Restart dint help.  Although Serkan's reply made me look at how Ant
> was
>     > getting invoked.
>     >
>     > I see this warning that tools.jar is missing:
>     >
>     > [royale-compiler] $ cmd.exe /C
> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
> %%ERRORLEVEL%%"
>     >
>     > Unable to locate tools.jar. Expected to find it in C:\Program
> Files\Java\jre1.8.0_251\lib\tools.jar
>     >
>     >
>     > I am pretty sure this is related to this issue.
>     >
>     >
>     > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
> [email protected]>
>     > wrote:
>     >
>     >>
>     >>
>     >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> <[email protected]>
>     >> wrote:
>     >>
>     >>> Did you reboot your VM?  Also, have you checked what user is
> running
>     >>> Jenkins on your VM?  I think that can sometimes be a problem.  I
> might be
>     >>> running Jenkins as the user.
>     >>>
>     >>>
>     >> Agents don't require Jenkins to be running.  I will give the
> rebooting of
>     >> the VM a shot .
>     >>
>     >> Thanks,
>     >> Om
>     >>
>     >>
>     >>> -Alex
>     >>>
>     >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <[email protected]>
>     >>> wrote:
>     >>>
>     >>>     On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> <[email protected]>
>     >>> wrote:
>     >>>
>     >>>     > Should be here:
>     >>>     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200405113&amp;sdata=RhBraBN5pQDVrqAbMoXKejWBTwyqtSwd7DURGcQSwUg%3D&amp;reserved=0
>     >>>
>     >>>
>     >>>     My git is located in the same exact location as master.
>     >>>     Moreover, the git call from the commandline executes fine.
> The git
>     >>> call
>     >>>     from ant exec is what is failing.
>     >>>
>     >>>
>     >>>
>     >>>     >
>     >>>     >
>     >>>     > HTH,
>     >>>     > -Alex
>     >>>     >
>     >>>     > From: OmPrakash Muppirala <[email protected]>
>     >>>     > Reply-To: "[email protected]" <[email protected]>
>     >>>     > Date: Sunday, April 19, 2020 at 9:37 PM
>     >>>     > To: Apache Royale Development <[email protected]>
>     >>>     > Subject: Re: Prioritize Release Jobs on CI
>     >>>     >
>     >>>     > I'm a bit stumped here.  The royale-compiler is failing with
> this
>     >>> error:
>     >>>     >
>     >>>     >
>     >>>     > BUILD FAILED
>     >>>     >
>     >>>     > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute
>     >>> failed:
>     >>>     > java.io.IOException: Cannot run program "git" (in directory
>     >>>     > "c:\jenkins\workspace\royale-compiler"): CreateProcess
> error=2,
>     >>> The system
>     >>>     > cannot find the file specified
>     >>>     >
>     >>>     >   at java.lang.ProcessBuilder.start(Unknown Source)
>     >>>     >
>     >>>     >
>     >>>     > It is from this part of the jenkins.xml:
>     >>>     >
>     >>>     >
>     >>>     >     <target name="closure-lib-download" description="Copies
> Closure
>     >>>     > Library from GitHub">
>     >>>     >         <echo message="Be patient. This takes a few
> minutes..." />
>     >>>     >         <exec executable="git" failifexecutionfails="true">
>     >>>     >             <arg value="clone" />
>     >>>     >             <arg value="
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200405113&amp;sdata=AJO8lF1H7VG%2Fy9T1I9p0%2Fsqjh8cQ8U8exbInYHyuch0%3D&amp;reserved=0
>     >>> <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=2%2BG3WpItozbraXCp2Q4XACBXizsHNZQYMAgiSaaPXwo%3D&amp;reserved=0
>     >>> >"
>     >>>     > />
>     >>>     >             <arg value="${closure.root}" />
>     >>>     >         </exec>
>     >>>     >         <echo>Cloned fresh copy of Google Closure
> Library</echo>
>     >>>     >     </target>
>     >>>     >
>     >>>     > I am not sure how this executable call works without the
> full path.
>     >>>     >
>     >>>     > I checked the env variables, I do have both the git/bin and
> git/cmd
>     >>>     > directory in the PATH:
>     >>>     >
>     >>>     > [cid:ii_k97zkk9o0]
>     >>>     >
>     >>>     > What am I missing?
>     >>>     >
>     >>>     > Thanks,
>     >>>     > Om
>     >>>     >
>     >>>     > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>> wrote:
>     >>>     > Update - I have successfully attached my VM as a slave agent
> of our
>     >>>     > Jenkins instance.
>     >>>     > I am going to pull the job - /royale-asjs_jsonly and tie it
> to my
>     >>> agent so
>     >>>     > I can test it.
>     >>>     >
>     >>>     > It will fail for a sometime while I go set up my VM with all
> the
>     >>>     > dependencies.
>     >>>     >
>     >>>     > Once we have the job successfully building on my VM, we can
> figure
>     >>> out how
>     >>>     > to divide the load between the master and agent.
>     >>>     >
>     >>>     > Thanks,
>     >>>     > Om
>     >>>     >
>     >>>     > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>> wrote:
>     >>>     > We could achieve the same by creating a new agent (separate
> vm) and
>     >>>     > attaching it as a slave to the current Jenkins server.
>     >>>     >
>     >>>     > Then we can use labels/tags to tie release jobs to one agent
> and
>     >>> non
>     >>>     > release jobs to another agent.
>     >>>     >
>     >>>     > That way we can maintain everything in one UI, one login
> while
>     >>> achieving
>     >>>     > the concurrent building capabilities we want.
>     >>>     >
>     >>>     > Jenkins is built for this kind of stuff and I think it would
> be
>     >>> best we
>     >>>     > followed this practice.
>     >>>     >
>     >>>     > Thanks,
>     >>>     > Om
>     >>>     > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> <[email protected]>
>     >>> wrote:
>     >>>     > Om, I thought you were going to get the image from my VM and
> run
>     >>> it on
>     >>>     > another VM.  Then we'd remove all non-release jobs from your
> VM
>     >>> and all of
>     >>>     > the release jobs from my VM.  That won't solve the problem
> of how
>     >>> long it
>     >>>     > takes for a commit to be built and tested, but will allow
> the RM
>     >>> to get a
>     >>>     > release out without getting stuck behind the commit jobs.
> Is that
>     >>>     > currently the plan?
>     >>>     >
>     >>>     > -Alex
>     >>>     >
>     >>>     > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> [email protected]
>     >>> <mailto:
>     >>>     > [email protected]>> wrote:
>     >>>     >
>     >>>     >     Makes sense to me.  I will set parallel executors back
> to 1.
>     >>>     >
>     >>>     >     And start working on a new Jenkins instance.
>     >>>     >
>     >>>     >     Thanks,
>     >>>     >     Om
>     >>>     >
>     >>>     >
>     >>>     >     On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>     >>> <[email protected]>
>     >>>     > wrote:
>     >>>     >
>     >>>     >     > Are you saying that Java, Ant and Maven do not know
> how to
>     >>>     > distribute work
>     >>>     >     > to different cores?
>     >>>     >     >
>     >>>     >     > To repeat my main concern:  our Jenkins jobs often use
> shared
>     >>>     > resources.
>     >>>     >     > If you want to take the time to fix that, feel free,
> but I
>     >>> do not
>     >>>     > know how
>     >>>     >     > you are going to keep two jobs from both trying to
> launch
>     >>> Flash
>     >>>     > Player
>     >>>     >     > Debugger at the same time and open the same socket to
>     >>> communicate
>     >>>     > with it,
>     >>>     >     > or try to parse the flashlog.txt that they have both
> written
>     >>> to.
>     >>>     >     >
>     >>>     >     > The royale-asjs job will use the royale-compiler
> workspace
>     >>> to get the
>     >>>     >     > compiler.  If the compiler is building, the jars are
> not
>     >>> there and
>     >>>     > the
>     >>>     >     > royale-asjs build fails.
>     >>>     >     >
>     >>>     >     > There is also only so much memory and some of our jobs
> use
>     >>> all of it
>     >>>     > and
>     >>>     >     > I'm not sure if jobs slowed down due to paging memory
> and
>     >>>     > writing/reading
>     >>>     >     > from disk, even if it is an SSD.
>     >>>     >     >
>     >>>     >     > I'm done for tonight, but that's what I was seeing
> last time
>     >>> I tried
>     >>>     > to
>     >>>     >     > have both master and an agent running jobs in parallel.
>     >>>     >     >
>     >>>     >     > Thanks,
>     >>>     >     > -Alex
>     >>>     >     >
>     >>>     >     > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>> wrote:
>     >>>     >     >
>     >>>     >     >     A typical setup would be to have 0 executors on
> master
>     >>> and at
>     >>>     > least n
>     >>>     >     >     number of executors on each agent, where n =
> number of
>     >>> cpu cores.
>     >>>     >     >     I see that the current VM has 2 cores.  So, I
> started
>     >>> with
>     >>>     > setting the
>     >>>     >     > num
>     >>>     >     >     executors on the current agent to 2.
>     >>>     >     >
>     >>>     >     >     This should improve things quite a bit.  If this
> doesn't
>     >>> work, I
>     >>>     > will
>     >>>     >     >     create a new VM and make it the slave agent of the
>     >>> current
>     >>>     > Jenkins
>     >>>     >     > master.
>     >>>     >     >
>     >>>     >     >
>     >>>     >     >     Thanks,
>     >>>     >     >     Om
>     >>>     >     >
>     >>>     >     >     On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>     >>>     > <[email protected]>
>     >>>     >     >     wrote:
>     >>>     >     >
>     >>>     >     >     > On your VM or mine?  I don't think mine can
> handle
>     >>> it.  I used
>     >>>     > to
>     >>>     >     > run jobs
>     >>>     >     >     > of master and agent and we got lots of failures
> and
>     >>> jobs took
>     >>>     >     > forever.  If
>     >>>     >     >     > two jobs are trying to run tests with the shared
> Flash
>     >>> Player
>     >>>     >     > Debugger, for
>     >>>     >     >     > example, you won't get consistent results.
>     >>>     >     >     >
>     >>>     >     >     > -Alex
>     >>>     >     >     >
>     >>>     >     >     > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>     >>>     > [email protected]<mailto:[email protected]>>
>     >>>     >     > wrote:
>     >>>     >     >     >
>     >>>     >     >     >     I just realized that we have only one Agent
> (node)
>     >>> listed
>     >>>     > under
>     >>>     >     >     > Jenkins.  I
>     >>>     >     >     >     am going to add at least one more node to
> start
>     >>> with.
>     >>>     >     >     >
>     >>>     >     >     >     Thanks,
>     >>>     >     >     >     Om
>     >>>     >     >     >
>     >>>     >     >     >     On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>     >>>     >     > <[email protected]>
>     >>>     >     >     > wrote:
>     >>>     >     >     >
>     >>>     >     >     >     > I think I followed the instructions and
> enabled
>     >>> SSH.
>     >>>     >     >     >     >
>     >>>     >     >     >     > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>     >>>     > [email protected]<mailto:[email protected]>>
>     >>>     >     > wrote:
>     >>>     >     >     >     >
>     >>>     >     >     >     >     I haven’t gotten it to work. Could be
> ssh
>     >>> needs to be
>     >>>     >     > enabled on
>     >>>     >     >     > the
>     >>>     >     >     >     > VM [1]. This is nice to have but not
> essential.
>     >>> So Alex,
>     >>>     > let
>     >>>     >     > me know
>     >>>     >     >     > if you
>     >>>     >     >     >     > want to try that, otherwise I’ll suspend my
>     >>> efforts on
>     >>>     > this.
>     >>>     >     >     >     >
>     >>>     >     >     >     >     [1]
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=iTpXVF%2FutxSXTYw3soghKAmTu3Ysp5J75aOyIHJjxCo%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=iTpXVF%2FutxSXTYw3soghKAmTu3Ysp5J75aOyIHJjxCo%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >
>     >>>     >     >     >     >     From: Yishay Weiss<mailto:
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>>
>     >>>     >     >     >     >     Sent: Wednesday, April 15, 2020 5:09 PM
>     >>>     >     >     >     >     To: [email protected]<mailto:
>     >>>     > [email protected]><mailto:[email protected]<mailto:
>     >>>     > [email protected]>>
>     >>>     >     >     >     >     Subject: RE: Prioritize Release Jobs
> on CI
>     >>>     >     >     >     >
>     >>>     >     >     >     >     I’d like to try and install an ssh
> server.
>     >>> Can anyone
>     >>>     >     > think of a
>     >>>     >     >     >     > reason not to do that? I’m asking in terms
> of
>     >>> security,
>     >>>     > and if
>     >>>     >     > there
>     >>>     >     >     > might
>     >>>     >     >     >     > be a problem because it’s a VM.
>     >>>     >     >     >     >
>     >>>     >     >     >     >     Thanks.
>     >>>     >     >     >     >
>     >>>     >     >     >     >     From: Yishay Weiss<mailto:
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>>
>     >>>     >     >     >     >     Sent: Monday, April 13, 2020 10:02 AM
>     >>>     >     >     >     >     To: [email protected]<mailto:
>     >>>     > [email protected]><mailto:[email protected]<mailto:
>     >>>     > [email protected]>>
>     >>>     >     >     >     >     Subject: RE: Prioritize Release Jobs
> on CI
>     >>>     >     >     >     >
>     >>>     >     >     >     >     Related, as most (all?) of the
> instructions
>     >>> don’t
>     >>>     > require
>     >>>     >     >     > anything but
>     >>>     >     >     >     > a shell wouldn’t it be easier and faster to
>     >>> access the
>     >>>     > machine
>     >>>     >     > with
>     >>>     >     >     > ssh
>     >>>     >     >     >     > [1], rather than using remote desktop?
>     >>>     >     >     >     >
>     >>>     >     >     >     >     [1]
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=1aVR8ZhJ5a82g3v%2FNfYYUxX5fhVZqLkvKb%2BpFS0xeEg%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=1aVR8ZhJ5a82g3v%2FNfYYUxX5fhVZqLkvKb%2BpFS0xeEg%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >
>     >>>     >     >     >     >     From: Yishay Weiss<mailto:
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>>
>     >>>     >     >     >     >     Sent: Monday, April 13, 2020 9:55 AM
>     >>>     >     >     >     >     To: [email protected]<mailto:
>     >>>     > [email protected]><mailto:[email protected]<mailto:
>     >>>     > [email protected]>>
>     >>>     >     >     >     >     Subject: RE: Prioritize Release Jobs
> on CI
>     >>>     >     >     >     >
>     >>>     >     >     >     >     Can’t you do that with remote desktop?
>     >>>     >     >     >     >
>     >>>     >     >     >     >     ________________________________
>     >>>     >     >     >     >     From: OmPrakash Muppirala <
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>>
>     >>>     >     >     >     >     Sent: Monday, April 13, 2020 9:51:25 AM
>     >>>     >     >     >     >     To: Apache Royale Development <
>     >>> [email protected]
>     >>>     > <mailto:[email protected]>>
>     >>>     >     >     >     >     Subject: Re: Prioritize Release Jobs
> on CI
>     >>>     >     >     >     >
>     >>>     >     >     >     >     Alex,
>     >>>     >     >     >     >
>     >>>     >     >     >     >     I believe this is your personal Azure
>     >>> subscription
>     >>>     > right?
>     >>>     >     > Any
>     >>>     >     >     > chance
>     >>>     >     >     >     > I can
>     >>>     >     >     >     >     get access to it so I can try to copy
> the
>     >>> image out
>     >>>     > the
>     >>>     >     > machine
>     >>>     >     >     > and
>     >>>     >     >     >     >     redeploy it somewhere else?
>     >>>     >     >     >     >
>     >>>     >     >     >     >     Thanks,
>     >>>     >     >     >     >     Om
>     >>>     >     >     >     >
>     >>>     >     >     >     >     On Sun, Apr 12, 2020 at 6:18 PM
> OmPrakash
>     >>> Muppirala <
>     >>>     >     >     >     > [email protected]<mailto:
> [email protected]
>     >>> >>
>     >>>     >     >     >     >     wrote:
>     >>>     >     >     >     >
>     >>>     >     >     >     >     > I can help set this up on Azure.
> Give me
>     >>> some
>     >>>     > time to
>     >>>     >     > work
>     >>>     >     >     > out the
>     >>>     >     >     >     >     > details?
>     >>>     >     >     >     >     >
>     >>>     >     >     >     >     > Thanks,
>     >>>     >     >     >     >     > Om
>     >>>     >     >     >     >     >
>     >>>     >     >     >     >     > On Sun, Apr 12, 2020, 11:49 AM Harbs
> <
>     >>>     >     > [email protected]<mailto:[email protected]>>
>     >>>     >     >     > wrote:
>     >>>     >     >     >     >     >
>     >>>     >     >     >     >     >> OK. Good to know.
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >     >> > On Apr 12, 2020, at 9:45 PM, Alex
> Harui
>     >>>     >     >     > <[email protected]
>     >>>     >     >     >     > >
>     >>>     >     >     >     >     >> wrote:
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> > FWIW, I just looked and the
> longest job
>     >>> in the
>     >>>     > release
>     >>>     >     >     > steps so
>     >>>     >     >     >     > far is
>     >>>     >     >     >     >     >> 8 minutes.  Most are under 2
> minutes.
>     >>> There
>     >>>     > might be
>     >>>     >     > jobs
>     >>>     >     >     > later
>     >>>     >     >     >     > that take
>     >>>     >     >     >     >     >> longer that we haven't run yet.
> IMO, the
>     >>> issue
>     >>>     > isn't
>     >>>     >     > speed
>     >>>     >     >     > of the
>     >>>     >     >     >     > machine,
>     >>>     >     >     >     >     >> it is just that we are sharing the
>     >>> machine with
>     >>>     > longer
>     >>>     >     > jobs
>     >>>     >     >     > (1 hour
>     >>>     >     >     >     > for
>     >>>     >     >     >     >     >> TourDeFlexMigration).  And again,
> the
>     >>> machine
>     >>>     > will be
>     >>>     >     > idle for
>     >>>     >     >     >     > stretches of
>     >>>     >     >     >     >     >> time while the RM verifies artifacts
>     >>> after each
>     >>>     > step.
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> > -Alex
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> > On 4/12/20, 11:32 AM, "Harbs" <
>     >>>     > [email protected]<mailto:[email protected]>
>     >>>     >     >     > <mailto:
>     >>>     >     >     >     >     >> [email protected]<mailto:
>     >>>     > [email protected]>>> wrote:
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> >    Fair enough.
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> >    I expect builds to be somewhere
>     >>> between 10
>     >>>     > and 20
>     >>>     >     > times
>     >>>     >     >     > faster
>     >>>     >     >     >     > on a
>     >>>     >     >     >     >     >> powerful machine.
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> >    Yeah. It’s probably going to
> be a
>     >>> bit of work
>     >>>     >     > changing
>     >>>     >     >     > the
>     >>>     >     >     >     > server,
>     >>>     >     >     >     >     >> but probably worth it in the long
> run.
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> >    I think I’ll try this when I
> do the
>     >>> next
>     >>>     > release
>     >>>     >     > unless
>     >>>     >     >     > Yishay
>     >>>     >     >     >     > wants
>     >>>     >     >     >     >     >> to work with me on this for this
> release
>     >>> — but
>     >>>     > I’m not
>     >>>     >     > going
>     >>>     >     >     > to be
>     >>>     >     >     >     > able to
>     >>>     >     >     >     >     >> help until after Passover (i.e. next
>     >>> week).
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> >    Thanks,
>     >>>     >     >     >     >     >> >    Harbs
>     >>>     >     >     >     >     >> >
>     >>>     >     >     >     >     >> >> On Apr 12, 2020, at 9:22 PM,
> Alex Harui
>     >>>     >     >     > <[email protected]
>     >>>     >     >     >     > >
>     >>>     >     >     >     >     >> wrote:
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >> The Azure portal says: Standard
> F2s_v2
>     >>> (2
>     >>>     > vcpus, 4
>     >>>     >     > GiB
>     >>>     >     >     > memory)
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >> I think I am reading changes to
> the
>     >>> build
>     >>>     > process in
>     >>>     >     > your
>     >>>     >     >     >     >     >> suggestions.  I do not really want
> to
>     >>> spend more
>     >>>     > of my
>     >>>     >     > time
>     >>>     >     >     > on this
>     >>>     >     >     >     >     >> process.  But if you want to do the
> work,
>     >>> that's
>     >>>     > fine
>     >>>     >     > with me.
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >> -Alex
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >> On 4/12/20, 10:57 AM, "Harbs" <
>     >>>     > [email protected]<mailto:[email protected]>
>     >>>     >     >     > <mailto:
>     >>>     >     >     >     >     >> [email protected]<mailto:
>     >>>     > [email protected]>> <mailto:[email protected]
> <mailto:
>     >>>     > [email protected]>
>     >>>     >     > <mailto:
>     >>>     >     >     >     >     >> [email protected]<mailto:
>     >>>     > [email protected]>>>> wrote:
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >>   What kind of horsepower is
> included
>     >>> in the
>     >>>     > free
>     >>>     >     > Azure
>     >>>     >     >     > account?
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >>   The server I mentioned builds
>     >>> (considerably)
>     >>>     >     > faster than
>     >>>     >     >     > my own
>     >>>     >     >     >     >     >> local machine. The ci server seems
> to
>     >>> build many
>     >>>     > times
>     >>>     >     > slower.
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >>   One thing we can do to minimize
>     >>> running
>     >>>     > server time
>     >>>     >     >     > would be to
>     >>>     >     >     >     >     >> transfer the artifacts to storage
> instead
>     >>> of
>     >>>     > keeping
>     >>>     >     > them on
>     >>>     >     >     > the
>     >>>     >     >     >     > server. On
>     >>>     >     >     >     >     >> AWS, I’d probably use S3. Not sure
> what
>     >>> the
>     >>>     > similar
>     >>>     >     > service on
>     >>>     >     >     >     > Azure is
>     >>>     >     >     >     >     >> called.
>     >>>     >     >     >     >     >> >>
>     >>>     >     >     >     >     >> >>> On Apr 12, 2020, at 8:26 PM,
> Alex
>     >>> Harui
>     >>>     >     >     >     > <[email protected]
>     >>>     >     >     >     >     >> <mailto:[email protected]
> <mailto:
>     >>>     > [email protected]>>> wrote:
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>> OK, that's pretty much how I
>     >>> understand Azure
>     >>>     > as
>     >>>     >     > well.
>     >>>     >     >     > The key
>     >>>     >     >     >     > thing
>     >>>     >     >     >     >     >> is that "running" includes time
> where the
>     >>> CI
>     >>>     > server is
>     >>>     >     > not
>     >>>     >     >     > running
>     >>>     >     >     >     > any
>     >>>     >     >     >     >     >> Jenkins jobs.  The CI Server steps
> might
>     >>> take
>     >>>     > only a few
>     >>>     >     >     > hours of
>     >>>     >     >     >     > actual
>     >>>     >     >     >     >     >> server time, but there is time
> where the
>     >>> RM is
>     >>>     > verifying
>     >>>     >     >     > artifacts
>     >>>     >     >     >     > locally
>     >>>     >     >     >     >     >> so you'd be paying for that or the
> RM
>     >>> would have
>     >>>     > to keep
>     >>>     >     >     > shutting
>     >>>     >     >     >     > down and
>     >>>     >     >     >     >     >> restarting.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>> Seems like it would be
>     >>> cheaper/simpler to get
>     >>>     > the
>     >>>     >     > free
>     >>>     >     >     > MSDN
>     >>>     >     >     >     > account
>     >>>     >     >     >     >     >> and leave it running.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>> -Alex
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>     >>>     >     > [email protected]<mailto:[email protected]>
>     >>>     >     >     > <mailto:
>     >>>     >     >     >     >     >> [email protected]<mailto:
>     >>>     > [email protected]>>> wrote:
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  My experience is with AWS.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  I assume Microsoft has similar
>     >>> offerings,
>     >>>     > but I
>     >>>     >     > don’t
>     >>>     >     >     > have
>     >>>     >     >     >     >     >> experience with Azure.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  AWS has on-demand EC2 instances
>     >>> which you
>     >>>     > pay for
>     >>>     >     > only
>     >>>     >     >     > the
>     >>>     >     >     >     > actual
>     >>>     >     >     >     >     >> time that they are running.[1]
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  Instances can be started and
> stopped
>     >>> via
>     >>>     > command
>     >>>     >     > line
>     >>>     >     >     > (or via
>     >>>     >     >     >     > the
>     >>>     >     >     >     >     >> web interface) as long as you have
> valid
>     >>>     > credentials to
>     >>>     >     > do so.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  For example: an m5.4xlarge
> instance
>     >>> has 16
>     >>>     > cores
>     >>>     >     > and
>     >>>     >     >     > costs
>     >>>     >     >     >     > about
>     >>>     >     >     >     >     >> $1.5 per hour. On a machine like
> that, a
>     >>> full
>     >>>     > build
>     >>>     >     > would
>     >>>     >     >     > probably
>     >>>     >     >     >     > take
>     >>>     >     >     >     >     >> less than 10 minutes. It’s probably
>     >>> possible to
>     >>>     > do a
>     >>>     >     > full
>     >>>     >     >     > release
>     >>>     >     >     >     > with only
>     >>>     >     >     >     >     >> a few hours of server time.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  Leaving a server like that
> running
>     >>> all the
>     >>>     > time
>     >>>     >     > would get
>     >>>     >     >     >     > expensive,
>     >>>     >     >     >     >     >> but if it’s just spun up for
> releases,
>     >>> you’d get
>     >>>     > very
>     >>>     >     > fast
>     >>>     >     >     > builds
>     >>>     >     >     >     > at a
>     >>>     >     >     >     >     >> reasonable price.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  I’d be happy to pay $10-$50
> (and
>     >>> possibly
>     >>>     > more) per
>     >>>     >     >     > release to
>     >>>     >     >     >     > make
>     >>>     >     >     >     >     >> the release process painless for
> the RM.
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>  [1]
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> <
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&amp;sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> ><
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> <
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> >><
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> <
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> ><
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&amp;sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> <
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200435096&amp;sdata=3udZW1XC05li0TnS4FzrmnHmtJ0H7S1Mz%2FF%2FhAYinXk%3D&amp;reserved=0
>     >>>     > <
>     >>>     >
>     >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&amp;data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200435096&amp;sdata=3udZW1XC05li0TnS4FzrmnHmtJ0H7S1Mz%2FF%2FhAYinXk%3D&amp;reserved=0
>     >>>     > >
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>
>     >>>     >     >     >     >     >> >>>> On Apr 12, 2020, at 7:45 PM,
> Alex
>     >>> Harui
>     >>>     >     >     >     > <[email protected]>
>     >>>     >     >     >     >     >> wrote:
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> I'm not very experienced with
>     >>> spinning up
>     >>>     >     > servers.  The
>     >>>     >     >     > CI
>     >>>     >     >     >     > server we
>     >>>     >     >     >     >     >> are using is effectively free,
> based on a
>     >>> generous
>     >>>     >     > donation
>     >>>     >     >     > from
>     >>>     >     >     >     > Microsoft
>     >>>     >     >     >     >     >> of MSDN accounts to ASF
> committers.  So I
>     >>> leave
>     >>>     > it up
>     >>>     >     > 24/7,
>     >>>     >     >     > and
>     >>>     >     >     >     > share the
>     >>>     >     >     >     >     >> RDP access on private@.  I think
> any
>     >>> other ASF
>     >>>     >     > committer
>     >>>     >     >     > could do
>     >>>     >     >     >     > the
>     >>>     >     >     >     >     >> same.  IIRC, if that server
> actually is
>     >>> stopped,
>     >>>     > I have
>     >>>     >     > to
>     >>>     >     >     > use my
>     >>>     >     >     >     > personal
>     >>>     >     >     >     >     >> (unshared) MSDN credentials to
> start it
>     >>> again.
>     >>>     >  AIUI,
>     >>>     >     > if I
>     >>>     >     >     >     > actually paid
>     >>>     >     >     >     >     >> for the server, it would cost me to
> leave
>     >>> it
>     >>>     > running
>     >>>     >     > even if
>     >>>     >     >     > it
>     >>>     >     >     >     > didn't run
>     >>>     >     >     >     >     >> jobs between releases.
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> Is that what you are basically
>     >>> saying?  I
>     >>>     > think it
>     >>>     >     > might
>     >>>     >     >     > be
>     >>>     >     >     >     > best if
>     >>>     >     >     >     >     >> another committer got a CI server
> going
>     >>> via the MS
>     >>>     >     > donation
>     >>>     >     >     > and
>     >>>     >     >     >     > could leave
>     >>>     >     >     >     >     >> it up 24/7.
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> -Alex
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>     >>>     >     > [email protected]<mailto:[email protected]>>
>     >>>     >     >     > wrote:
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> I’m willing to do this.
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> Considering that the release
> will be
>     >>> run
>     >>>     >     > infrequently, it
>     >>>     >     >     >     > should be
>     >>>     >     >     >     >     >> doable to have a relatively powerful
>     >>> server that
>     >>>     > could
>     >>>     >     > be
>     >>>     >     >     > spun up on
>     >>>     >     >     >     >     >> demand. This is something I have
> setup
>     >>> for my own
>     >>>     >     > releases.
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> The only complication would be
> that
>     >>> each RM
>     >>>     > would
>     >>>     >     > need
>     >>>     >     >     > valid
>     >>>     >     >     >     >     >> credentials to spin up the server.
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>> Harbs
>     >>>     >     >     >     >     >> >>>>
>     >>>     >     >     >     >     >> >>>>> On Apr 12, 2020, at 7:10 PM,
> Alex
>     >>> Harui
>     >>>     >     >     >     > <[email protected]>
>     >>>     >     >     >     >     >> wrote:
>     >>>     >     >     >     >     >> >>>>>
>     >>>     >     >     >     >     >> >>>>> A better solution, IMO, is for
>     >>> someone else
>     >>>     > to
>     >>>     >     > offer up
>     >>>     >     >     > a CI
>     >>>     >     >     >     > server
>     >>>     >     >     >     >     >> only for release jobs.
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >     >>
>     >>>     >     >     >     >
>     >>>     >     >     >     >
>     >>>     >     >     >     >
>     >>>     >     >     >     >
>     >>>     >     >     >
>     >>>     >     >     >
>     >>>     >     >     >
>     >>>     >     >
>     >>>     >     >
>     >>>     >     >
>     >>>     >
>     >>>     >
>     >>>
>     >>>
>     >>>
>
>
>

Reply via email to