Royale-compiler has to be built first. This is an example of shared resources that I mentioned upthread. Royale-typedefs is going to look for a sibling workspace folder called royale-compiler with a built of royale-compiler in it. If royale-compiler fails to create all of its binaries or is in the process of building them, royale-typedefs will report an error.
What should probably happen is that royale-typedefs pulls down the lastsuccessfulartifacts from royale-compiler, but I've never found enough time and energy to try to make changes like that since most of us do have all of the folders as siblings. HTH, -Alex On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <[email protected]> wrote: I am now getting this error on royale-typedefs build: BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58: The following error occurred while executing this line: c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar' doesn't exist. Where does the ROYALE_TRANSPILER_HOME var come from? Here is the full console output: https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=vvN91svHM9UrGH%2FpsQoFdpyHgyVMwatr5NJ9s9%2FUfzc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <[email protected]> wrote: > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <[email protected]> > wrote: > >> Congratulations! But does that mean that JAVA_HOME is pointing at a JRE >> instead of a JDK? If you have other issues that might be a factor. >> > > Yeah, I messed up initially by getting the JRE instead of JDK. I have > since corrected it. But for some reason Ant still thinks that JAVA_HOME is > the jre directory. > I don't know how to fix this, hence the hack :-| > > > > >> >> HTH, >> -Alex >> >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <[email protected]> >> wrote: >> >> I copied tools.jar from jdk/lib to the jre/lib. That seems to have >> fixed >> the issue. >> We now have a successful build of the royale-compiler on the new Agent >> machine!! >> >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala < >> [email protected]> >> wrote: >> >> > Restart dint help. Although Serkan's reply made me look at how Ant >> was >> > getting invoked. >> > >> > I see this warning that tools.jar is missing: >> > >> > [royale-compiler] $ cmd.exe /C >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit >> %%ERRORLEVEL%%" >> > >> > Unable to locate tools.jar. Expected to find it in C:\Program >> Files\Java\jre1.8.0_251\lib\tools.jar >> > >> > >> > I am pretty sure this is related to this issue. >> > >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala < >> [email protected]> >> > wrote: >> > >> >> >> >> >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui >> <[email protected]> >> >> wrote: >> >> >> >>> Did you reboot your VM? Also, have you checked what user is >> running >> >>> Jenkins on your VM? I think that can sometimes be a problem. I >> might be >> >>> running Jenkins as the user. >> >>> >> >>> >> >> Agents don't require Jenkins to be running. I will give the >> rebooting of >> >> the VM a shot . >> >> >> >> Thanks, >> >> Om >> >> >> >> >> >>> -Alex >> >>> >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <[email protected] >> > >> >>> wrote: >> >>> >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui >> <[email protected]> >> >>> wrote: >> >>> >> >>> > Should be here: >> >>> > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=L6YhauHRF8IcSIlLJVFGn%2BPY5Ut%2BC9i2OBaNUF2yX20%3D&reserved=0 >> >>> >> >>> >> >>> My git is located in the same exact location as master. >> >>> Moreover, the git call from the commandline executes fine. >> The git >> >>> call >> >>> from ant exec is what is failing. >> >>> >> >>> >> >>> >> >>> > >> >>> > >> >>> > HTH, >> >>> > -Alex >> >>> > >> >>> > From: OmPrakash Muppirala <[email protected]> >> >>> > Reply-To: "[email protected]" <[email protected]> >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM >> >>> > To: Apache Royale Development <[email protected]> >> >>> > Subject: Re: Prioritize Release Jobs on CI >> >>> > >> >>> > I'm a bit stumped here. The royale-compiler is failing >> with this >> >>> error: >> >>> > >> >>> > >> >>> > BUILD FAILED >> >>> > >> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute >> >>> failed: >> >>> > java.io.IOException: Cannot run program "git" (in directory >> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess >> error=2, >> >>> The system >> >>> > cannot find the file specified >> >>> > >> >>> > at java.lang.ProcessBuilder.start(Unknown Source) >> >>> > >> >>> > >> >>> > It is from this part of the jenkins.xml: >> >>> > >> >>> > >> >>> > <target name="closure-lib-download" description="Copies >> Closure >> >>> > Library from GitHub"> >> >>> > <echo message="Be patient. This takes a few >> minutes..." /> >> >>> > <exec executable="git" failifexecutionfails="true"> >> >>> > <arg value="clone" /> >> >>> > <arg value=" >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=a99eAxOF3LFn9BDj%2Ba%2FycnfqNWTKoBPMb9zqK37oEoo%3D&reserved=0 >> >>> < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=a99eAxOF3LFn9BDj%2Ba%2FycnfqNWTKoBPMb9zqK37oEoo%3D&reserved=0 >> >>> >" >> >>> > /> >> >>> > <arg value="${closure.root}" /> >> >>> > </exec> >> >>> > <echo>Cloned fresh copy of Google Closure >> Library</echo> >> >>> > </target> >> >>> > >> >>> > I am not sure how this executable call works without the >> full path. >> >>> > >> >>> > I checked the env variables, I do have both the git/bin and >> git/cmd >> >>> > directory in the PATH: >> >>> > >> >>> > [cid:ii_k97zkk9o0] >> >>> > >> >>> > What am I missing? >> >>> > >> >>> > Thanks, >> >>> > Om >> >>> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala < >> >>> [email protected] >> >>> > <mailto:[email protected]>> wrote: >> >>> > Update - I have successfully attached my VM as a slave >> agent of our >> >>> > Jenkins instance. >> >>> > I am going to pull the job - /royale-asjs_jsonly and tie it >> to my >> >>> agent so >> >>> > I can test it. >> >>> > >> >>> > It will fail for a sometime while I go set up my VM with >> all the >> >>> > dependencies. >> >>> > >> >>> > Once we have the job successfully building on my VM, we can >> figure >> >>> out how >> >>> > to divide the load between the master and agent. >> >>> > >> >>> > Thanks, >> >>> > Om >> >>> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala < >> >>> [email protected] >> >>> > <mailto:[email protected]>> wrote: >> >>> > We could achieve the same by creating a new agent (separate >> vm) and >> >>> > attaching it as a slave to the current Jenkins server. >> >>> > >> >>> > Then we can use labels/tags to tie release jobs to one >> agent and >> >>> non >> >>> > release jobs to another agent. >> >>> > >> >>> > That way we can maintain everything in one UI, one login >> while >> >>> achieving >> >>> > the concurrent building capabilities we want. >> >>> > >> >>> > Jenkins is built for this kind of stuff and I think it >> would be >> >>> best we >> >>> > followed this practice. >> >>> > >> >>> > Thanks, >> >>> > Om >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui >> <[email protected]> >> >>> wrote: >> >>> > Om, I thought you were going to get the image from my VM >> and run >> >>> it on >> >>> > another VM. Then we'd remove all non-release jobs from >> your VM >> >>> and all of >> >>> > the release jobs from my VM. That won't solve the problem >> of how >> >>> long it >> >>> > takes for a commit to be built and tested, but will allow >> the RM >> >>> to get a >> >>> > release out without getting stuck behind the commit jobs. >> Is that >> >>> > currently the plan? >> >>> > >> >>> > -Alex >> >>> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" < >> [email protected] >> >>> <mailto: >> >>> > [email protected]>> wrote: >> >>> > >> >>> > Makes sense to me. I will set parallel executors back >> to 1. >> >>> > >> >>> > And start working on a new Jenkins instance. >> >>> > >> >>> > Thanks, >> >>> > Om >> >>> > >> >>> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui >> >>> <[email protected]> >> >>> > wrote: >> >>> > >> >>> > > Are you saying that Java, Ant and Maven do not know >> how to >> >>> > distribute work >> >>> > > to different cores? >> >>> > > >> >>> > > To repeat my main concern: our Jenkins jobs often >> use shared >> >>> > resources. >> >>> > > If you want to take the time to fix that, feel free, >> but I >> >>> do not >> >>> > know how >> >>> > > you are going to keep two jobs from both trying to >> launch >> >>> Flash >> >>> > Player >> >>> > > Debugger at the same time and open the same socket to >> >>> communicate >> >>> > with it, >> >>> > > or try to parse the flashlog.txt that they have both >> written >> >>> to. >> >>> > > >> >>> > > The royale-asjs job will use the royale-compiler >> workspace >> >>> to get the >> >>> > > compiler. If the compiler is building, the jars are >> not >> >>> there and >> >>> > the >> >>> > > royale-asjs build fails. >> >>> > > >> >>> > > There is also only so much memory and some of our >> jobs use >> >>> all of it >> >>> > and >> >>> > > I'm not sure if jobs slowed down due to paging memory >> and >> >>> > writing/reading >> >>> > > from disk, even if it is an SSD. >> >>> > > >> >>> > > I'm done for tonight, but that's what I was seeing >> last time >> >>> I tried >> >>> > to >> >>> > > have both master and an agent running jobs in >> parallel. >> >>> > > >> >>> > > Thanks, >> >>> > > -Alex >> >>> > > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" < >> >>> [email protected] >> >>> > <mailto:[email protected]>> wrote: >> >>> > > >> >>> > > A typical setup would be to have 0 executors on >> master >> >>> and at >> >>> > least n >> >>> > > number of executors on each agent, where n = >> number of >> >>> cpu cores. >> >>> > > I see that the current VM has 2 cores. So, I >> started >> >>> with >> >>> > setting the >> >>> > > num >> >>> > > executors on the current agent to 2. >> >>> > > >> >>> > > This should improve things quite a bit. If this >> doesn't >> >>> work, I >> >>> > will >> >>> > > create a new VM and make it the slave agent of the >> >>> current >> >>> > Jenkins >> >>> > > master. >> >>> > > >> >>> > > >> >>> > > Thanks, >> >>> > > Om >> >>> > > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui >> >>> > <[email protected]> >> >>> > > wrote: >> >>> > > >> >>> > > > On your VM or mine? I don't think mine can >> handle >> >>> it. I used >> >>> > to >> >>> > > run jobs >> >>> > > > of master and agent and we got lots of failures >> and >> >>> jobs took >> >>> > > forever. If >> >>> > > > two jobs are trying to run tests with the >> shared Flash >> >>> Player >> >>> > > Debugger, for >> >>> > > > example, you won't get consistent results. >> >>> > > > >> >>> > > > -Alex >> >>> > > > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" < >> >>> > [email protected]<mailto:[email protected]>> >> >>> > > wrote: >> >>> > > > >> >>> > > > I just realized that we have only one Agent >> (node) >> >>> listed >> >>> > under >> >>> > > > Jenkins. I >> >>> > > > am going to add at least one more node to >> start >> >>> with. >> >>> > > > >> >>> > > > Thanks, >> >>> > > > Om >> >>> > > > >> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui >> >>> > > <[email protected]> >> >>> > > > wrote: >> >>> > > > >> >>> > > > > I think I followed the instructions and >> enabled >> >>> SSH. >> >>> > > > > >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" < >> >>> > [email protected]<mailto:[email protected]>> >> >>> > > wrote: >> >>> > > > > >> >>> > > > > I haven’t gotten it to work. Could be >> ssh >> >>> needs to be >> >>> > > enabled on >> >>> > > > the >> >>> > > > > VM [1]. This is nice to have but not >> essential. >> >>> So Alex, >> >>> > let >> >>> > > me know >> >>> > > > if you >> >>> > > > > want to try that, otherwise I’ll suspend >> my >> >>> efforts on >> >>> > this. >> >>> > > > > >> >>> > > > > [1] >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=MmNf%2F613Ns9MQEfBARvB4%2F15hs7UW1MIw6rsFo4EfCg%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=MmNf%2F613Ns9MQEfBARvB4%2F15hs7UW1MIw6rsFo4EfCg%3D&reserved=0 >> >>> > > >> >>> > > > > >> >>> > > > > From: Yishay Weiss<mailto: >> >>> [email protected] >> >>> > <mailto:[email protected]>> >> >>> > > > > Sent: Wednesday, April 15, 2020 5:09 >> PM >> >>> > > > > To: [email protected]<mailto: >> >>> > [email protected]><mailto:[email protected]<mailto: >> >>> > [email protected]>> >> >>> > > > > Subject: RE: Prioritize Release Jobs >> on CI >> >>> > > > > >> >>> > > > > I’d like to try and install an ssh >> server. >> >>> Can anyone >> >>> > > think of a >> >>> > > > > reason not to do that? I’m asking in >> terms of >> >>> security, >> >>> > and if >> >>> > > there >> >>> > > > might >> >>> > > > > be a problem because it’s a VM. >> >>> > > > > >> >>> > > > > Thanks. >> >>> > > > > >> >>> > > > > From: Yishay Weiss<mailto: >> >>> [email protected] >> >>> > <mailto:[email protected]>> >> >>> > > > > Sent: Monday, April 13, 2020 10:02 AM >> >>> > > > > To: [email protected]<mailto: >> >>> > [email protected]><mailto:[email protected]<mailto: >> >>> > [email protected]>> >> >>> > > > > Subject: RE: Prioritize Release Jobs >> on CI >> >>> > > > > >> >>> > > > > Related, as most (all?) of the >> instructions >> >>> don’t >> >>> > require >> >>> > > > anything but >> >>> > > > > a shell wouldn’t it be easier and faster >> to >> >>> access the >> >>> > machine >> >>> > > with >> >>> > > > ssh >> >>> > > > > [1], rather than using remote desktop? >> >>> > > > > >> >>> > > > > [1] >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=BxL32J7V1cv0P4ZIPfrHkGIcii9lgFYDNMUrR%2BLfgzA%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=BxL32J7V1cv0P4ZIPfrHkGIcii9lgFYDNMUrR%2BLfgzA%3D&reserved=0 >> >>> > > >> >>> > > > > >> >>> > > > > From: Yishay Weiss<mailto: >> >>> [email protected] >> >>> > <mailto:[email protected]>> >> >>> > > > > Sent: Monday, April 13, 2020 9:55 AM >> >>> > > > > To: [email protected]<mailto: >> >>> > [email protected]><mailto:[email protected]<mailto: >> >>> > [email protected]>> >> >>> > > > > Subject: RE: Prioritize Release Jobs >> on CI >> >>> > > > > >> >>> > > > > Can’t you do that with remote desktop? >> >>> > > > > >> >>> > > > > ________________________________ >> >>> > > > > From: OmPrakash Muppirala < >> >>> [email protected] >> >>> > <mailto:[email protected]>> >> >>> > > > > Sent: Monday, April 13, 2020 9:51:25 >> AM >> >>> > > > > To: Apache Royale Development < >> >>> [email protected] >> >>> > <mailto:[email protected]>> >> >>> > > > > Subject: Re: Prioritize Release Jobs >> on CI >> >>> > > > > >> >>> > > > > Alex, >> >>> > > > > >> >>> > > > > I believe this is your personal Azure >> >>> subscription >> >>> > right? >> >>> > > Any >> >>> > > > chance >> >>> > > > > I can >> >>> > > > > get access to it so I can try to copy >> the >> >>> image out >> >>> > the >> >>> > > machine >> >>> > > > and >> >>> > > > > redeploy it somewhere else? >> >>> > > > > >> >>> > > > > Thanks, >> >>> > > > > Om >> >>> > > > > >> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM >> OmPrakash >> >>> Muppirala < >> >>> > > > > [email protected]<mailto: >> [email protected] >> >>> >> >> >>> > > > > wrote: >> >>> > > > > >> >>> > > > > > I can help set this up on Azure. >> Give me >> >>> some >> >>> > time to >> >>> > > work >> >>> > > > out the >> >>> > > > > > details? >> >>> > > > > > >> >>> > > > > > Thanks, >> >>> > > > > > Om >> >>> > > > > > >> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM >> Harbs < >> >>> > > [email protected]<mailto:[email protected]>> >> >>> > > > wrote: >> >>> > > > > > >> >>> > > > > >> OK. Good to know. >> >>> > > > > >> >> >>> > > > > >> > On Apr 12, 2020, at 9:45 PM, >> Alex Harui >> >>> > > > <[email protected] >> >>> > > > > > >> >>> > > > > >> wrote: >> >>> > > > > >> > >> >>> > > > > >> > FWIW, I just looked and the >> longest job >> >>> in the >> >>> > release >> >>> > > > steps so >> >>> > > > > far is >> >>> > > > > >> 8 minutes. Most are under 2 >> minutes. >> >>> There >> >>> > might be >> >>> > > jobs >> >>> > > > later >> >>> > > > > that take >> >>> > > > > >> longer that we haven't run yet. >> IMO, the >> >>> issue >> >>> > isn't >> >>> > > speed >> >>> > > > of the >> >>> > > > > machine, >> >>> > > > > >> it is just that we are sharing the >> >>> machine with >> >>> > longer >> >>> > > jobs >> >>> > > > (1 hour >> >>> > > > > for >> >>> > > > > >> TourDeFlexMigration). And again, >> the >> >>> machine >> >>> > will be >> >>> > > idle for >> >>> > > > > stretches of >> >>> > > > > >> time while the RM verifies >> artifacts >> >>> after each >> >>> > step. >> >>> > > > > >> > >> >>> > > > > >> > -Alex >> >>> > > > > >> > >> >>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" < >> >>> > [email protected]<mailto:[email protected]> >> >>> > > > <mailto: >> >>> > > > > >> [email protected]<mailto: >> >>> > [email protected]>>> wrote: >> >>> > > > > >> > >> >>> > > > > >> > Fair enough. >> >>> > > > > >> > >> >>> > > > > >> > I expect builds to be >> somewhere >> >>> between 10 >> >>> > and 20 >> >>> > > times >> >>> > > > faster >> >>> > > > > on a >> >>> > > > > >> powerful machine. >> >>> > > > > >> > >> >>> > > > > >> > Yeah. It’s probably going to >> be a >> >>> bit of work >> >>> > > changing >> >>> > > > the >> >>> > > > > server, >> >>> > > > > >> but probably worth it in the long >> run. >> >>> > > > > >> > >> >>> > > > > >> > I think I’ll try this when I >> do the >> >>> next >> >>> > release >> >>> > > unless >> >>> > > > Yishay >> >>> > > > > wants >> >>> > > > > >> to work with me on this for this >> release >> >>> — but >> >>> > I’m not >> >>> > > going >> >>> > > > to be >> >>> > > > > able to >> >>> > > > > >> help until after Passover (i.e. >> next >> >>> week). >> >>> > > > > >> > >> >>> > > > > >> > Thanks, >> >>> > > > > >> > Harbs >> >>> > > > > >> > >> >>> > > > > >> >> On Apr 12, 2020, at 9:22 PM, >> Alex Harui >> >>> > > > <[email protected] >> >>> > > > > > >> >>> > > > > >> wrote: >> >>> > > > > >> >> >> >>> > > > > >> >> The Azure portal says: Standard >> F2s_v2 >> >>> (2 >> >>> > vcpus, 4 >> >>> > > GiB >> >>> > > > memory) >> >>> > > > > >> >> >> >>> > > > > >> >> I think I am reading changes to >> the >> >>> build >> >>> > process in >> >>> > > your >> >>> > > > > >> suggestions. I do not really want >> to >> >>> spend more >> >>> > of my >> >>> > > time >> >>> > > > on this >> >>> > > > > >> process. But if you want to do >> the work, >> >>> that's >> >>> > fine >> >>> > > with me. >> >>> > > > > >> >> >> >>> > > > > >> >> -Alex >> >>> > > > > >> >> >> >>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" < >> >>> > [email protected]<mailto:[email protected]> >> >>> > > > <mailto: >> >>> > > > > >> [email protected]<mailto: >> >>> > [email protected]>> <mailto:[email protected] >> <mailto: >> >>> > [email protected]> >> >>> > > <mailto: >> >>> > > > > >> [email protected]<mailto: >> >>> > [email protected]>>>> wrote: >> >>> > > > > >> >> >> >>> > > > > >> >> What kind of horsepower is >> included >> >>> in the >> >>> > free >> >>> > > Azure >> >>> > > > account? >> >>> > > > > >> >> >> >>> > > > > >> >> The server I mentioned builds >> >>> (considerably) >> >>> > > faster than >> >>> > > > my own >> >>> > > > > >> local machine. The ci server seems >> to >> >>> build many >> >>> > times >> >>> > > slower. >> >>> > > > > >> >> >> >>> > > > > >> >> One thing we can do to >> minimize >> >>> running >> >>> > server time >> >>> > > > would be to >> >>> > > > > >> transfer the artifacts to storage >> instead >> >>> of >> >>> > keeping >> >>> > > them on >> >>> > > > the >> >>> > > > > server. On >> >>> > > > > >> AWS, I’d probably use S3. Not sure >> what >> >>> the >> >>> > similar >> >>> > > service on >> >>> > > > > Azure is >> >>> > > > > >> called. >> >>> > > > > >> >> >> >>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM, >> Alex >> >>> Harui >> >>> > > > > <[email protected] >> >>> > > > > >> <mailto:[email protected] >> <mailto: >> >>> > [email protected]>>> wrote: >> >>> > > > > >> >>> >> >>> > > > > >> >>> OK, that's pretty much how I >> >>> understand Azure >> >>> > as >> >>> > > well. >> >>> > > > The key >> >>> > > > > thing >> >>> > > > > >> is that "running" includes time >> where the >> >>> CI >> >>> > server is >> >>> > > not >> >>> > > > running >> >>> > > > > any >> >>> > > > > >> Jenkins jobs. The CI Server steps >> might >> >>> take >> >>> > only a few >> >>> > > > hours of >> >>> > > > > actual >> >>> > > > > >> server time, but there is time >> where the >> >>> RM is >> >>> > verifying >> >>> > > > artifacts >> >>> > > > > locally >> >>> > > > > >> so you'd be paying for that or the >> RM >> >>> would have >> >>> > to keep >> >>> > > > shutting >> >>> > > > > down and >> >>> > > > > >> restarting. >> >>> > > > > >> >>> >> >>> > > > > >> >>> Seems like it would be >> >>> cheaper/simpler to get >> >>> > the >> >>> > > free >> >>> > > > MSDN >> >>> > > > > account >> >>> > > > > >> and leave it running. >> >>> > > > > >> >>> >> >>> > > > > >> >>> -Alex >> >>> > > > > >> >>> >> >>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" < >> >>> > > [email protected]<mailto:[email protected]> >> >>> > > > <mailto: >> >>> > > > > >> [email protected]<mailto: >> >>> > [email protected]>>> wrote: >> >>> > > > > >> >>> >> >>> > > > > >> >>> My experience is with AWS. >> >>> > > > > >> >>> >> >>> > > > > >> >>> I assume Microsoft has similar >> >>> offerings, >> >>> > but I >> >>> > > don’t >> >>> > > > have >> >>> > > > > >> experience with Azure. >> >>> > > > > >> >>> >> >>> > > > > >> >>> AWS has on-demand EC2 >> instances >> >>> which you >> >>> > pay for >> >>> > > only >> >>> > > > the >> >>> > > > > actual >> >>> > > > > >> time that they are running.[1] >> >>> > > > > >> >>> >> >>> > > > > >> >>> Instances can be started and >> stopped >> >>> via >> >>> > command >> >>> > > line >> >>> > > > (or via >> >>> > > > > the >> >>> > > > > >> web interface) as long as you have >> valid >> >>> > credentials to >> >>> > > do so. >> >>> > > > > >> >>> >> >>> > > > > >> >>> For example: an m5.4xlarge >> instance >> >>> has 16 >> >>> > cores >> >>> > > and >> >>> > > > costs >> >>> > > > > about >> >>> > > > > >> $1.5 per hour. On a machine like >> that, a >> >>> full >> >>> > build >> >>> > > would >> >>> > > > probably >> >>> > > > > take >> >>> > > > > >> less than 10 minutes. It’s probably >> >>> possible to >> >>> > do a >> >>> > > full >> >>> > > > release >> >>> > > > > with only >> >>> > > > > >> a few hours of server time. >> >>> > > > > >> >>> >> >>> > > > > >> >>> Leaving a server like that >> running >> >>> all the >> >>> > time >> >>> > > would get >> >>> > > > > expensive, >> >>> > > > > >> but if it’s just spun up for >> releases, >> >>> you’d get >> >>> > very >> >>> > > fast >> >>> > > > builds >> >>> > > > > at a >> >>> > > > > >> reasonable price. >> >>> > > > > >> >>> >> >>> > > > > >> >>> I’d be happy to pay $10-$50 >> (and >> >>> possibly >> >>> > more) per >> >>> > > > release to >> >>> > > > > make >> >>> > > > > >> the release process painless for >> the RM. >> >>> > > > > >> >>> >> >>> > > > > >> >>> [1] >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > > >> >>> > > > > >> < >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > > >> >>> > > > > >> >< >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > > >> >>> > > > > >> < >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0 >> >>> > > >> >>> > > > > >> >>< >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > > >> >>> > > > > >> < >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > > >> >>> > > > > >> >< >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > > >> >>> > > > > >> < >> >>> > > > > >> >> >>> > > > > >> >>> > > > >> >>> > > >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > < >> >>> > >> >>> >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0 >> >>> > > >> >>> > > > > >> >>> >> >>> > > > > >> >>> >> >>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM, >> Alex >> >>> Harui >> >>> > > > > <[email protected]> >> >>> > > > > >> wrote: >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> I'm not very experienced with >> >>> spinning up >> >>> > > servers. The >> >>> > > > CI >> >>> > > > > server we >> >>> > > > > >> are using is effectively free, >> based on a >> >>> generous >> >>> > > donation >> >>> > > > from >> >>> > > > > Microsoft >> >>> > > > > >> of MSDN accounts to ASF >> committers. So I >> >>> leave >> >>> > it up >> >>> > > 24/7, >> >>> > > > and >> >>> > > > > share the >> >>> > > > > >> RDP access on private@. I think >> any >> >>> other ASF >> >>> > > committer >> >>> > > > could do >> >>> > > > > the >> >>> > > > > >> same. IIRC, if that server >> actually is >> >>> stopped, >> >>> > I have >> >>> > > to >> >>> > > > use my >> >>> > > > > personal >> >>> > > > > >> (unshared) MSDN credentials to >> start it >> >>> again. >> >>> > AIUI, >> >>> > > if I >> >>> > > > > actually paid >> >>> > > > > >> for the server, it would cost me >> to leave >> >>> it >> >>> > running >> >>> > > even if >> >>> > > > it >> >>> > > > > didn't run >> >>> > > > > >> jobs between releases. >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> Is that what you are basically >> >>> saying? I >> >>> > think it >> >>> > > might >> >>> > > > be >> >>> > > > > best if >> >>> > > > > >> another committer got a CI server >> going >> >>> via the MS >> >>> > > donation >> >>> > > > and >> >>> > > > > could leave >> >>> > > > > >> it up 24/7. >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> -Alex >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" < >> >>> > > [email protected]<mailto:[email protected]>> >> >>> > > > wrote: >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> I’m willing to do this. >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> Considering that the release >> will be >> >>> run >> >>> > > infrequently, it >> >>> > > > > should be >> >>> > > > > >> doable to have a relatively >> powerful >> >>> server that >> >>> > could >> >>> > > be >> >>> > > > spun up on >> >>> > > > > >> demand. This is something I have >> setup >> >>> for my own >> >>> > > releases. >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> The only complication would >> be that >> >>> each RM >> >>> > would >> >>> > > need >> >>> > > > valid >> >>> > > > > >> credentials to spin up the server. >> >>> > > > > >> >>>> >> >>> > > > > >> >>>> Harbs >> >>> > > > > >> >>>> >> >>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, >> Alex >> >>> Harui >> >>> > > > > <[email protected]> >> >>> > > > > >> wrote: >> >>> > > > > >> >>>>> >> >>> > > > > >> >>>>> A better solution, IMO, is >> for >> >>> someone else >> >>> > to >> >>> > > offer up >> >>> > > > a CI >> >>> > > > > server >> >>> > > > > >> only for release jobs. >> >>> > > > > >> >> >>> > > > > >> >> >>> > > > > >> >>> > > > > >> >>> > > > > >> >>> > > > > >> >>> > > > >> >>> > > > >> >>> > > > >> >>> > > >> >>> > > >> >>> > > >> >>> > >> >>> > >> >>> >> >>> >> >>> >> >> >>
