Hi Daniel, Your PR looks good to me. I think the best place for you to start is by setting up the PGA portal (the old portal we used before the django one) and adding a resource manager type for the compute resource as you can see in the attached image. You can set up the pga locally using this [1] guide. Once you can register the resource manager type using the pga portal, you can use the django portal to submit jobs. I believe that you don't need to change any code in the django portal.
[1] https://github.com/apache/airavata/tree/master/modules/ide-integration#optional-starting-super-admin-portal-pga Thanks Dimuthu On Sun, Oct 4, 2020 at 6:12 PM Daniel Shchur <[email protected]> wrote: > Hi Dimuthu and Suresh, > > > > Thanks for getting back to us. We went ahead and made a work in progress pull > request <https://github.com/apache/airavata/pull/263> for our changes we > have created so far. We also took a look at the job-monitor section and > will work towards creating additions to support HTCondor. > > > > Do any of you have any suggestions on what the best way is to test > submissions to HTCondor? We looked into using the Airavata API and the > Django portal and are curious what you would recommend, and how to do it > using your recommendation. > > > > Thanks! > > > > - Daniel Shchur > > > > *From: *DImuthu Upeksha <[email protected]> > *Sent: *Friday, October 2, 2020 5:22 PM > *To: *Airavata Dev <[email protected]> > *Cc: *[email protected]; Evan Palmer > <[email protected]> > *Subject: *Re: HTCondor Extension Help > > > > Hi Daniel, > > > > This is great progress. I think you are on the right track. Did you manage > to set up the ide integration for the development of Airavata. If you have > already done that, you can test these features. However I recommend you to > send pull requests to a separate branch (htcondor?) and then I can provide > you feedback on the next steps. > > > > Thanks > > Dimuthu > > > > > > On Thu, Oct 1, 2020 at 4:57 PM Suresh Marru <[email protected]> wrote: > > Hi Daniel, > > > > Thanks for this nice summary for keeping the dev list apprised of your > progress. > > > > One additional item is to discuss and plan on job monitoring approaches, > you can look at current references here - > https://github.com/apache/airavata/tree/master/modules/job-monitor > <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_airavata_tree_master_modules_job-2Dmonitor&d=DwMFaQ&c=Cu5g146wZdoqVuKpTNsYHeFX_rg6kWhlkLF8Eft-wwo&r=SfMtyOx08LDuEVnPLH5bLf0tBX7T0FnnGw0oDSWu8Es&m=lmrRGQ0q0u8q8eCyoDDHtDCxKniLMvrktlVw7qnV3Fo&s=zpJDdIRgv9hm0QkGZuHhDOYvc1_zMhUmH9TF7mx9A-0&e=> > > > > > Suresh > > > > On Oct 1, 2020, at 4:52 PM, Daniel Shchur <[email protected]> > wrote: > > > > Hi all, > > > > We are working on the HTCondor extension for Airavata. We have gone > through the code and started to implement additions based on the other job > workflow systems such as SLURM. We forked > <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_docquantum_airavata_tree_htcondor&d=DwMFaQ&c=Cu5g146wZdoqVuKpTNsYHeFX_rg6kWhlkLF8Eft-wwo&r=SfMtyOx08LDuEVnPLH5bLf0tBX7T0FnnGw0oDSWu8Es&m=lmrRGQ0q0u8q8eCyoDDHtDCxKniLMvrktlVw7qnV3Fo&s=14ShokmbcQHBZlmV67fTrNoK8ARktUQERu6wRQQTlWc&e=> > the > project and created a new branch (htcondor) to host our changes. We will > make a pull request into the main Airavata repository for it once we have > finished the implementation. A relevant issue has also been created here > <https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_AIRAVATA-2D3377&d=DwMFaQ&c=Cu5g146wZdoqVuKpTNsYHeFX_rg6kWhlkLF8Eft-wwo&r=SfMtyOx08LDuEVnPLH5bLf0tBX7T0FnnGw0oDSWu8Es&m=lmrRGQ0q0u8q8eCyoDDHtDCxKniLMvrktlVw7qnV3Fo&s=ZjE4skBTqEHdJqLBat2-uLoS1w6_Ksh_c5d4VPKjnS8&e=> > . > > > > We would like help to know exactly where additions need to be made in case > we missed a few spots. At this point, we know that: > > - A groovy template needs to be made (finished) > - A job configuration class needs to be made (WIP) > - A job parser class needs to be made (WIP) > - And enums need to be modified throughout the project so that systems > know of HTCondor as an option. (finished) > > > > If any of you could direct us to the right places, that would be greatly > appreciated. > > > > Also, if there’s more documentation or information about the code, such as > how the command map should work or should be implemented (configuration > class?), that would be appreciated. > > > > Thank you! > > > > - Daniel Shchur > > > > >
