Re: [arts-dev] ARTS scattering database interfaces
Hi Stefan, This is a fair point. Originally the intention was to use the Zenodo repository only for more major updates, while the ftp-server was intended for development versions. Regardless, I think we should reevaluate this approach. For instance, we should probably host the development version of the interface on GitHub instead (with the database itself still on the ftp server). We'll discuss this when Patrick and Simon are back from vacation. Best regards, Robin Ekelund PhD Student Department of Space, Earth and Environment +46(0)31 772 17 66 robin.ekel...@chalmers.se Chalmers University of Technology Hörsalsvägen 9/11 SE-412 96 Göteborg, Sweden www.chalmers.se From: Stefan Buehler Sent: Friday, August 16, 2019 12:09:55 PM To: Oliver Lemke Cc: Robin Nils Ekelund; Stuart Fox; arts_dev.mi@lists.uni-hamburg.de Subject: Re: [arts-dev] ARTS scattering database interfaces Dear all, I started with Zenodo yesterday for another project, and it was very pleasant to use actually. So I would suggest to put updates also there, it supports this very well. (It automatically generates a special DOI that always points to the latest version.) Then on the ARTS webpage just refer to Zenodo. Best wishes, Stefan > On 16. Aug 2019, at 11:33, Oliver Lemke wrote: > > Hi Robin, > > We removed the link to the ftp server from the webpage once the database was > published on Zenodo. > > Our FTP server contains the same version as Zenodo anyway: > > ftp://ftp-projects.cen.uni-hamburg.de/arts/ArtsScatDbase/ > > Once there are updates available which are not published on Zenodo, we can of > course put the link back. > > Cheers, > Oliver > > >> On 16 Aug 2019, at 10:57, Robin Nils Ekelund >> wrote: >> >> Hi Stuart, >> >> Thanks for your input and sorry for the late reply, just got back to the >> office. >> >> As Jana mentioned, most of us use the Matlab interface, hence we haven't >> detected this specific issue so far. >> >> Apart from the Zenodo repository, we have one on a ftp-server in Hamburg. I >> just checked the ARTS website and found that it's not linked anywhere yet. >> Currently it doesn't matter, because there's is currently no newer version >> than the Zenodo one yet anyway. >> >> I'll have a look at your changes Stuart and make sure that those are >> available in a new version, accessible from the ARTS homepage. I'm no Python >> expert, but I have others I can consult. >> >> Best regards, >> Robin Ekelund >> PhD Student >> Department of Space, Earth and Environment >> +46(0)31 772 17 66 >> robin.ekel...@chalmers.se >> >> Chalmers University of Technology >> Hörsalsvägen 9/11 >> SE-412 96 Göteborg, Sweden >> www.chalmers.se<http://www.chalmers.se> >> >> >> >> From: arts_dev.mi-boun...@mailman.rrz.uni-hamburg.de >> on behalf of Jana Mendrok >> >> Sent: Wednesday, August 14, 2019 12:44 PM >> To: arts_dev.mi@lists.uni-hamburg.de >> Cc: Fox, Stuart >> Subject: Re: [arts-dev] ARTS scattering database interfaces >> >> Hi Stuart, >> >> I guess, it's me to blame here. I did some testing, but obviously not >> exhaustive (enough) ;) >> Maybe it went unnoticed since there is a also matlab version of this, and >> maybe everyone who applied the method so far has used matlab. (at least >> Patrick. Who surely used the interpolation routine. But very likely in >> matlab.) >> >> Back when we developed this, we had an internal repository, which likely >> still exists, but I don't think there is a semi-public one like for ARTS and >> other ARTS-related tools. Yet. Could be a good thing to have, but that's up >> to Patrick and /or Stefan to decide and initiate. >> Would likely be good, if your changes are at least put into the internal >> repository. But I have to leave that to others of the ARTS-DB project group. >> >> Best wishes, >> Jana >> >> On Fri, Aug 9, 2019 at 11:10 AM Fox, Stuart >> wrote: >> Hi developers, >> >> I’ve been trying to use the Python assp methods (downloaded from the Zenodo >> link) to work with some single scattering data. Specifically, I have been >> trying to use assp.assp_interp_size to interpolate some optical properties >> onto a common size grid. However, there seems to be a number of bugs and >> typos in the code which mean that it doesn’t run. >> >> I think I’ve fixed the code so that it “works” (attached). However, I’m >> curious to know if anyone has actually used this method before, and if there >> are
Re: [arts-dev] ARTS scattering database interfaces
Dear all, I started with Zenodo yesterday for another project, and it was very pleasant to use actually. So I would suggest to put updates also there, it supports this very well. (It automatically generates a special DOI that always points to the latest version.) Then on the ARTS webpage just refer to Zenodo. Best wishes, Stefan > On 16. Aug 2019, at 11:33, Oliver Lemke wrote: > > Hi Robin, > > We removed the link to the ftp server from the webpage once the database was > published on Zenodo. > > Our FTP server contains the same version as Zenodo anyway: > > ftp://ftp-projects.cen.uni-hamburg.de/arts/ArtsScatDbase/ > > Once there are updates available which are not published on Zenodo, we can of > course put the link back. > > Cheers, > Oliver > > >> On 16 Aug 2019, at 10:57, Robin Nils Ekelund >> wrote: >> >> Hi Stuart, >> >> Thanks for your input and sorry for the late reply, just got back to the >> office. >> >> As Jana mentioned, most of us use the Matlab interface, hence we haven't >> detected this specific issue so far. >> >> Apart from the Zenodo repository, we have one on a ftp-server in Hamburg. I >> just checked the ARTS website and found that it's not linked anywhere yet. >> Currently it doesn't matter, because there's is currently no newer version >> than the Zenodo one yet anyway. >> >> I'll have a look at your changes Stuart and make sure that those are >> available in a new version, accessible from the ARTS homepage. I'm no Python >> expert, but I have others I can consult. >> >> Best regards, >> Robin Ekelund >> PhD Student >> Department of Space, Earth and Environment >> +46(0)31 772 17 66 >> robin.ekel...@chalmers.se >> >> Chalmers University of Technology >> Hörsalsvägen 9/11 >> SE-412 96 Göteborg, Sweden >> www.chalmers.se >> >> >> >> From: arts_dev.mi-boun...@mailman.rrz.uni-hamburg.de >> on behalf of Jana Mendrok >> >> Sent: Wednesday, August 14, 2019 12:44 PM >> To: arts_dev.mi@lists.uni-hamburg.de >> Cc: Fox, Stuart >> Subject: Re: [arts-dev] ARTS scattering database interfaces >> >> Hi Stuart, >> >> I guess, it's me to blame here. I did some testing, but obviously not >> exhaustive (enough) ;) >> Maybe it went unnoticed since there is a also matlab version of this, and >> maybe everyone who applied the method so far has used matlab. (at least >> Patrick. Who surely used the interpolation routine. But very likely in >> matlab.) >> >> Back when we developed this, we had an internal repository, which likely >> still exists, but I don't think there is a semi-public one like for ARTS and >> other ARTS-related tools. Yet. Could be a good thing to have, but that's up >> to Patrick and /or Stefan to decide and initiate. >> Would likely be good, if your changes are at least put into the internal >> repository. But I have to leave that to others of the ARTS-DB project group. >> >> Best wishes, >> Jana >> >> On Fri, Aug 9, 2019 at 11:10 AM Fox, Stuart >> wrote: >> Hi developers, >> >> I’ve been trying to use the Python assp methods (downloaded from the Zenodo >> link) to work with some single scattering data. Specifically, I have been >> trying to use assp.assp_interp_size to interpolate some optical properties >> onto a common size grid. However, there seems to be a number of bugs and >> typos in the code which mean that it doesn’t run. >> >> I think I’ve fixed the code so that it “works” (attached). However, I’m >> curious to know if anyone has actually used this method before, and if there >> are any potential pitfalls I should be aware of? Is there a repository >> anywhere for the database interfaces for up-to-date versions etc? >> >> I also had to make some changes to typhon to get things running – see >> https://github.com/atmtools/typhon/pull/308 >> >> Cheers, >> >> Stuart >> >> Dr Stuart Fox Radiation Research Manager >> Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom >> Tel: +44 (0) 330 135 2480 Fax: +44 (0)1392 885681 >> Email: stuart@metoffice.gov.uk Website: www.metoffice.gov.uk >> See our guide to climate change at >> http://www.metoffice.gov.uk/climate-change/guide/ >> >> ___ >> arts_dev.mi mailing list >> arts_dev.mi@lists.uni-hamburg.de >> https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi >> >
Re: [arts-dev] ARTS scattering database interfaces
Hi Robin, We removed the link to the ftp server from the webpage once the database was published on Zenodo. Our FTP server contains the same version as Zenodo anyway: ftp://ftp-projects.cen.uni-hamburg.de/arts/ArtsScatDbase/ Once there are updates available which are not published on Zenodo, we can of course put the link back. Cheers, Oliver > On 16 Aug 2019, at 10:57, Robin Nils Ekelund > wrote: > > Hi Stuart, > > Thanks for your input and sorry for the late reply, just got back to the > office. > > As Jana mentioned, most of us use the Matlab interface, hence we haven't > detected this specific issue so far. > > Apart from the Zenodo repository, we have one on a ftp-server in Hamburg. I > just checked the ARTS website and found that it's not linked anywhere yet. > Currently it doesn't matter, because there's is currently no newer version > than the Zenodo one yet anyway. > > I'll have a look at your changes Stuart and make sure that those are > available in a new version, accessible from the ARTS homepage. I'm no Python > expert, but I have others I can consult. > > Best regards, > Robin Ekelund > PhD Student > Department of Space, Earth and Environment > +46(0)31 772 17 66 > robin.ekel...@chalmers.se > > Chalmers University of Technology > Hörsalsvägen 9/11 > SE-412 96 Göteborg, Sweden > www.chalmers.se > > > > From: arts_dev.mi-boun...@mailman.rrz.uni-hamburg.de > on behalf of Jana Mendrok > > Sent: Wednesday, August 14, 2019 12:44 PM > To: arts_dev.mi@lists.uni-hamburg.de > Cc: Fox, Stuart > Subject: Re: [arts-dev] ARTS scattering database interfaces > > Hi Stuart, > > I guess, it's me to blame here. I did some testing, but obviously not > exhaustive (enough) ;) > Maybe it went unnoticed since there is a also matlab version of this, and > maybe everyone who applied the method so far has used matlab. (at least > Patrick. Who surely used the interpolation routine. But very likely in > matlab.) > > Back when we developed this, we had an internal repository, which likely > still exists, but I don't think there is a semi-public one like for ARTS and > other ARTS-related tools. Yet. Could be a good thing to have, but that's up > to Patrick and /or Stefan to decide and initiate. > Would likely be good, if your changes are at least put into the internal > repository. But I have to leave that to others of the ARTS-DB project group. > > Best wishes, > Jana > > On Fri, Aug 9, 2019 at 11:10 AM Fox, Stuart > wrote: > Hi developers, > > I’ve been trying to use the Python assp methods (downloaded from the Zenodo > link) to work with some single scattering data. Specifically, I have been > trying to use assp.assp_interp_size to interpolate some optical properties > onto a common size grid. However, there seems to be a number of bugs and > typos in the code which mean that it doesn’t run. > > I think I’ve fixed the code so that it “works” (attached). However, I’m > curious to know if anyone has actually used this method before, and if there > are any potential pitfalls I should be aware of? Is there a repository > anywhere for the database interfaces for up-to-date versions etc? > > I also had to make some changes to typhon to get things running – see > https://github.com/atmtools/typhon/pull/308 > > Cheers, > > Stuart > > Dr Stuart Fox Radiation Research Manager > Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom > Tel: +44 (0) 330 135 2480 Fax: +44 (0)1392 885681 > Email: stuart@metoffice.gov.uk Website: www.metoffice.gov.uk > See our guide to climate change at > http://www.metoffice.gov.uk/climate-change/guide/ > > ___ > arts_dev.mi mailing list > arts_dev.mi@lists.uni-hamburg.de > https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi > > > -- > = > Jana Mendrok, Ph.D. > Deutscher Wetterdienst > Frankfurter Str. 135 > 63067 Offenbach am Main, Germany > > Email: jana.mend...@dwd.de > Phone : +49 (0)69 8062 3139 > = > ___ > arts_dev.mi mailing list > arts_dev.mi@lists.uni-hamburg.de > https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi ___ arts_dev.mi mailing list arts_dev.mi@lists.uni-hamburg.de https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi
Re: [arts-dev] ARTS scattering database interfaces
Hi Stuart, Thanks for your input and sorry for the late reply, just got back to the office. As Jana mentioned, most of us use the Matlab interface, hence we haven't detected this specific issue so far. Apart from the Zenodo repository, we have one on a ftp-server in Hamburg. I just checked the ARTS website and found that it's not linked anywhere yet. Currently it doesn't matter, because there's is currently no newer version than the Zenodo one yet anyway. I'll have a look at your changes Stuart and make sure that those are available in a new version, accessible from the ARTS homepage. I'm no Python expert, but I have others I can consult. Best regards, Robin Ekelund PhD Student Department of Space, Earth and Environment +46(0)31 772 17 66 robin.ekel...@chalmers.se Chalmers University of Technology Hörsalsvägen 9/11 SE-412 96 Göteborg, Sweden www.chalmers.se From: arts_dev.mi-boun...@mailman.rrz.uni-hamburg.de on behalf of Jana Mendrok Sent: Wednesday, August 14, 2019 12:44 PM To: arts_dev.mi@lists.uni-hamburg.de Cc: Fox, Stuart Subject: Re: [arts-dev] ARTS scattering database interfaces Hi Stuart, I guess, it's me to blame here. I did some testing, but obviously not exhaustive (enough) ;) Maybe it went unnoticed since there is a also matlab version of this, and maybe everyone who applied the method so far has used matlab. (at least Patrick. Who surely used the interpolation routine. But very likely in matlab.) Back when we developed this, we had an internal repository, which likely still exists, but I don't think there is a semi-public one like for ARTS and other ARTS-related tools. Yet. Could be a good thing to have, but that's up to Patrick and /or Stefan to decide and initiate. Would likely be good, if your changes are at least put into the internal repository. But I have to leave that to others of the ARTS-DB project group. Best wishes, Jana On Fri, Aug 9, 2019 at 11:10 AM Fox, Stuart mailto:stuart@metoffice.gov.uk>> wrote: Hi developers, I’ve been trying to use the Python assp methods (downloaded from the Zenodo link) to work with some single scattering data. Specifically, I have been trying to use assp.assp_interp_size to interpolate some optical properties onto a common size grid. However, there seems to be a number of bugs and typos in the code which mean that it doesn’t run. I think I’ve fixed the code so that it “works” (attached). However, I’m curious to know if anyone has actually used this method before, and if there are any potential pitfalls I should be aware of? Is there a repository anywhere for the database interfaces for up-to-date versions etc? I also had to make some changes to typhon to get things running – see https://github.com/atmtools/typhon/pull/308 Cheers, Stuart Dr Stuart Fox Radiation Research Manager Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom Tel: +44 (0) 330 135 2480 Fax: +44 (0)1392 885681 Email: stuart@metoffice.gov.uk<mailto:stuart@metoffice.gov.uk> Website: www.metoffice.gov.uk<http://www.metoffice.gov.uk> See our guide to climate change at http://www.metoffice.gov.uk/climate-change/guide/ ___ arts_dev.mi mailing list arts_dev.mi@lists.uni-hamburg.de<mailto:arts_dev.mi@lists.uni-hamburg.de> https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi -- = Jana Mendrok, Ph.D. Deutscher Wetterdienst Frankfurter Str. 135 63067 Offenbach am Main, Germany Email: jana.mend...@dwd.de<mailto:jana.mend...@dwd.de> Phone : +49 (0)69 8062 3139 = ___ arts_dev.mi mailing list arts_dev.mi@lists.uni-hamburg.de https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi
Re: [arts-dev] ARTS scattering database interfaces
Hi Stuart, I guess, it's me to blame here. I did some testing, but obviously not exhaustive (enough) ;) Maybe it went unnoticed since there is a also matlab version of this, and maybe everyone who applied the method so far has used matlab. (at least Patrick. Who surely used the interpolation routine. But very likely in matlab.) Back when we developed this, we had an internal repository, which likely still exists, but I don't think there is a semi-public one like for ARTS and other ARTS-related tools. Yet. Could be a good thing to have, but that's up to Patrick and /or Stefan to decide and initiate. Would likely be good, if your changes are at least put into the internal repository. But I have to leave that to others of the ARTS-DB project group. Best wishes, Jana On Fri, Aug 9, 2019 at 11:10 AM Fox, Stuart wrote: > Hi developers, > > > > I’ve been trying to use the Python assp methods (downloaded from the > Zenodo link) to work with some single scattering data. Specifically, I have > been trying to use assp.assp_interp_size to interpolate some optical > properties onto a common size grid. However, there seems to be a number of > bugs and typos in the code which mean that it doesn’t run. > > > > I think I’ve fixed the code so that it “works” (attached). However, I’m > curious to know if anyone has actually used this method before, and if > there are any potential pitfalls I should be aware of? Is there a > repository anywhere for the database interfaces for up-to-date versions etc? > > > > I also had to make some changes to typhon to get things running – see > https://github.com/atmtools/typhon/pull/308 > > > > Cheers, > > > > Stuart > > > > Dr Stuart Fox Radiation Research Manager > > *Met Office* FitzRoy Road Exeter Devon EX1 3PB United Kingdom > Tel: +44 (0) 330 135 2480 Fax: +44 (0)1392 885681 > Email: stuart@metoffice.gov.uk Website: www.metoffice.gov.uk > See our guide to climate change at > http://www.metoffice.gov.uk/climate-change/guide/ > > > ___ > arts_dev.mi mailing list > arts_dev.mi@lists.uni-hamburg.de > https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi > -- = Jana Mendrok, Ph.D. Deutscher Wetterdienst Frankfurter Str. 135 63067 Offenbach am Main, Germany Email: jana.mend...@dwd.de Phone : +49 (0)69 8062 3139 = ___ arts_dev.mi mailing list arts_dev.mi@lists.uni-hamburg.de https://mailman.rrz.uni-hamburg.de/mailman/listinfo/arts_dev.mi
