Re: [QGIS-Developer] QGIS testing workflow with QgsMultiRenderChecker (on Windows and Travis)

2020-06-30 Thread Olivier Dalang
Hi Even, Hi Rizky,

Thanks for your answers ! I just learned from Matthias about the existence
of cdash.orfeo-toolbox.org (for which there's a tinyurl link at the bottom
of each travis run) that actually has exactly what I needed (for example
https://cdash.orfeo-toolbox.org/testDetails.php?test=20613873=46050).

Cheers,

Olivier


On Tue, 30 Jun 2020 at 11:04, Even Rouault 
wrote:

> On mardi 30 juin 2020 14:20:50 CEST Rizky Maulana Nugraha wrote:
>
> > Hi Olivier,
>
> >
>
> > Maybe this helps. You can run build in debug mode in travis. I usually
> just
>
> > make a private repo with a minimum script to run that said tests. Then
> you
>
> > can ssh into the build.
>
>
>
> Slightly more convenient is to use locally the Docker build method that is
> used by QGIS
>
> See https://github.com/qgis/QGIS/tree/master/.docker#building
>
>
>
> --
>
> Spatialys - Geospatial professional services
>
> http://www.spatialys.com
> ___
> QGIS-Developer mailing list
> QGIS-Developer@lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
___
QGIS-Developer mailing list
QGIS-Developer@lists.osgeo.org
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer

Re: [QGIS-Developer] QGIS testing workflow with QgsMultiRenderChecker (on Windows and Travis)

2020-06-30 Thread Even Rouault
On mardi 30 juin 2020 14:20:50 CEST Rizky Maulana Nugraha wrote:
> Hi Olivier,
> 
> Maybe this helps. You can run build in debug mode in travis. I usually just
> make a private repo with a minimum script to run that said tests. Then 
you
> can ssh into the build.

Slightly more convenient is to use locally the Docker build method that is 
used by QGIS
See https://github.com/qgis/QGIS/tree/master/.docker#building

-- 
Spatialys - Geospatial professional services
http://www.spatialys.com
___
QGIS-Developer mailing list
QGIS-Developer@lists.osgeo.org
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer

Re: [QGIS-Developer] QGIS testing workflow with QgsMultiRenderChecker (on Windows and Travis)

2020-06-30 Thread Rizky Maulana Nugraha
Hi Olivier,

Maybe this helps. You can run build in debug mode in travis. I usually just
make a private repo with a minimum script to run that said tests. Then you
can ssh into the build.
But this doesn't work in windows type build.

One other workaround I can think of is to just send the output file
somewhere.
When you run your travis job from your own repo, you can set the
environment variable yourself. You can put secrets there in the environment
in your repo's Travis settings (not in the repo, because the repo is
public, I assume).
For example, in the past I have tried to put my docker credentials to push
the built image and have it sent to docker hub with all necessary build
output inside, so I can look it up later.
If you just need the output, maybe sending the files over ssh/rsync will do.

Regards,
-- 
Rizky Maulana Nugraha
Kartoza
ri...@kartoza.com

On Mon, Jun 29, 2020 at 10:06 PM Olivier Dalang 
wrote:

> Dear list,
>
> I'm struggling a little bit with tests using QgsMultiRenderChecker.
>
> 1/ Running the tests *on Windows*, I get some small rendering differences
> with fonts that make tests fail. I'm getting the warnings below, both with
> the font installed in my system or not. It seems to load the font with a
> different size (20.1429 instead of 20) and as normal instead of bold, which
> would explain why the test fail. Any idea why this happens, and how to fix
> it ?
>
>
> ..\src\core\qgsfontutils.cpp(311) : (QgsFontUtils::getStandardTestFont) 
> [1372ms] Inexact font match - consider installing the QGIS Vera Sans font.
>
> ..\src\core\qgsfontutils.cpp(312) : (QgsFontUtils::getStandardTestFont) [0ms] 
> Requested: QGIS Vera Sans,20,-1,5,75,0,0,0,0,0,Bold
>
> ..\src\core\qgsfontutils.cpp(314) : (QgsFontUtils::getStandardTestFont) [2ms] 
> Replaced:  QGIS Vera Sans,20.1429,47,5,75,0,0,0,0
>
> 2/ The QgsLayoutChecker tests outputs some HTML view of the failing tests,
> allowing for a nice comparison of expected vs rendered images. When I run
> the tests locally, I can redirect the output to a report.html file, then
> see it in the browser (rather hacky, as all the test output goes in the
> file, so it's not at all a proper html file, but it works).
> Is it possible to somehow retrieve these results *from Travis *runs ?
> That would be very helpful to workaround 1/.
>
> Thanks !!
>
> Olivier
>
>
> ___
> QGIS-Developer mailing list
> QGIS-Developer@lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
___
QGIS-Developer mailing list
QGIS-Developer@lists.osgeo.org
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer