Re: [Qgis-developer] Setting up environment for developing with QGIS in c++
Thanks Richard, I'm on Linux :D. I'll take a look at the resources. Thanks! On Thu, Apr 2, 2015 at 2:48 PM, Richard Duivenvoorde wrote: > On 02-04-15 19:24, George Silva wrote: > > Hello everyone, > > > > Is there a place where I can find documentation on what sort of > > environment I need to develop/debug QGIS itself? > > > > What's the motivation behind this is a blocker bug in Raster Calculator, > > that I reported. > > Hi George, > > depending on your OS/environment/experience, you can either develop > using an editor + gdb (hardcore, only for jurgen I think :-) ) > see install file how to compile: > > https://github.com/qgis/QGIS/blob/master/INSTALL > > or using QtCreator if you prefer an IDE, Tim Sutton wrote about that > recently: > > http://kartoza.com/how-to-build-and-debug-qgis-with-qtcreator/ > > For what I know most devs are on linux, maybe somebody with development > experience on Windows can chime in for that. > > Feel free to ask questions on IRC > > Regards, > > Richard Duivenvoorde > > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
[Qgis-developer] Setting up environment for developing with QGIS in c++
Hello everyone, Is there a place where I can find documentation on what sort of environment I need to develop/debug QGIS itself? What's the motivation behind this is a blocker bug in Raster Calculator, that I reported. THanks -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] Using QGIS for parallel processing
What kind of parallel processing do you need? For example, rendering in QGIS is done in parallel. Do you need to do parallel processing for topological testing? Without more information, I can't say much more. George On Fri, Mar 20, 2015 at 5:05 PM, Patricia Carbajales wrote: > Hello, > > I am interested in using High Performance Computing resources with > geospatial data. Since QGIS is cross-platform, I wonder if it would be > possible to install QGIS in our Linux cluster to run parallel processes. > > I looked online for any information and couldn't find an answer. > > Any response will be much appreciated. > > Regards, > > Patricia > > > > > > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] QGIS and Coverity scans
Congratulations to everyone. Code quality is something that matters on the long run. Since QGIS only gets better, I envision a big marathon :P. Anyone who develops software and understands what these metrics mean know they are significant, so congratulations again. George On Wed, Feb 11, 2015 at 9:29 AM, Nathan Woodrow wrote: > > Thanks to Jürgen and Martin's assistance > > And yours of course. This is some great stabilization to the product. > > - Natahn > > On Wed Feb 11 2015 at 9:13:32 PM Nyall Dawson > wrote: > >> Hi all, >> >> If you've been following recent git commits, you'll have noticed a lot >> of "Coverity" related commits, and may be wondering what these are all >> about. >> >> Coverity Scan ( https://scan.coverity.com/ ) is a powerful automated >> static code analyser which is able to detect a large number of code >> errors, such as memory leaks and potential crashes, and even things >> like accidental copy/paste errors. It's a well respected service and >> fortunately offers free testing of open source projects (it's quite >> expensive for commercial software). >> >> When we first ran Coverity over the QGIS codebase about 2 weeks ago it >> picked up just over 1000 potential issues, with a defect density of >> about 1 error per 1000 lines of code. Apparently the standard for >> "good" software is a defect density of 1. For comparison, python sits >> at 0.08, and the Linux kernel at 0.53. Libreoffice's latest release >> hit 0.02, and they used this as a big highlight of their press release >> [1]. >> >> Thanks to Jürgen and Martin's assistance we're now down to a defect >> density of 0.26. I'm hoping that with a bit more work we can smash >> this down even further and possibly even reach the coveted "Coverity >> Clean" status [2] for 2.8. In any case this is a great demonstration >> that we are serious about code quality and stable releases, and is a >> good selling point for our first LTS release (alongside the expanding >> test suite and Travis CI testing). >> >> Unfortunately we can't automate submission to Coverity via Travis >> builds due to the compilation time required to build QGIS using >> Coverity exceeding Travis' limits, so I'm currently manually >> submitting builds to Coverity on a semi-regular schedule. >> >> The full Coverity defect reports are available by invitation only. If >> you're a developer and want to view them, let me know and I'll add you >> to the group. >> >> Nyall >> >> >> [1] http://blog.documentfoundation.org/2015/01/29/libreoffice-4-4-the- >> most-beautiful-libreoffice-ever/ >> [2] Why is this important? well... I really want to beat MapInfo >> there! http://www.pb.com/pbs-voc/product-improvements.shtml >> ___ >> Qgis-developer mailing list >> Qgis-developer@lists.osgeo.org >> http://lists.osgeo.org/mailman/listinfo/qgis-developer > > > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] guestimating plug-in dev time?
I also have a lot of experience with a large number of users (around 15)
editing a central database with PostGIS. No problems there.
Remi, the development time for this would be around a day. If you wish to
outsource that job, I have some experience with QGIS Plugins and I could
develop that for you.
George
On Mon, Jan 19, 2015 at 10:29 AM, Bernhard Ströbl
wrote:
> Hi Andreas,
>
> I do not think that multi-core rendering is the issue here as Remi
> mentions to have experienced crashes since QGIS 1.8.
>
> Remi,
> I am using QGIS with Postgres/PostGIS with some dozens of users on a
> central database _without_ any issues in QGIS (except the multi-core issue
> Andreas mentioned). So do share your problems together with relevent parts
> of your data base so they can beanalyzed.
>
> Bernhard
>
> Am 19.01.2015 13:19, schrieb Andreas Neumann:
>
>> Hi Remi,
>>
>> Regarding crashes with Postgis: do you have multithreading with a lot of
>> CPU cores active? I am experiencing crashes if more than 2 cores are
>> active. Try limiting to 2 CPU cores and see if this helps.
>>
>> Still trying to investigate this issue with the devs.
>>
>> Besides the above issue, editing with Postgis works stable for me -
>> certainly not as many crashes as you say you have.
>>
>> Please do not ignore the crashes but try to report them so that the devs
>> can do something about it.
>>
>> Andreas
>>
>> On 19.01.2015 11:57, Rémi Cura wrote:
>>
>>> I think a more global solution is possible.
>>> After all when you load a postgis layer in qgis, if somebody else
>>> changes it, the view is not refreshed, which is annoying (and
>>> sometimes dangerous because you may edit old data).
>>>
>>> It would be easy to ad this (which would also work for my case) using
>>> the LISTEN / NOTIFY feature of postgres.
>>>
>>> Basically when selecting a table as a new qgis layer, you
>>> automatically add a triger to it.
>>> The trigger will be fired at any change (create/delete/update).
>>> The trigger would simply send a message to qgis via NOTIFY.
>>> example : "NOTIFY qgis_change_ ;", where is a unique id.
>>> Of course qgis would be listening, which is very simple in python
>>> (import psycopg2;
>>> conn = psycopg.connect(my_database_string)
>>> conn.autocommit(1)
>>> curs = conn.cursor()
>>> curs.execute("LISTEN qgis_change_;"))
>>>
>>> Of course one would need a mechanism to remove this trigger when not
>>> necessary (for instance, name the channel "qgis_change_/time_stamp/",
>>> delete channel too old automatically, and change channel periodically
>>> (20 in for instance)).
>>>
>>> I don't know if from a security point of view it would be possibe
>>> tough (would require the permission to create a trigger).
>>> I don't know if typical qgis user have the right to create trigger on
>>> database they use.
>>>
>>> I use a lot of different version of QGIS and I can guarantee at least
>>> a dozen crash a day with version 1.8 to 2.3,
>>> plus pending transaction with postgis whenever the crash occurs.
>>> I'm installing 2.6 to see if postgis layers are less fragile right now ^^
>>>
>>> Cheers,
>>> Rémi-C
>>>
>>> 2015-01-19 11:29 GMT+01:00 Martin Dobias >> >:
>>>
>>> I see - indeed QGIS would need to do quite some database
>>> inspection to understand that layer A and layer B are related.
>>> This should be however also easy to address in a custom plugin.
>>>
>>> It is surprising to me that you say PostGIS layers are fragile in
>>> QGIS - they are very commonly used by lots of people and we
>>> haven't heard about crashes in the issue tracker. If you do
>>> experience crashes please consider filing reports on hub.qgis.org
>>> with instructions on how to replicate them.
>>>
>>> Regards
>>> Martin
>>>
>>>
>>> On Mon, Jan 19, 2015 at 5:18 PM, Rémi Cura >> > wrote:
>>>
>>> Thanks Martin,
>>> one day to several days feel like a very reasonnable order of
>>> magnitude.
>>>
>>> QGis is not refreshing the view because when editing layer A
>>> the postgis data base automatically also edit layer B.
>>> I don't think qgis has a mechanism of tracking dbchanges (it
>>> would be possible tough).
>>> Morevover PostGIS layer are still "fragile" in qgis (crashes
>>> often).
>>>
>>> Thanks for the help,
>>> Cheers
>>> Rémi-C
>>>
>>> 2015-01-19 10:56 GMT+01:00 Martin Dobias >> >:
>>>
>>> Hi Remi
>>>
>>> Such plugin should be quite easy to write - I would assume
>>> up to one day of work for an experienced pyqgis developer.
>>> For a newcomer it may take few more days to get familiar
>>> with the API, tools, environment and so on.
>>>
>>> For the refresh of rendering after geometry editing - that
>>> should work out of
Re: [Qgis-developer] Reverse order in PostGIS commit?
Hello Jurgen! I can test this easily. I'll get back to you soon. On Thu, Jul 10, 2014 at 12:03 PM, Jürgen E. wrote: > Hi George, > > On Thu, 10. Jul 2014 at 11:42:00 -0300, George Silva wrote: > > This could affect custom database triggers or implementations. > > > Here we use an auditing scheme to monitor perfomance of digitizing of our > > users. > > > I agree with Paolo here, this gives a unpredicted result in some > operations > > that might exist. > > Did anyone verify that the insertion order is different yet? Paolo said > that > it was. I'm not sure it is. > > But as said, as the return order is arbitrary later, I don't see a big > impact > if it wasn't. > > > Jürgen > > -- > Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-31 > Dipl.-Inf. (FH) Rheinstraße 13 Fax. +49-4931-918175-50 > Software Engineer D-26506 Norden > http://www.norbit.de > QGIS release manager (PSC) GermanyIRC: jef on FreeNode > > -- > norBIT Gesellschaft fuer Unternehmensberatung und Informationssysteme mbH > Rheinstrasse 13, 26506 Norden > GF: Jelto Buurman, HR: Amtsgericht Emden, HRB 5502 > > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] Reverse order in PostGIS commit?
This could affect custom database triggers or implementations. Here we use an auditing scheme to monitor perfomance of digitizing of our users. I agree with Paolo here, this gives a unpredicted result in some operations that might exist. On Thu, Jul 10, 2014 at 10:46 AM, Paolo Cavallini wrote: > Il 09/07/2014 09:40, Jürgen E. Fischer ha scritto: > > > You refer to the order of INSERTs? Why does that matter? The order in > which > > you get back the feature after INSERT later is undefined anyway. > > Ideally the records should be inserted in the order they have been > digitized, to give > the most predictable and least surprising results for the user. > All the best. > > -- > Paolo Cavallini - www.faunalia.eu > Corsi QGIS e PostGIS: http://www.faunalia.eu/training.html > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] Bug with avoid intersection - willing to fund fix
I already asked a few devs without response. Ive even dug under the cpp hood to see if I could find somethimg interesting, and I did, but Im not sure on how to resolve the issue, since cpp is kinda of a black art for me :-) Devs around the world! How much it will cost to fix this bug? Em 14/11/2013 07:53, "Andreas Neumann" escreveu: > Hi, > > So if there is so much interest in having this issue fixed I assume that > there would be plenty out there who would fund the fix! > > The fix won't happen if noone pays for it - just complaining about this > does not help. > > Get an estimate from some developer (e.g. Sandro Santilli oder > Sourcepole) to know how much it would cost to fix. > > As much as I like GRASS - and it is very good to know that this > workaround exists (thanks Stefan for mentioning it!) - I don't think it > is reasonable to ask people to go through GRASS to get proper data out > of their QGIS digitized data set. > > Who will take the lead to ask a developer? > > Andreas > > Am 14.11.2013 10:40, schrieb Blumentrath, Stefan: > > Hi George > > > > I had a lot of trouble with those issues too, and I would really love to > see them fixed. In other words, I agree with Giovanni that these are pretty > important bugs for many and not really uncommon digitization use-cases and > would support his categorization as blocker... > > > > However, my current workaround is to ignore the untidiness in the > topology at first and then send the vector dataset through GRASS which is > (at least for not too big datasets) quite convenient using the > Sextante/Processing framework (see also discussion here): > > > http://osgeo-org.1560.x6.nabble.com/Running-v-clean-on-a-QGIS-vector-layer-Polygon-through-Sextante-td5050418.html > > > > Cheers > > Stefan > > > > > > > > ___ > > Qgis-developer mailing list > > Qgis-developer@lists.osgeo.org > > http://lists.osgeo.org/mailman/listinfo/qgis-developer > > > > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] Bug with avoid intersection - willing to fund fix
Any comments from the QGis crowd? Thanks On Sat, Nov 9, 2013 at 9:18 AM, Sandro Santilli wrote: > On Thu, Nov 07, 2013 at 04:26:32PM -0200, George Silva wrote: > > QGis does the explicit noding of the first adjancent feature, but the > > results are inconsistent. > > Noding should involve all nearby features, updating each of them > to include the new node. > > > Sometimes it works, sometimes it doesnt. I've tried many things to see > if I > > could find a reproducible series of steps, but without success. > > I bet, it's not easy to "manually" put points in critical spots > of a floating point grid ! > > --strk; > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] [geos-devel] Bug with avoid intersection - willing to fund fix
Hello Sandro. I dont think this is a GEOS bug. I was following the various discussions on this bug/unexpected behavior. On one of them, in discussion with Marco, you said that it might be a problem with GEOSDifference. And after that theres our chat in IRC, which seems to fit the problem. We can easily test this inserting the geometries directly in Postgis, I mean, the result of an ST_Difference. Im not sure where the bug resides, but I would like to come up with alternatives, or at least a very clear method of constructing these polygons in Qgis that will not result in errors. It seems to me that if the new polygon only intersects another one, works, but that is not always the case when doing land use maps. The plain simple test that Qgis MUST pass is that polygons created with avoid intersections options, should have NO topological errors. Im just travelling right now, but we'll come up with test cases. Anyone on Qgis community has any ideas? Thanks everyone Em 08/11/2013 07:41, "Sandro Santilli" escreveu: ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] Bug with avoid intersection - willing to fund fix
QGis does the explicit noding of the first adjancent feature, but the results are inconsistent. Sometimes it works, sometimes it doesnt. I've tried many things to see if I could find a reproducible series of steps, but without success. Right now we are comparing the results ArcGIS is giving us against QGIS topology checker. It looks like QGIS topology checker is finding a lot more errors (I think QGIS is correct), but the main difference is visualization of the errors (which is another deal). Any ideas? On Thu, Nov 7, 2013 at 3:36 PM, Sandro Santilli wrote: > On Thu, Nov 07, 2013 at 06:28:47PM +0100, kimaidou wrote: > > Hi > > > > I have seen another "bug" or misbehaviour IMHO : I would expect QGIS to > > automatically create a node at the intersection of 2 linestring when > > topology editing is ON, with no need to do it manually. This would help a > > lot too. > > +1 > > GEOS-3.4.0 introduced a GEOSNode interface that could be handy for that. > > Explicit noding would also probably help fixing other issues, > which I suspect are due to the conceptually wrong assumption > that you can snap a point to a line: > http://lists.osgeo.org/pipermail/geos-devel/2013-November/006720.html > > --strk; > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
[Qgis-developer] Bug with avoid intersection - willing to fund fix
Hello everyone, We have an important QGis digitizing issue that is blocking and generating a lot of work for us. The issue has been described in more then 3 bugs ( http://hub.qgis.org/issues/8174, http://hub.qgis.org/issues/4880, and others) and it really hurts QGis image as a software. This is something that cannot happen. In our current setup we have 10 GIS Analysts working on a large area, doing land use maps. This problem is killing us! I'm cross posting in GEOS dev list to see if there is interest in fixing this bug, one way or the other and our company is willing to fund part (or depending how much, all the costs) of the development of this fix. Please, let me know. Thanks! -- George R. C. Silva SIGMA Consultoria http://www.consultoriasigma.com.br/ ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
[Qgis-developer] Customizing the "save feature" behavior
Hello devs! Is it possible using python to customize the "save feature" behavior of QGIS? This is my use case: I want to use the built in digitizer functions to create some segments. After the user finishes a certain segment, I need to validate that record and perform some extra actions on it. This is somewhat similar to what ArcGIS have, and they call it Tasks in ArcObjects. A custom task will perform that custom behavior with that finished sketch. How much work will I have to implement something like that? Can it be done with Python? Cheers! -- George R. C. Silva Desenvolvimento em GIS http://geoprocessamento.net http://blog.geoprocessamento.net ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
[Qgis-developer] Configuring PyCharm
Hello experts, I've been trying to configure PyCharm to remotely debug Quantum GIS plugins. Can anyone help me on how to do it? I tried to do this: http://blog.jetbrains.com/pycharm/2010/12/python-remote-debug-with-pycharm/ but no luck. Also, what are the best practices on how to deploy/test a new plugin? The biggest problem I've seem is that my project (that it's located elsewhere) needs to be transfered to .qgis/plugins to work. How can I circumvent this need? Or should I build a "pre build" script? Thanks for all the help, -- George R. C. Silva Desenvolvimento em GIS http://geoprocessamento.net http://blog.geoprocessamento.net ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] MXD
The Mxd format is more complex then just filenames. As mentioned, there are styling issues, graphics, projections and custom objects stored to it. ArcGIS uses a variety of Properties (Key Value pairs) and saves them to each MXD also. Custom extensions, labelling, ah, my head is hurting already. I'm not sure if this is such an easy task. I can provide some MXDs for analysis, just let me know. George On Thu, Jan 27, 2011 at 2:09 PM, Barry Rowlingson < b.rowling...@lancaster.ac.uk> wrote: > On Thu, Jan 27, 2011 at 1:56 PM, Stephan Holl > wrote: > > > I would love to read more about Barries reverse engeneerings of the > > 'obfuscated' format. > > All I've discovered at the moment is that if you dump it using > "strings -e l foo.mxd" on a Linux box you can actually see the file > names of shapefiles and geotiffs - they're stored as UTF-16 strings. > But being able to locate where in the whole mush of strings that whizz > past so you could automatically strip them out is another problem. > > If I actually had this problem on a one-off, say someone gave me a > MXD with two layers and the accompanying shapefiles, I'd probably just > do it manually - start Qgis, load two layers. With a hundred layers > I'd probably get the filenames and make a Qgis project file > programmatically. But given that extracting anything other than the > layer file names and ordering (styling, for example) is just about > impossible I'd probably do it from the filenames rather than the MXD > itself. But anyway, for me the break-even point for automating this is > about 20 layers, and that might only happen once in my lifetime... > > Barry > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva Desenvolvimento em GIS http://blog.geoprocessamento.net ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
Re: [Qgis-developer] Announcement: PostGIS Versioning System pgversion and QGIS Plugin
This is great. Congratulations on the plugin. George On Sun, Nov 7, 2010 at 3:14 PM, Paolo Cavallini wrote: > Il 07/11/2010 15:44, Horst Düster ha scritto: > > I hope that pgvs can make your life easier. > > Thanks a lot Horst! > I think we should merge (all/most) database tools in a common framework, > otherwise > life will become very difficult for our users (e.g. there is a different > versioning > system in the PostGIS manager plugin). > Food for discussion at the hackfest, I guess. > All the best. > > -- > Paolo Cavallini: http://www.faunalia.it/pc > ___ > Qgis-developer mailing list > Qgis-developer@lists.osgeo.org > http://lists.osgeo.org/mailman/listinfo/qgis-developer > -- George R. C. Silva Desenvolvimento em GIS http://blog.geoprocessamento.net ___ Qgis-developer mailing list Qgis-developer@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-developer
