Hi,

Good hints from Jukka,

Also, Roberto should check that he is using a 64bits JVM (Help/About/Info).

There is little chance that a 32bits JVM (1G memory) can load 1.5M features, but a 64 bits JVM with 8G RAM should be able to laod them (depends on the features though).

Also, querying a database consume more memory than the one necessary to hold the dataset in memory (it holds both the JDBC ResultSet and the FeatureCollection during the conversion).

You may succeed to load 500000 + 500000 + 500000 features even if loading 1.5M failed (you can use LIMIT, OFFSET for that or any attribute making it possible to split your dataset in several parts). AFAIR, combining the three dataset into a single one after that is not memory consuming.

Michaël

Le 29/09/2016 à 15:36, Rahkonen Jukka (MML) a écrit :

Hi,

I suppose that Kosmo is using some sort of disk cache while OpenJUMP keeps everything in memory. Going to 64-bit Java was a huge improvement for OJ but still it is memory bound.

Does Roberto need to handle all the 1.5 million features at a time? Often it is enough that all the features are available when you zoom in enough. If that happens to be the case he can just set the max features for that layer to, let’s say 10000. In OpenJUMP layers which are added with that route from PostGIS are dynamic. It means that when user pans or zooms a new query with new bounding box and LIMIT=10000 is fired. It means that it is both fast and memory friendly. It also means that in country wide view the map may look empty.

Run datastore query has similar option. Zoom to your area of interest, write your query like

SELECT * FROM my_huge_layer;

Now press the View button. It will add text ${view:0} to the query and it means that only features within the view will be fetched. This layer will be non-dynamic but user can use mouse right click on top of the layer name, select Database-Refresh Layer and a new query with the current BBOX will me made.

It is also possible to prevent the heavy country wide requests through the layer “Style – Scale - Only show layer when scale is between”.

If Roberto must do something for all the 1.5 million features he may still be able to do that in batches. Run datastore queries as

SELECT * FROM my_huge_layer limit 100000;

SELECT * FROM my_huge_layer limit 100000 offset 100000;

SELECT * FROM my_huge_layer limit 100000 offset 200000;

…

-Jukka Rahkonen-

Stefan Steiniger wrote:

So, it appears that Roberto is loading the features (1.5 million) from postgis, and gets an out of memory (he is working on Ubuntu with 8gb). Supposedly it works with Kosmo. Not sure what one can do here? Anyone an idea?

Stefan


El 29-09-2016, a las 07:49, Roberto Carlos Albani Meolans <robertoalb...@hotmail.com <mailto:robertoalb...@hotmail.com>> escribió:

    Gracias por tu ayuda.

    Tengo 8g de ram

    Estoy trabajando con base de datos postgis y trato de leer desde ahi.

    se entiende??

    Gracias


            Lähettäjä poisti kuvan.Roberto Carlos Albani Meolans

    ------------------------------------------------------------------------

    *De:*jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>
    <jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>>
    *Enviado:* jueves, 29 de septiembre de 2016 01:00 a.m.
    *Para:* jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    *Asunto:* Jump-pilot-devel Digest, Vol 123, Issue 41

    Send Jump-pilot-devel mailing list submissions to
    jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>

    To subscribe or unsubscribe via the World Wide Web, visit
    https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

    Jump-pilot-devel Info Page - SourceForge
    <https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel>

    lists.sourceforge.net <http://lists.sourceforge.net>

    Your email address: Your name (optional): You may enter a privacy
    password below. This provides only mild security, but should
    prevent others from messing with ...



    or, via email, send a message with subject or body 'help' to
    jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>

    You can reach the person managing the list at
    jump-pilot-devel-ow...@lists.sourceforge.net
    <mailto:jump-pilot-devel-ow...@lists.sourceforge.net>

    When replying, please edit your Subject line so it is more specific
    than "Re: Contents of Jump-pilot-devel digest..."


    Today's Topics:

       1. Re: Jump-pilot-devel Digest, Vol 123, Issue 39 (stefan
    steiniger)
       2. Re: Add SRID and units to Task (manf...@egger-gis.at
    <mailto:manf...@egger-gis.at>)


    ----------------------------------------------------------------------

    Message: 1
    Date: 28 Sep 2016 21:56:26 -0300
    From: "stefan steiniger" <sst...@geo.uzh.ch
    <mailto:sst...@geo.uzh.ch>>
    Subject: Re: [JPP-Devel] Jump-pilot-devel Digest, Vol 123, Issue 39
    To: "OpenJump develop and use"
            <jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>>
    Message-ID: <fdda8b87-16cb-4ede-b2eb-400600ad5...@geo.uzh.ch
    <mailto:fdda8b87-16cb-4ede-b2eb-400600ad5...@geo.uzh.ch>>
    Content-Type: text/plain; charset=windows-1252

    Hola Roberto,

    buena saber. Entonces tu cambiaste el archivo oj_linux.sh y
    reiniciaste OpenJUMP? (si me quieres mandar el archivo directo,
    pero bien hasta domingo estar? de viaje). Cuando ram tiene tu PC?
    Pero no tengo claro porque eso funciona con Kosmo pero no funciona
    con OpenJUMP. Excepto Kosmo no esta leyendo el archivo completo -
    o viene de una base de datos Postgis?

    slds,
    stefan

    Si no resulta, QGIS es tal vez la mejor alternativa - tambi?n con
    respeto a las funciones de cartograf?a y funciones de
    procesamiento (hay muchos ?plugins?).


    On Sep 28, 2016, at 8:31, Roberto Carlos Albani Meolans
    <robertoalb...@hotmail.com <mailto:robertoalb...@hotmail.com>> wrote:

    > Hola, y muchas gracias por su atencion.
    > El problema de memoria sigue.
    > Estamos trabajando en un sistema de catastro (Santa Fe,
    Argentina), donde se utiliza genamap como gis y queremos cambiar a
    so libre, y nos gusto mucho OpenJump.
    > Hemos probado con Kosmo y este problema de memoria no lo tiene,
    levanta el 1.500.000 registro de parcela y no tiene problema de
    memoria. Pero la decicion de un gis es OpenJump.
    >
    > La Pc es ubuntu 12.04 a 32 bit.
    >
    > Gracias, nuevamente
    >  Roberto Carlos Albani Meolans
    >
    >
    >
    > De: jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>
    <jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>>
    > Enviado: martes, 27 de septiembre de 2016 07:37 p.m.
    > Para: jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    > Asunto: Jump-pilot-devel Digest, Vol 123, Issue 39
    >
    > Send Jump-pilot-devel mailing list submissions to
    > jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    >
    > To subscribe or unsubscribe via the World Wide Web, visit
    > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

    Jump-pilot-devel Info Page - SourceForge
    <https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel>

    lists.sourceforge.net <http://lists.sourceforge.net>

    Your email address: Your name (optional): You may enter a privacy
    password below. This provides only mild security, but should
    prevent others from messing with ...



    > Jump-pilot-devel Info Page - SourceForge
    > lists.sourceforge.net <http://lists.sourceforge.net>
    > Your email address: Your name (optional): You may enter a
    privacy password below. This provides only mild security, but
    should prevent others from messing with ...
    >
    >
    > or, via email, send a message with subject or body 'help' to
    > jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>
    >
    > You can reach the person managing the list at
    > jump-pilot-devel-ow...@lists.sourceforge.net
    <mailto:jump-pilot-devel-ow...@lists.sourceforge.net>
    >
    > When replying, please edit your Subject line so it is more specific
    > than "Re: Contents of Jump-pilot-devel digest..."
    >
    >
    > Today's Topics:
    >
    >    1. memoria (Roberto Carlos Albani Meolans)
    >    2. Re: memoria (edgar.sol...@web.de <mailto:edgar.sol...@web.de>)
    >    3. Re: memoria (stefan steiniger)
    >    4. Re: memoria (edgar.sol...@web.de <mailto:edgar.sol...@web.de>)
    >    5. SVN: [5032]
    > core/trunk/src/com/vividsolutions/jump/datastore/postgis/
    >       PostgisValueConverterFactory.java
    >       (jump-pilot-...@lists.sourceforge.net
    <mailto:jump-pilot-...@lists.sourceforge.net>)
    >
    >
    >
    ----------------------------------------------------------------------
    >
    > Message: 1
    > Date: Mon, 26 Sep 2016 13:52:38 +0000
    > From: Roberto Carlos Albani Meolans <robertoalb...@hotmail.com
    <mailto:robertoalb...@hotmail.com>>
    > Subject: [JPP-Devel] memoria
    > To: "jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>"
    >         <jump-pilot-devel-requ...@lists.sourceforge.net
    <mailto:jump-pilot-devel-requ...@lists.sourceforge.net>>,
    >         "jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>"
    >         <jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>>
    > Message-ID:
> <by2pr17mb04567c83f7e7d6041d7fe53ab5...@by2pr17mb0456.namprd17.prod.outlook.com
    
<mailto:by2pr17mb04567c83f7e7d6041d7fe53ab5...@by2pr17mb0456.namprd17.prod.outlook.com>>
    >
    > Content-Type: text/plain; charset="iso-8859-1"
    >
    > Hola, estoy trabajando con openJump y cuando quiero cargar
    1.500.000 registro de parcelas tengo problemas de memoria.
    >
    >
    > Exception in thread "AWT-EventQueue-0" Exception in thread
    "TimerQueue" java.lang.OutOfMemoryError: GC overhead limit exceeded
    > Exception: java.lang.OutOfMemoryError thrown from the
    UncaughtExceptionHandler in thread "TimerQueue"
    >
    > at sun.java2d.SunGraphics2D.clone(SunGraphics2D.java:274)
    > at sun.java2d.SunGraphics2D.create(SunGraphics2D.java:308)
    > at java.awt.Graphics.create(Graphics.java:164)
    > at javax.swing.JComponent.paintChildren(JComponent.java:870)
    > at javax.swing.JSplitPane.paintChildren(JSplitPane.java:1047)
    > at javax.swing.JComponent.paint(JComponent.java:1064)
    > at javax.swing.JComponent.paintChildren(JComponent.java:888)
    > at javax.swing.JComponent.paint(JComponent.java:1064)
    > Exception in thread "AWT-XAWT" Exception in thread
    "AWT-EventQueue-0" java.lang.OutOfMemoryError: GC overhead limit
    exceeded
    > java.lang.OutOfMemoryError: GC overhead limit exceeded
    > [INFO] 10:50:02.296 Warning: GC overhead limit exceede
    >
    >
    > que puedo hace??
    > Gracias
    >
    >
    >
    > [http://graphics.hotmail.com/emsmilep.gif] Roberto Carlos Albani
    Meolans
    > -------------- next part --------------
    > An HTML attachment was scrubbed...
    >
    > ------------------------------
    >
    > Message: 2
    > Date: Mon, 26 Sep 2016 15:58:08 +0200
    > From: edgar.sol...@web.de <mailto:edgar.sol...@web.de>
    > Subject: Re: [JPP-Devel] memoria
    > To: OpenJump develop and use
    <jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>>
    > Message-ID: <74277027-8de9-81c6-cc43-0f6f95d70...@web.de
    <mailto:74277027-8de9-81c6-cc43-0f6f95d70...@web.de>>
    > Content-Type: text/plain; charset=windows-1252
    >
    > On 26.09.2016 15:52, Roberto Carlos Albani Meolans wrote:
    > > Hola, estoy trabajando con openJump y cuando quiero cargar
    1.500.000 registro de parcelas tengo problemas de memoria.
    > >
    > >
    > > Exception in thread "AWT-EventQueue-0" Exception in thread
    "TimerQueue" java.lang.OutOfMemoryError: GC overhead limit exceeded
    > > Exception: java.lang.OutOfMemoryError thrown from the
    UncaughtExceptionHandler in thread "TimerQueue"
    > >
    > > at sun.java2d.SunGraphics2D.clone(SunGraphics2D.java:274)
    > > at sun.java2d.SunGraphics2D.create(SunGraphics2D.java:308)
    > > at java.awt.Graphics.create(Graphics.java:164)
    > > at javax.swing.JComponent.paintChildren(JComponent.java:870)
    > > at javax.swing.JSplitPane.paintChildren(JSplitPane.java:1047)
    > > at javax.swing.JComponent.paint(JComponent.java:1064)
    > > at javax.swing.JComponent.paintChildren(JComponent.java:888)
    > > at javax.swing.JComponent.paint(JComponent.java:1064)
    > > Exception in thread "AWT-XAWT" Exception in thread
    "AWT-EventQueue-0" java.lang.OutOfMemoryError: GC overhead limit
    exceeded
    > > java.lang.OutOfMemoryError: GC overhead limit exceeded
    > > [INFO] 10:50:02.296 Warning: GC overhead limit exceede
    > >
    > >
    > > que puedo hace??
    >
    > hey Roberto, can you write in english by any chance? ..ede
    >
    >
    >
    > ------------------------------
    >
    > Message: 3
    > Date: 26 Sep 2016 19:23:14 -0300
    > From: "stefan steiniger" <sst...@geo.uzh.ch
    <mailto:sst...@geo.uzh.ch>>
    > Subject: Re: [JPP-Devel] memoria
    > To: "OpenJump develop and use"
    >         <jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>>
    > Message-ID: <3a310f2f-8727-481f-b453-aa63d7a94...@geo.uzh.ch
    <mailto:3a310f2f-8727-481f-b453-aa63d7a94...@geo.uzh.ch>>
    > Content-Type: text/plain; charset=windows-1252
    >
    > Hola Roberto,
    >
    > se puede aumentar la memoria en oj_windows.bat o oj_linux.sh en
    la linea
    > #JAVA_MAXMEM=?-Xmx1024M
    > hay que borrar el # y en este caso la memoria usado seria
    1024MG=1GB cuando abres OpenJUMP de nuevo.
    >
    > slds,
    > Stefan
    >
    > @Edgar, hope its ok when I just respond - although its an
    english list ;)
    >
    > On Sep 26, 2016, at 10:58, edgar.sol...@web.de
    <mailto:edgar.sol...@web.de> wrote:
    >
    > > On 26.09.2016 15:52, Roberto Carlos Albani Meolans wrote:
    > >> Hola, estoy trabajando con openJump y cuando quiero cargar
    1.500.000 registro de parcelas tengo problemas de memoria.
    > >>
    > >>
    > >> Exception in thread "AWT-EventQueue-0" Exception in thread
    "TimerQueue" java.lang.OutOfMemoryError: GC overhead limit exceeded
    > >> Exception: java.lang.OutOfMemoryError thrown from the
    UncaughtExceptionHandler in thread "TimerQueue"
    > >>
    > >> at sun.java2d.SunGraphics2D.clone(SunGraphics2D.java:274)
    > >> at sun.java2d.SunGraphics2D.create(SunGraphics2D.java:308)
    > >> at java.awt.Graphics.create(Graphics.java:164)
    > >> at javax.swing.JComponent.paintChildren(JComponent.java:870)
    > >> at javax.swing.JSplitPane.paintChildren(JSplitPane.java:1047)
    > >> at javax.swing.JComponent.paint(JComponent.java:1064)
    > >> at javax.swing.JComponent.paintChildren(JComponent.java:888)
    > >> at javax.swing.JComponent.paint(JComponent.java:1064)
    > >> Exception in thread "AWT-XAWT" Exception in thread
    "AWT-EventQueue-0" java.lang.OutOfMemoryError: GC overhead limit
    exceeded
    > >> java.lang.OutOfMemoryError: GC overhead limit exceeded
    > >> [INFO] 10:50:02.296 Warning: GC overhead limit exceede
    > >>
    > >>
    > >> que puedo hace??
    > >
    > > hey Roberto, can you write in english by any chance? ..ede
    > >
    > >
    
------------------------------------------------------------------------------
    > > _______________________________________________
    > > Jump-pilot-devel mailing list
    > > Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    > > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

    Jump-pilot-devel Info Page - SourceForge
    <https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel>

    lists.sourceforge.net <http://lists.sourceforge.net>

    Your email address: Your name (optional): You may enter a privacy
    password below. This provides only mild security, but should
    prevent others from messing with ...



    > Jump-pilot-devel Info Page - SourceForge
    > lists.sourceforge.net <http://lists.sourceforge.net>
    > Your email address: Your name (optional): You may enter a
    privacy password below. This provides only mild security, but
    should prevent others from messing with ...
    >
    >
    >
    >
    >
    >
    > ------------------------------
    >
    > Message: 4
    > Date: Tue, 27 Sep 2016 09:48:01 +0200
    > From: edgar.sol...@web.de <mailto:edgar.sol...@web.de>
    > Subject: Re: [JPP-Devel] memoria
    > To: jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    > Message-ID: <fcd56a02-815a-91c9-8315-3eb75d16c...@web.de
    <mailto:fcd56a02-815a-91c9-8315-3eb75d16c...@web.de>>
    > Content-Type: text/plain; charset=windows-1252
    >
    > Stefan,
    >
    > just didn't want to activate an online translator, in case he's
    english capable. afaics you suggest to manually adjust the maxmem
    setting. i would ask him for the OJ version used, as we have a
    routine that sets maxmem to 90% or so of the available memory
    since a while.
    >
    > also using more then 1GB requires a java 64bit runtime.. ede
    >
    > On 27.09.2016 00:23, stefan steiniger wrote:
    > > Hola Roberto,
    > >
    > > se puede aumentar la memoria en oj_windows.bat o oj_linux.sh
    en la linea
    > > #JAVA_MAXMEM=?-Xmx1024M
    > > hay que borrar el # y en este caso la memoria usado seria
    1024MG=1GB cuando abres OpenJUMP de nuevo.
    > >
    > > slds,
    > > Stefan
    > >
    > > @Edgar, hope its ok when I just respond - although its an
    english list ;)
    > >
    > > On Sep 26, 2016, at 10:58, edgar.sol...@web.de
    <mailto:edgar.sol...@web.de> wrote:
    > >
    > >> On 26.09.2016 15:52, Roberto Carlos Albani Meolans wrote:
    > >>> Hola, estoy trabajando con openJump y cuando quiero cargar
    1.500.000 registro de parcelas tengo problemas de memoria.
    > >>>
    > >>>
    > >>> Exception in thread "AWT-EventQueue-0" Exception in thread
    "TimerQueue" java.lang.OutOfMemoryError: GC overhead limit exceeded
    > >>> Exception: java.lang.OutOfMemoryError thrown from the
    UncaughtExceptionHandler in thread "TimerQueue"
    > >>>
    > >>> at sun.java2d.SunGraphics2D.clone(SunGraphics2D.java:274)
    > >>> at sun.java2d.SunGraphics2D.create(SunGraphics2D.java:308)
    > >>> at java.awt.Graphics.create(Graphics.java:164)
    > >>> at javax.swing.JComponent.paintChildren(JComponent.java:870)
    > >>> at javax.swing.JSplitPane.paintChildren(JSplitPane.java:1047)
    > >>> at javax.swing.JComponent.paint(JComponent.java:1064)
    > >>> at javax.swing.JComponent.paintChildren(JComponent.java:888)
    > >>> at javax.swing.JComponent.paint(JComponent.java:1064)
    > >>> Exception in thread "AWT-XAWT" Exception in thread
    "AWT-EventQueue-0" java.lang.OutOfMemoryError: GC overhead limit
    exceeded
    > >>> java.lang.OutOfMemoryError: GC overhead limit exceeded
    > >>> [INFO] 10:50:02.296 Warning: GC overhead limit exceede
    > >>>
    > >>>
    > >>> que puedo hace??
    > >>
    > >> hey Roberto, can you write in english by any chance? ..ede
    > >>
    > >>
    
------------------------------------------------------------------------------
    > >> _______________________________________________
    > >> Jump-pilot-devel mailing list
    > >> Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    > >> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

    Jump-pilot-devel Info Page - SourceForge
    <https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel>

    lists.sourceforge.net <http://lists.sourceforge.net>

    Your email address: Your name (optional): You may enter a privacy
    password below. This provides only mild security, but should
    prevent others from messing with ...



    > Jump-pilot-devel Info Page - SourceForge
    > lists.sourceforge.net <http://lists.sourceforge.net>
    > Your email address: Your name (optional): You may enter a
    privacy password below. This provides only mild security, but
    should prevent others from messing with ...
    >
    >
    > >
    > >
    > >
    
------------------------------------------------------------------------------
    > > _______________________________________________
    > > Jump-pilot-devel mailing list
    > > Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    > > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

    Jump-pilot-devel Info Page - SourceForge
    <https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel>

    lists.sourceforge.net <http://lists.sourceforge.net>

    Your email address: Your name (optional): You may enter a privacy
    password below. This provides only mild security, but should
    prevent others from messing with ...



    > Jump-pilot-devel Info Page - SourceForge
    > lists.sourceforge.net <http://lists.sourceforge.net>
    > Your email address: Your name (optional): You may enter a
    privacy password below. This provides only mild security, but
    should prevent others from messing with ...
    >
    >
    > >
    >
    >
    >
    > ------------------------------
    >
    > Message: 5
    > Date: Tue, 27 Sep 2016 22:37:06 +0000
    > From: jump-pilot-...@lists.sourceforge.net
    <mailto:jump-pilot-...@lists.sourceforge.net>
    > Subject: [JPP-Devel] SVN: [5032]
    > core/trunk/src/com/vividsolutions/jump/datastore/postgis/
    >         PostgisValueConverterFactory.java
    > To: jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    > Message-ID:
> <mailman.37875.1475015828.6153.jump-pilot-de...@lists.sourceforge.net
    
<mailto:mailman.37875.1475015828.6153.jump-pilot-de...@lists.sourceforge.net>>
    > Content-Type: text/plain; charset=UTF-8
    >
    > Revision: 5032
    > http://sourceforge.net/p/jump-pilot/code/5032
    <http://sourceforge.net/p/jump-pilot/code/5032>
    > Author:   michaudm
    > Date:     2016-09-27 22:37:05 +0000 (Tue, 27 Sep 2016)
    > Log Message:
    > -----------
    > Finally remove bytea->geometry mapping for postgis
    >
    > Modified Paths:
    > --------------
    >
    
core/trunk/src/com/vividsolutions/jump/datastore/postgis/PostgisValueConverterFactory.java
    >
    > Modified:
    
core/trunk/src/com/vividsolutions/jump/datastore/postgis/PostgisValueConverterFactory.java
    > ===================================================================
    > ---
    
core/trunk/src/com/vividsolutions/jump/datastore/postgis/PostgisValueConverterFactory.java
    2016-09-25 22:42:47 UTC (rev 5031)
    > +++
    
core/trunk/src/com/vividsolutions/jump/datastore/postgis/PostgisValueConverterFactory.java
    2016-09-27 22:37:05 UTC (rev 5032)
    > @@ -24,7 +24,8 @@
    >
    >      // manages 2 cases: type retrieved from Database metadata
    (DataStore Panel)
    >      // and from direct Adhoc query (type of the column resultset).
    > -    if ("bytea".equalsIgnoreCase(dbTypeName) ||
    "geometry".equalsIgnoreCase(dbTypeName)) {
    > +    // Finally, converting bytea to geometry is a bad idea
    > +    if (/*"bytea".equalsIgnoreCase(dbTypeName) ||*/
    "geometry".equalsIgnoreCase(dbTypeName)) {
    >        return WKB_GEOMETRY_MAPPER;
    >      }
    >
    >
    >
    >
    >
    > ------------------------------
    >
    >
    
------------------------------------------------------------------------------
    >
    >
    > ------------------------------
    >
    > _______________________________________________
    > Jump-pilot-devel mailing list
    > Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

    Jump-pilot-devel Info Page - SourceForge
    <https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel>

    lists.sourceforge.net <http://lists.sourceforge.net>

    Your email address: Your name (optional): You may enter a privacy
    password below. This provides only mild security, but should
    prevent others from messing with ...



    > Jump-pilot-devel Info Page - SourceForge
    > lists.sourceforge.net <http://lists.sourceforge.net>
    > Your email address: Your name (optional): You may enter a
    privacy password below. This provides only mild security, but
    should prevent others from messing with ...
    >
    >
    >
    >
    > End of Jump-pilot-devel Digest, Vol 123, Issue 39
    > *************************************************
    >
    >
    
------------------------------------------------------------------------------
    > _______________________________________________
    > Jump-pilot-devel mailing list
    > Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel




    ------------------------------

    Message: 2
    Date: Thu, 29 Sep 2016 00:00:08 -0400 (EDT)
    From: "manf...@egger-gis.at <mailto:manf...@egger-gis.at>"
    <manf...@egger-gis.at <mailto:manf...@egger-gis.at>>
    Subject: Re: [JPP-Devel] Add SRID and units to Task
    To: "OpenJump develop and use"
            <jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>>
    Cc: jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    Message-ID: <1475121608.017232...@webmail.jimdo.com
    <mailto:1475121608.017232...@webmail.jimdo.com>>
    Content-Type: text/plain;charset=UTF-8

    Good morning!

    I published a first version of my tool including registered
    EPSG-Codes in geotools 2.6.0.  :

    http://www.egger-gis.at/shapefile-projectionfinder/

    Before i start to develop a OPEN JUMP PLUGIN i want to ask which
    databases OPEN JUMP uses for transformations?

    I the last weeks i saw in your email traffic that you included
    different sources of projection definitions (EPSG, ESRI, user
    defs, ...)?

    And is it possible to make different .prj files? You know ESRI can
    not read WKT by OGC...

    Best regards,

    Manfred Egger

    Alois-Schrott-Str. 34
    6020 Innsbruck
    Austria

    Web: http://egger-gis.at

    -----Original Message-----
    From: "Micha?l Michaud" <m.michael.mich...@orange.fr
    <mailto:m.michael.mich...@orange.fr>>
    Sent: Thursday, August 4, 2016 5:32pm
    To: jump-pilot-devel@lists.sourceforge.net
    <mailto:jump-pilot-devel@lists.sourceforge.net>
    Subject: Re: [JPP-Devel] Add SRID and units to Task

    Hi Peppe,

    Your explanation is clear.

    I tend to be on the same opinion as Jukka on this topic because I
    generally use OpenJUMP as a toolbox, and I generally know exactly
    what I
    want to do with my data.

    But I admit that to visualize heterogeneous data, OpenJUMP has not
    much
    to offer to the user to solve projection problems, and the
    beginner can
    be bothered by the lack of assistance.

    Here are a few recommandation :

    1 - Projection issues may be tricky. It is magic as long as the only
    need is visualization, but if the user need to reproject his
    dataset, he
    must be aware of the consequences (reversibility, topology
    consistency...). Last time I have been screwed by a projection
    problem
    is with FME. I imported shapefiles with a prj in a project using the
    "same" projection. It was supposed to be a no-op (doing nothing),
    except
    that FME did a transformation from projection A (defined by prj
    parameters) to projection A (defined by internal FME parameters),
    which
    resulted in an invisible switch of  a few micrometers difficult to
    see,
    but which broke the consistency with another layer (which did not
    follow
    the same process). Of course this can be avoided in FME, but this is
    just an example to illustrate that without a great care, something
    supposed to be magic may become dramatic.

    2 - From my point of view, one of the most difficult problem is to be
    able to recognize that two coordinate reference system with different
    origins (different registries, different formats, different
    libraries,
    different definitions) represent the same thing (see the above
    problem
    with FME). I think you already worked on that problem.

    3 - Your mail explains quite clearly what already exists and where
    you
    want to go. I think that to anticipate difficulties, we can
    suppose that
    a SRID is associated to the task and try to define OpenJUMP
    behaviour in
    different situations :
    - default behaviour when creating a new task : asking for a srid
    or not
    ? it is a good thing if OJ can infer information from prj files or
    other
    sources, but I don't like having to answer esoteric questions
    before I
    can start working.
    - task without srid : does it take the srid of the first layer
    imported
    ? What if layers without srid are already imported ?
    - can we change the srid of a task if layers with srid are already
    imported ?
    - importing a layer with a different srid : 1) the layer is just
    tagged
    (layer srid mismatch task srid), 2) the layer is automatically
    reprojected by the renderer ? 3) the user is invited to reproject the
    layer ? 4) There are some options to define OpenJUMP behaviour
    - how to deal with layers without projection : can we import them
    in a
    task with a srid ? can we edit them ? Do we set the task
    projection to
    the layer projection automatically ?
    - if a reprojected layer is not editable, an interesting option
    would be
    to set the task srid to the selected layer srid (-> makes the
    selected
    layer editable, and reproject other layers)
    - etc.

    4- Implementation : no real opinion. Ede's advice will certainly make
    the code more flexible, but also a bit more complex. And how to
    represent the coordinate system property ? Another difficult
    question.
    We already have SRID represented by an int at the geometry level
    (JTS)
    and a CoordinateSystem at the FeatureSchema level. IMHO, the first
    is a
    bit too lightweight (cannot handle non EPSG crs). The second is too
    lightweight if we want to use it to effectively transform coordinates
    (cannot handle much transformations) and too heavyweight if we
    just use
    it as a reference to be used by CTS library (or any other).


    My 3 cents

    Michael



    Le 03/08/2016 ? 15:13, Gmail a ?crit :
    > LoopThis thread needs a larger explanation.
    > I try to simplify it.
    > other GIS like Kosmo or GVSig implemented Coordinate system
    framework
    > following these steps:
    > a) first step they add a projection object to the task (usually
    as EPSG or
    > ESRI code). In Kosmo user has to set that. QGIS also allows to
    set Task
    > projection loading that from the first loadedf file (with SRID).
    > b) QGIS define the Unit of the task from SRID ( ex. 4326>degree,
    > 32632>metre) while GvSig And Kosmo require to set it manually.
    > c) a projection object is set to each loaded layer. This is done
    reading
    > layer metadata or manually
    > d) if the task and the layer projection object are different a
    > transformation should be set. Those software use ( for vector) proj4
    > libraries. In this step Qgis and newer gvsig allows on fly
    reprojection.
    > e) this transformation is taken into account only by layer
    renderes on the
    > workbench. Which changes geometry before drawing it.
    > This transformation is saved into project file and taken into
    account
    > whenever the project file is loaded.
    > f) Note that Kosmo (and probably Gvsig) doesn't allow any
    spatial operation
    > on reprojected layers. The only way to modify them is to save
    them reprojected.
    >
    > Recently I did few modifications on shape file reading in order
    to expand
    > capability to set layer SRId  when reading file. Layer
    properties plugins
    > already have this capability for both raster and vector ( included
    > geotif*). Together with database and wfs capability to record
    layer srid we
    > probably get almost point C of my list.
    >
    > My idea is to work on point A and B, integrating parts if my
    measure plugin
    > in to OJ core in order to have measurements\zoom when task
    projection is
    > geographic or possibility that oj display meter or feet unit on
    > measurements \ scale bar.
    > The other points can be faced in the future, including in fly
    reprojection.
    >
    > My project:
    > 1) Oj already as a srid registry embedded that I added when I
    defined srid
    > detection capability from auxiliary files. It is a simple list of
    > projection, a series of lines with only srid number and a proj.
    description
    > ( ex <32632>;<WGS 84 UTM zone 32>), build using proj4 registries
    and excel.
    > I could expand each line with unit ( ex <32632>;<WGS 84 UTM zone
    32>;<metre>)
    > 2) expand Task class with srid code and unit. User can define
    manually .
    > 3) modify measure /zoom plugins according units, meter, foot,
    degree ( in
    > this last case I would limit only to wgs84 ) using classes fro
    my measure
    > plugin.
    >
    > Peppe
    >
    >
    >
    >
    >
    > *
    >
    >
    >
    > Inviato con AquaMail per Android
    > http://www.aqua-mail.com
    >
    >
    > Il 03 agosto 2016 12:32:48 edgar.sol...@web.de
    <mailto:edgar.sol...@web.de> ha scritto:
    >
    >> hey Peppe,
    >>
    >> On 03.08.2016 11:11, Giuseppe Aruta wrote:
    >>> Hi all,
    >>> The title explains what is my idea. In a possible future we
    can extend OJ
    >>> projection capabilities.  And the 1st step I would explore is
    to add SRID
    >>> code to a task (to centralize possible transformations)
    >> can you elaborate?
    >>
    >>> and unit of measurements (retriving from SRID, which will
    affect other
    >>> plugins/tools like measure tools, measure area/length, display
    scales etc,
    >>> especially for Geographic coordinate systems).
    >> same here.
    >>
    >>> I gave a look at Task class , should I implement (srid and
    unit) as
    >>> properties into the associate xml file? Does it breaks
    compatibility?
    >> ..ede
    >>
    >>
    
------------------------------------------------------------------------------
    >> _______________________________________________
    >> Jump-pilot-devel mailing list
    >> Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    >> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
    >
    >
    >
    
------------------------------------------------------------------------------
    > _______________________________________________
    > Jump-pilot-devel mailing list
    > Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
    >


    
------------------------------------------------------------------------------
    _______________________________________________
    Jump-pilot-devel mailing list
    Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel






    ------------------------------

    
------------------------------------------------------------------------------


    ------------------------------

    _______________________________________________
    Jump-pilot-devel mailing list
    Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel


    End of Jump-pilot-devel Digest, Vol 123, Issue 41
    *************************************************

    Lähettäjä poisti kuvan.

    
------------------------------------------------------------------------------

    _______________________________________________
    Jump-pilot-devel mailing list
    Jump-pilot-devel@lists.sourceforge.net
    <mailto:Jump-pilot-devel@lists.sourceforge.net>
    https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel



------------------------------------------------------------------------------


_______________________________________________
Jump-pilot-devel mailing list
Jump-pilot-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

------------------------------------------------------------------------------
_______________________________________________
Jump-pilot-devel mailing list
Jump-pilot-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel

Reply via email to