[Arches] Re: Best way to load an ESRI Shapefile as a TileStash vector overlay

[Brett Ferguson]

Thanks Adam & Rob for the info -

I was hoping to just link the shapefile file itself, but it sounds like it 
is much better to load it into postgis database so I'll do that first, and 
give it a go. Understood that it's a large file so I'll do an extract first 
to get the process right and then go from there.

On Monday, July 1, 2019 at 11:08:46 AM UTC-7, Adam Cox wrote:
>
> Ok, I just reread your original post, and 1gb is a pretty large shapefile! 
> I strongly recocommend working through the entire workflow with a cut out 
> of maybe 50 features from that shapefile. It's very time-consuming to make 
> mistakes when processing such large files.
>
> On Monday, July 1, 2019 at 1:02:43 PM UTC-5, Adam Cox wrote:
>>
>> Hi Brett, if your ultimate goal is a "selectable layer" as we have 
>> documented here: 
>> https://arches.readthedocs.io/en/stable/creating-new-map-layers/#making-selectable-vector-layers,
>>  
>> I see that one of the recommended sources for that selectable layer is 
>> "...a tile server layer serving vector features from PostGIS". To do this, 
>> you would basically prepare your shapefile as described in those docs (add 
>> the geojson field, etc.) and then load it into postgres/postgis as it's own 
>> new table.
>>
>> There are a couple of ways to load a shapefile into postgres/postgis, so 
>> it will depend on what you are most comfortable with. For example, you can 
>> use QGIS to connection to your postgres database, and then load the 
>> shapefile in from there (QGIS makes this quite straightforward, I believe 
>> you need to use the DB manager panel). Alternatively, you could use the 
>> command line tool shp2pgsql which comes with postgis (you should already 
>> have it).
>>
>> Once you have loaded the shapefile into postgres/postgis, you can just 
>> follow along the "rivers" example in the arches4 geo examples repo to make 
>> a layer from your table.
>>
>> You'll be stringing together a few complex operations, so I'd recommend 
>> taking good notes along the way, and be ready to start back at the 
>> beginning if you get to a point where you realize something went wrong a 
>> few steps back.
>>
>> Looking forward to hearing how it goes!
>>
>> Adam
>>
>> On Wednesday, June 19, 2019 at 10:49:47 AM UTC-5, Brett Ferguson wrote:
>>>
>>> I'm struggling to make an ESRI Shapefile available as vector layer 
>>> (eventually selectable). I was hoping to make it available from the .shp 
>>> file itself on the server, but at this point I'd be happy to get it in any 
>>> way possible as a TileStash overlay. It is a fairly large file (1GB). I 
>>> feel like I've fallen into a documentation hole between Arches and 
>>> TileStash to get the configuration right.
>>>
>>> I've seen the arches4-geo-examples but the only tileserver shapefile 
>>> example I can see uses mapnik which we haven't installed (if that is the 
>>> recommended way we can). Does anyone have an example of this, or have a 
>>> suggestion w/ examples of a better way to do it (via geojson, etc)?
>>>
>>> Thanks!
>>>
>>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/d21e789c-bcdf-4262-9260-39679d2525e0%40googlegroups.com.

[Arches] Re: Best way to load an ESRI Shapefile as a TileStash vector overlay

[Adam Cox]

Ok, I just reread your original post, and 1gb is a pretty large shapefile! 
I strongly recocommend working through the entire workflow with a cut out 
of maybe 50 features from that shapefile. It's very time-consuming to make 
mistakes when processing such large files.

On Monday, July 1, 2019 at 1:02:43 PM UTC-5, Adam Cox wrote:
>
> Hi Brett, if your ultimate goal is a "selectable layer" as we have 
> documented here: 
> https://arches.readthedocs.io/en/stable/creating-new-map-layers/#making-selectable-vector-layers,
>  
> I see that one of the recommended sources for that selectable layer is 
> "...a tile server layer serving vector features from PostGIS". To do this, 
> you would basically prepare your shapefile as described in those docs (add 
> the geojson field, etc.) and then load it into postgres/postgis as it's own 
> new table.
>
> There are a couple of ways to load a shapefile into postgres/postgis, so 
> it will depend on what you are most comfortable with. For example, you can 
> use QGIS to connection to your postgres database, and then load the 
> shapefile in from there (QGIS makes this quite straightforward, I believe 
> you need to use the DB manager panel). Alternatively, you could use the 
> command line tool shp2pgsql which comes with postgis (you should already 
> have it).
>
> Once you have loaded the shapefile into postgres/postgis, you can just 
> follow along the "rivers" example in the arches4 geo examples repo to make 
> a layer from your table.
>
> You'll be stringing together a few complex operations, so I'd recommend 
> taking good notes along the way, and be ready to start back at the 
> beginning if you get to a point where you realize something went wrong a 
> few steps back.
>
> Looking forward to hearing how it goes!
>
> Adam
>
> On Wednesday, June 19, 2019 at 10:49:47 AM UTC-5, Brett Ferguson wrote:
>>
>> I'm struggling to make an ESRI Shapefile available as vector layer 
>> (eventually selectable). I was hoping to make it available from the .shp 
>> file itself on the server, but at this point I'd be happy to get it in any 
>> way possible as a TileStash overlay. It is a fairly large file (1GB). I 
>> feel like I've fallen into a documentation hole between Arches and 
>> TileStash to get the configuration right.
>>
>> I've seen the arches4-geo-examples but the only tileserver shapefile 
>> example I can see uses mapnik which we haven't installed (if that is the 
>> recommended way we can). Does anyone have an example of this, or have a 
>> suggestion w/ examples of a better way to do it (via geojson, etc)?
>>
>> Thanks!
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/4bc5d7d5-4694-4d96-bf42-5674ce143dc0%40googlegroups.com.

Re: [Arches] Re: Best way to load an ESRI Shapefile as a TileStash vector overlay

[Rob Gaston]

Hi Brett,

You can use shp2pgsql 
(https://postgis.net/docs/using_postgis_dbmanagement.html#shp2pgsql_usage 
) to 
load your shapefile into PostGIS.  From there you can follow this example: 
https://github.com/legiongis/arches4-geo-examples/tree/master/tileserver/postgis
 


With data of that size, you’ll probably need to be thoughtful about how you 
craft your TileStache config (http://tilestache.org/doc/ 
) taking into consideration zoom levels and caching 
to optimize performance.

You’ll also need to style your data according to the Mapbox Style Spec 
(https://docs.mapbox.com/mapbox-gl-js/style-spec/ 
).  You may find Maputnik 
(https://maputnik.github.io/ ) useful as a GUI for 
building to this spec.

I hope that helps!
- Rob


> On Jun 29, 2019, at 11:33 AM, Brett Ferguson  wrote:
> 
> Hi Alina -
> 
> Thanks for following up with this. I haven't found a solution yet, so if you 
> have any members that might be able to help I'd really appreciate it.
> 
> Cheers,
> 
> Brett
> 
> On Thursday, June 27, 2019 at 2:26:40 PM UTC-7, Alina Myklebust wrote:
> Hi Brett,
> 
> I noticed you haven't received feedback on your shapefile question.  If you 
> haven't found a solution yet, I will see if another community member can help 
> answer your question. 
> 
> Cheers,
> 
> Alina
> 
> 
> On Wednesday, June 19, 2019 at 8:49:47 AM UTC-7, Brett Ferguson wrote:
> I'm struggling to make an ESRI Shapefile available as vector layer 
> (eventually selectable). I was hoping to make it available from the .shp file 
> itself on the server, but at this point I'd be happy to get it in any way 
> possible as a TileStash overlay. It is a fairly large file (1GB). I feel like 
> I've fallen into a documentation hole between Arches and TileStash to get the 
> configuration right.
> 
> I've seen the arches4-geo-examples but the only tileserver shapefile example 
> I can see uses mapnik which we haven't installed (if that is the recommended 
> way we can). Does anyone have an example of this, or have a suggestion w/ 
> examples of a better way to do it (via geojson, etc)?
> 
> Thanks!
> 
> -- 
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe, 
> send email to archesproject+unsubscr...@googlegroups.com. For more 
> information, visit https://groups.google.com/d/forum/archesproject?hl=en 
> 
> --- 
> You received this message because you are subscribed to the Google Groups 
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to archesproject+unsubscr...@googlegroups.com 
> .
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/archesproject/1309efd7-12f5-4614-8f4f-64ca7daa7c39%40googlegroups.com
>  
> .

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/8D2B543A-4D14-4947-B5F2-671AA6751E09%40fargeo.com.

[Arches] Re: Best way to load an ESRI Shapefile as a TileStash vector overlay

[Adam Cox]

Hi Brett, if your ultimate goal is a "selectable layer" as we have 
documented here: 
https://arches.readthedocs.io/en/stable/creating-new-map-layers/#making-selectable-vector-layers,
 
I see that one of the recommended sources for that selectable layer is 
"...a tile server layer serving vector features from PostGIS". To do this, 
you would basically prepare your shapefile as described in those docs (add 
the geojson field, etc.) and then load it into postgres/postgis as it's own 
new table.

There are a couple of ways to load a shapefile into postgres/postgis, so it 
will depend on what you are most comfortable with. For example, you can use 
QGIS to connection to your postgres database, and then load the shapefile 
in from there (QGIS makes this quite straightforward, I believe you need to 
use the DB manager panel). Alternatively, you could use the command line 
tool shp2pgsql which comes with postgis (you should already have it).

Once you have loaded the shapefile into postgres/postgis, you can just 
follow along the "rivers" example in the arches4 geo examples repo to make 
a layer from your table.

You'll be stringing together a few complex operations, so I'd recommend 
taking good notes along the way, and be ready to start back at the 
beginning if you get to a point where you realize something went wrong a 
few steps back.

Looking forward to hearing how it goes!

Adam

On Wednesday, June 19, 2019 at 10:49:47 AM UTC-5, Brett Ferguson wrote:
>
> I'm struggling to make an ESRI Shapefile available as vector layer 
> (eventually selectable). I was hoping to make it available from the .shp 
> file itself on the server, but at this point I'd be happy to get it in any 
> way possible as a TileStash overlay. It is a fairly large file (1GB). I 
> feel like I've fallen into a documentation hole between Arches and 
> TileStash to get the configuration right.
>
> I've seen the arches4-geo-examples but the only tileserver shapefile 
> example I can see uses mapnik which we haven't installed (if that is the 
> recommended way we can). Does anyone have an example of this, or have a 
> suggestion w/ examples of a better way to do it (via geojson, etc)?
>
> Thanks!
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/cfbd2a18-6f2e-4c06-bd53-91fe045f920a%40googlegroups.com.

[Arches] Re: Best way to load an ESRI Shapefile as a TileStash vector overlay

[Brett Ferguson]

Hi Alina -

Thanks for following up with this. I haven't found a solution yet, so if 
you have any members that might be able to help I'd really appreciate it.

Cheers,

Brett

On Thursday, June 27, 2019 at 2:26:40 PM UTC-7, Alina Myklebust wrote:
>
> Hi Brett,
>
> I noticed you haven't received feedback on your shapefile question.  If 
> you haven't found a solution yet, I will see if another community member 
> can help answer your question. 
>
> Cheers,
>
> Alina
>
>
> On Wednesday, June 19, 2019 at 8:49:47 AM UTC-7, Brett Ferguson wrote:
>>
>> I'm struggling to make an ESRI Shapefile available as vector layer 
>> (eventually selectable). I was hoping to make it available from the .shp 
>> file itself on the server, but at this point I'd be happy to get it in any 
>> way possible as a TileStash overlay. It is a fairly large file (1GB). I 
>> feel like I've fallen into a documentation hole between Arches and 
>> TileStash to get the configuration right.
>>
>> I've seen the arches4-geo-examples but the only tileserver shapefile 
>> example I can see uses mapnik which we haven't installed (if that is the 
>> recommended way we can). Does anyone have an example of this, or have a 
>> suggestion w/ examples of a better way to do it (via geojson, etc)?
>>
>> Thanks!
>>
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/1309efd7-12f5-4614-8f4f-64ca7daa7c39%40googlegroups.com.

[Arches] Re: Best way to load an ESRI Shapefile as a TileStash vector overlay

[Alina Myklebust]

Hi Brett,

I noticed you haven't received feedback on your shapefile question.  If you 
haven't found a solution yet, I will see if another community member can 
help answer your question. 

Cheers,

Alina


On Wednesday, June 19, 2019 at 8:49:47 AM UTC-7, Brett Ferguson wrote:
>
> I'm struggling to make an ESRI Shapefile available as vector layer 
> (eventually selectable). I was hoping to make it available from the .shp 
> file itself on the server, but at this point I'd be happy to get it in any 
> way possible as a TileStash overlay. It is a fairly large file (1GB). I 
> feel like I've fallen into a documentation hole between Arches and 
> TileStash to get the configuration right.
>
> I've seen the arches4-geo-examples but the only tileserver shapefile 
> example I can see uses mapnik which we haven't installed (if that is the 
> recommended way we can). Does anyone have an example of this, or have a 
> suggestion w/ examples of a better way to do it (via geojson, etc)?
>
> Thanks!
>

-- 
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send 
email to archesproject+unsubscr...@googlegroups.com. For more information, 
visit https://groups.google.com/d/forum/archesproject?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/archesproject/ee00fbc2-a7d8-46d2-946c-886021bdaa53%40googlegroups.com.