Hey Andrea, thanks for the info.
My case is running a geogit import that can use several fetch threads if
the feature source supports paging. No filtering at all, just dividing up
the work for each thread to import a different subset of the dataset. We're
on gt-9.0 yet though, but I guess once we move to 10.0 I'll be able to test
whether the paging support provided by content datastore brings any perf
improvement or not.
Cheers,
Gabriel
On Fri, Nov 22, 2013 at 1:50 PM, Andrea Aime
<[email protected]>wrote:
> On Fri, Nov 22, 2013 at 5:42 PM, Gabriel Roldan
> <[email protected]>wrote:
>
>> Hey there,
>>
>> It looks to me like the shapefile datastore does not support paging
>> through query's startIndex and maxFeatures. It does support maxFeatures
>> though.
>> So before getting more into it, I just wanted to confirm it doesn't
>> support startIndex and ask whether there's a compelling reason for it. I
>> may try to come up with a patch otherwise.
>>
>
> In the following I assume you're talking about the shapefile code in 10.x
> onwards.
> ShapefileFeatureSource does not, in fact, override canOffset and canLimit,
> so you're right there is not _native_ support for paging,
> meaning the performance could be improved with some direct support.
>
> That said, ContentFeatureSource should properly handle paging by skipping
> features and limiting results, of course, at a cost.
>
> Thinking about the implementation... hum... not sure it's possible to do
> any optimization when filters are around.
> Most of the filters cannot be resolved directly before reading, one has to
> read features, then check if they match the
> filter, which pretty much means you have to read all features anyways to
> find those that match the filters.
> Even spatial filters cannot be actually run against the spatial index,
> which gives us a superset of the actual result.
>
> Cheers
> Andrea
>
> --
> ==
> Our support, Your Success! Visit http://opensdi.geo-solutions.it for more
> information.
> ==
>
> Ing. Andrea Aime
> @geowolf
> Technical Lead
>
> GeoSolutions S.A.S.
> Via Poggio alle Viti 1187
> 55054 Massarosa (LU)
> Italy
> phone: +39 0584 962313
> fax: +39 0584 1660272
> mob: +39 339 8844549
>
> http://www.geo-solutions.it
> http://twitter.com/geosolutions_it
>
> -------------------------------------------------------
>
--
Gabriel Roldán
Software Developer | Boundless
[email protected]
@gabrielroldan <https://twitter.com/gabrielroldan>
------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT
organizations don't have a clear picture of how application performance
affects their revenue. With AppDynamics, you get 100% visibility into your
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk
_______________________________________________
GeoTools-Devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/geotools-devel
