Hi Joris,
Good question. GeoServer does not ship with any Hadoop code by
default. Several of the interfaces in GeoTools and GeoServer do
properly respect Java URL / URL FactoryHandlers, etc. When those things
line up, one can use GeoServer with different URLs for a number of
really, really cool deployment options! (That said, there are a few
places where assumptions are made, and sometimes one can hit small
issues to work through.)
That aside, given that GeoServer does not ship with anything Hadoop and
that its core functionality does not presently include any cloud vendors
libraries (there are extensions for S3 support), your question comes
down to what GeoMesa can do and where an end user can fill in the details.
GeoMesa uses the Hadoop FileSystem interface in a few ways. One of them
happens to be in the HBase library code which is checking that the HBase
is configured properly for GeoMesa use. Just like GeoServer, GeoMesa
does not make an attempt to bundle all the cloud vendors' libraries, so
you'll need to add them to your deployment. I'd suggest starting here
(https://hadoop.apache.org/docs/current/hadoop-azure/abfs.html) to find
the jar(s) you need!
Cheers,
Jim
On 10/23/2020 1:32 PM, Joris Billen wrote:
Dear community,
this question is related to the support of abfs by geoserver.
I am on geoserver 2.17.2.
I connected to a geomesa (3.0.0)-hbase (2.5.5) datastore that is
stored on Azure. Hbase stores its data on abfs (azure blob filesytem
-the new generation adls).
I have some data that I can read well in hbase, that I ingested
through the geomesa-hbase cli tools, and that I can add as a store in
geoserver. When I go to the layer preview in geoserver, the gml that
contains the geodata, is shown correctly.
However when I try to visualize (using openlayers), I get error message:
23 Oct 16:42:35 WARN [util.DynamicClassLoader] - Failed to identify
the fs of dir
abfs://[email protected]/ourhbase/hbase/lib, ignored
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for
scheme "abfs"
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3332)
...
org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException:
java.lang.ClassNotFoundException:
org.locationtech.geomesa.hbase.rpc.filter.CqlTransformFilter
I believe this missing class is part of the geomesa-hbase distrbuted
runtime jar, which was stored in the folder referenced above.
It looks like he can not access this jar since he does not recognize abfs.
So the question is: is abfs supported in geoserver?
Thanks for feedback!
_______________________________________________
Geoserver-users mailing list
Please make sure you read the following two resources before posting to this
list:
- Earning your support instead of buying it, but Ian Turton:
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines:
http://geoserver.org/comm/userlist-guidelines.html
If you want to request a feature or an improvement, also see this:
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
[email protected]
https://lists.sourceforge.net/lists/listinfo/geoserver-users
_______________________________________________
Geoserver-users mailing list
Please make sure you read the following two resources before posting to this
list:
- Earning your support instead of buying it, but Ian Turton:
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines:
http://geoserver.org/comm/userlist-guidelines.html
If you want to request a feature or an improvement, also see this:
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
[email protected]
https://lists.sourceforge.net/lists/listinfo/geoserver-users
