I guess my point is that the average user doesn't want these capabilities.
We removed the profile to make build process easier, but the main reason we
had it to begin with was because they are optional extensions that can
complicate licensing and add a lot of unwanted dependencies.
The other option we have would be to swap geomesa with geowave [1].
Geowave has an apache 2 license [2] and so all the dependencies that brings
in should be ok. We've talked about adding GeoWave support a lot, so I
think that there is value outside of for licensing issues. I don't think
it would be trivial to bring in GeoWave for Geomesa, so that might put
cutting a release on hold for a while.
[1] https://github.com/ngageoint/geowave
[2] https://github.com/ngageoint/geowave/blob/master/LICENSE
On Thu, Sep 15, 2016 at 12:46 AM, Meier, Caleb <caleb.me...@parsons.com>
wrote:
While the indexer project extensions are optional in that they are turned
off by default to minimize data plume, I would argue that they are not
optional in the sense that Josh has described. There is no other way to
index/query for freetext, geospatial, and temporal data without these
extensions. So if a user wants these capabilities, they need the indexer
project and all of the incompatibly licensed dependencies that come along
with it.
________________________________________
From: Puja Valiyil [puja...@gmail.com]
Sent: Wednesday, September 14, 2016 9:49 PM
To: dev@rya.incubator.apache.org
Cc: Billie Rinaldi
Subject: Re: RYA-179 Review License / Copyright notices on Rya Artifacts
The indexer project has a set of configurable optional extension to Rya.
Things like support for geosparql, support for free text indexing, and
support for precomputed joins (which is where the fluo integration comes
in). These are extensions that by default are turned off. They can
really
increase the data plume associated with some data, which is the main
reason
why.
In the original port into Apache, this project was only included if you
specified that profile. This was because we have traditionally
considered
those features experimental and they bring in a lot of possibly unwanted
dependencies. Aaron refactored it to not be optional when he was
updating
the pond to reference the Apache parent Pom.
So no alternative, but functionality that a typical user may debatably
not
want.
Sent from my iPhone
On Sep 14, 2016, at 8:05 PM, Josh Elser <els...@apache.org> wrote:
I would have said that this is only kosher when you have an alternative
to the incompatibly licensed software. Is the indexer actually optional
(I
don't have enough context)? Are there ways for me to to indexing of the
same type of data that don't require use of these incompatible
dependencies?
Billie might be able to provide some more context too.
Aaron D. Mihalik wrote:
Could we revive the indexer profile again?
(tl;dr: Yes. Mentors: Please correct us if we're wrong)
This might be a solution. I found a couple similar cases with Apache
projects and discussions related to those cases.
Apache Flink integrated with Amazon Kinesis [1] and [2]. Note that
Kinesis
is an optional profile, and it's well documented in the POM why it's
optional.
(Note that NiFi got around this by using Amazon's SDK for Java [3],
which
is purely Apache 2.0)
Spark uses optional profiles to build artifacts based on LGPL
dependencies. Spark has to built by the user to use netlib [4][5],
Ganglia
[6], or Kinesis [6].
I think a profile will work, but I'd like to see it well documented
(both
in the POM and manual) so that we never accidentally create a release
with
these artifacts.
I was going to open a separate ticket to implement this, but I think
it's
good to track all of this effort under RYA-177.
--Aaron
[1]
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_flink_blob_release-2D1.1.2_flink-2Dstreaming-
2Dconnectors_pom.xml-23L69&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
wnYDdDdgR8EEFav9sKC7ftd6ZjSJcOXU8FISG6jJMHc&e=
[2]
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_flink_blob_release-2D1.1.2_flink-2Dstreaming-
2Dconnectors_flink-2Dconnector-2Dkinesis_pom.xml-23L73&d=CwIFAg&c=Nwf-
pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHC
geo_4WXTD0qo8&m=USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
ZFTL5gQzyzLvRcWrafGrCobMJ8d1DWSmZlIVz9M7EuQ&e=
[3] https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_nifi_blob_master_pom.xml-23L1316&d=CwIFAg&c=
Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
6pMGnZxiQccMUFNO18dbUc8luQrhNKa-XVCc1y_YlGg&e=
[4] https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_spark_blob_v2.0.0_mllib_pom.xml-23L120&d=CwIFAg&
c=Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=apxAyRJMc-
jDvRpVzA6wFnuOjlNtFUKev9nXgiv79DM&e=
[5]
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_spark_blob_v2.0.0_docs_ml-2Dguide.md-
23dependencies&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=yFa0G6qUiJpaZxKA--
8iuH8m3hxgmutd-0ZD0B32268&e=
[6] https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_spark_blob_v2.0.0_pom.xml-23L2414&d=CwIFAg&c=
Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
3xSSyDcql0fPyGpmzCoVV4W8Zgv2yHzm_HhKNhQahko&e=
[7] https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.
apache.org_jira_browse_LEGAL-2D198&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
lyjGafTKlvfprCiiaEuPxZZql8RfTAqKuPm3VuGB87w&e=
[8] https://urldefense.proofpoint.com/v2/url?u=https-3A__www.
gnu.org_licenses_lgpl-2Djava.html&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=GRs3Rw_AG6rsk_
mdzckqKUMoPYAt8c18d8gd5pBmiVI&e=
On Wed, Sep 14, 2016 at 12:09 PM David Lotts<dlo...@gmail.com>
wrote:
Great find Aaron!
The ESRI library is quite comparable!
Rya via Geomesa are using *JTS Topology Suite (*JTS): (the javadocs
at
vividsolutions seems to be 404 )
https://urldefense.proofpoint.com/v2/url?u=http-3A__
tsusiatsoftware.net_jts_javadoc_com_vividsolutions_
jts_geom_Geometry.html&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=nscsppMk-
bNMwHX82u4sd7VbUal5jIzdeuq34bmTwg0&e=
Far from a drop-in replacement, but a path forward:
https://urldefense.proofpoint.com/v2/url?u=http-3A__esri.
github.io_geometry-2Dapi-2Djava_javadoc_&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=2GWOgMrIQvSXFXooaOYQ_
y0DQOPcK3xdpCXq0Iev1r0&e=
Interesting, ESRI has Shape file support, but no GML, the opposite of
JTS!
david.
On Wed, Sep 14, 2016 at 10:29 AM, Aaron D. Mihalik<
aaron.miha...@gmail.com>
wrote:
Yeah, that sounds possible. I don't like the idea of having to
maintain
another build/ci/release process, though.
More importantly, we'd also have to modify our GeoIndexer interface
[1]
to
something Apache Friendly. It looks like Ersi puts out an Apache
2.0
library [2].
[1]
https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_apache_incubator-2Drya_blob_master_&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
2es83xf9omvbFNTaRU0pjHhcWJOjjVD4puEiCGAHTzo&e=
extras/indexing/src/main/java/mvm/rya/indexing/GeoIndexer.java
[2] https://urldefense.proofpoint.com/v2/url?u=https-3A__github.
com_Esri_geometry-2Dapi-2Djava&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
OxkKSfjgLWCFVHN9iHWYMWrc8zXsQFSQVeIg_IZln28&e=
On Tue, Sep 13, 2016 at 10:36 PM Jim Hughes<jn...@ccri.com>
wrote:
Hi Aaron,
Thanks, wasn't finding that list quickly...
It sounds like the GeoMesa/GeoTools usage might fall under this
Q/A:
https://urldefense.proofpoint.com/v2/url?u=http-3A__www.
apache.org_legal_resolved.html-23optional&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
oonzG34DfvESxMKhzH3zwTAP8382Y074uyDImZlXj3w&e= .
Thoughts?
Jim
On 9/13/2016 9:25 PM, Aaron D. Mihalik wrote:
Jim,
We've been working off of these lists:
https://urldefense.proofpoint.com/v2/url?u=http-3A__www.
apache.org_legal_resolved.html-23category-2Da&d=CwIFAg&
c=Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=GxpBa_
DXc5ciR7ABQlVXaoTyAHKRAcGQTdaeu9PRlMA&e=
On Tue, Sep 13, 2016 at 6:07 PM Jim Hughes<jn...@ccri.com>
wrote:
Hi David,
A number of the geo-dependencies are likely from the geo-indexing
(which
uses GeoMesa (Apache 2.0) which uses GeoTools and JTS).
Are there options to make the geoindexing a profile, provide the
source,
and not provide artifacts for that code at Apache?
Also, is there a list of approved licenses for Apache projects
dependencies?
Cheers,
Jim
On 09/13/2016 05:46 PM, David Lotts wrote:
This issue is a release blocker:
<https://urldefense.proofpoint.com/v2/url?u=https-
3A__issues.apache.org_jira_browse_RYA-2D179&d=CwIFAg&c=
Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
tv58xgiqgMT6McWRnFDk4mQv44be_F1AfRhHX4BITFU&e= >
RYA-179<https://urldefense.proofpoint.com/v2/url?u=https-
3A__issues.apache.org_jira_browse_RYA-2D179&d=CwIFAg&c=
Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
tv58xgiqgMT6McWRnFDk4mQv44be_F1AfRhHX4BITFU&e= > Review
License /
Copyright notices on Rya Artifacts
I was able to create a 3rd party dependency license report for
Rya
from the license
maven plugin.
<https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.mojohaus.org_license-2Dmaven-2Dplugin_&d=CwIFAg&c=
Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=uB2GXLB9U4r3d-
2p-1Knb2TtdALTX5Slxi2NDmVZnzU&e= >
Good: I can send the full list if you like. Mostly ASL and
clearly
permitted.
Okay: A number of CDDL and CPL licenses -- permitted if no
source
code
is
included.
Needs Improvement: The following are not clearly permitted
licenses:
(cern.colt MIT license see
https://urldefense.proofpoint.com/v2/url?u=https-3A__dst.
lbl.gov_ACSSoftware_colt_license.html&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=nkfTihZpFbwrq1xV6atJsaeFR_
wV8Cs8BIfOM2LlV3c&e= ) colt
(colt:colt:1.2.0 -
no url defined)
-- this is a mistake, should be java.util.Arrays,
not
cern.colt.Arrays -- creating an issue to eliminate dependency.
(GNU LESSER GENERAL PUBLIC LICENSE) JCalendar
(com.toedter:jcalendar:1.1.4 -
https://urldefense.proofpoint.com/v2/url?u=http-3A__www.
toedter.com_en_jcalendar_&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_
LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
xpan75i2SwtO0y9BvlBgDSIKOTgF5c1vBeBaydmmpzM&e= )
(Lesser General Public License (LGPL)) JTS Topology Suite
(com.vividsolutions:jts:1.13 -
https://urldefense.proofpoint.com/v2/url?u=http-3A__
sourceforge.net_projects_jts-2Dtopo-2Dsuite&d=CwIFAg&c=Nwf-
pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=vuVdzYC2kksVZR5STiFwDpzJ7CrMHC
geo_4WXTD0qo8&m=USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=EE4WpoOm4n_
6riGjpReA3wZM6Jzt8hJRSVjDtFzFanQ&e= )
(Lesser General Public License (LGPL)) Image
I/O-Extensions
-
GeoCore
(it.geosolutions.imageio-ext:imageio-ext-geocore:1.1.13 - no url
defined)
(Lesser General Public License (LGPL)) Image
I/O-Extensions
-
Custom
Streams (it.geosolutions.imageio-ext:imageio-ext-streams:1.1.13
-
no
url
defined)
(Lesser General Public License (LGPL)) Improved TIFF
Plugin
(it.geosolutions.imageio-ext:imageio-ext-tiff:1.1.13 - no url
defined)
(Lesser General Public License (LGPL)) Image
I/O-Extensions
-
utilities classes and methods
(it.geosolutions.imageio-ext:imageio-ext-utilities:1.1.13 - no
url
defined)
(Unknown license) jai_codec (javax.media:jai_codec:1.1.3
-
no
url
defined)
(Unknown license) jai_core (javax.media:jai_core:1.1.3 -
no
url
defined)
(Unknown license) jai_imageio
(javax.media:jai_imageio:1.1
-
no
url
defined)
(Unknown license) jgridshift (jgridshift:jgridshift:1.0 -
no
url
defined)
(GNU Lesser General Public License) Remote Tea Runtime
(org.acplt:oncrpc:1.0.7 - https://urldefense.proofpoint.
com/v2/url?u=http-3A__remotetea.sourceforge.net_&d=
CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
EOLDxztEUSjsTNW2QH8XItlqpuIlH5n7_10fdLy8AKY&e= )
(Unknown license) Antlr 3.4 Runtime
(org.antlr:antlr-runtime:3.4 -
https://urldefense.proofpoint.com/v2/url?u=http-3A__www.
antlr.org&d=CwIFAg&c=Nwf-pp4xtYRe0sCRVM8_LWH54joYF7EKmrYIdfxIq10&r=
vuVdzYC2kksVZR5STiFwDpzJ7CrMHCgeo_4WXTD0qo8&m=
USEC4e6JdxuZZwMB0AkZPzHtdsKWf8ep6g5BSRLQ2XY&s=
6JePto8zpoeyNZtl0UNZILGSRA7EgcTN0JCrhpT9jHc&e= )
(Unknown license) Jettison (org.codehaus.jettison:
jettison:1.1
- no
url defined)
(Lesser General Public License (LGPL)) API interfaces
(org.geotools:gt-api:14.3 - no url defined)
(Lesser General Public License (LGPL)) Grid Coverage
module
(org.geotools:gt-coverage:14.3 - no url defined)
(Lesser General Public License (LGPL)) OGC CQL to Filter
parser
(org.geotools:gt-cql:14.1 - no url defined)
(Lesser General Public License (LGPL)) DataStore Support
(org.geotools:gt-data:14.1 - no url defined)
(Lesser General Public License (LGPL)) Feature Based
Graphs
and
Networks (org.geotools:gt-graph:14.3 - no url defined)
(Lesser General Public License (LGPL)) Vector grids
(org.geotools:gt-grid:14.1 - no url defined)
(Lesser General Public License (LGPL)) Main module
(org.geotools:gt-main:14.1 - no url defined)
(Lesser General Public License (LGPL)) Metadata
(org.geotools:gt-metadata:14.1 - no url defined)
(Lesser General Public License (LGPL)) (OGC copyright)
Open
GIS
Interfaces (org.geotools:gt-opengis:14.1 - no url defined)
(Lesser General Public License (LGPL)) Process
(org.geotools:gt-process:14.1 - no url defined)
(Lesser General Public License (LGPL)) Process Feature
(org.geotools:gt-process-feature:14.1 - no url defined)
(Lesser General Public License (LGPL)) Referencing
services
(org.geotools:gt-referencing:14.3 - no url defined)
(Lesser General Public License (LGPL)) Render
(org.geotools:gt-render:14.1 - no url defined)
(Lesser General Public License (LGPL)) Shapefile module
(org.geotools:gt-shapefile:14.1 - no url defined)
(Lesser General Public License (LGPL)) Feature
transforming
feature
source wrapper (org.geotools:gt-transform:14.1 - no url defined)
(Lesser General Public License (LGPL)) XML Parsing
(org.geotools.xsd:gt-xsd-core:14.3 - no url defined)
(Lesser General Public License (LGPL)) GML2 XML Support
(org.geotools.xsd:gt-xsd-gml2:14.3 - no url defined)
(Lesser General Public License (LGPL)) GML3 XML Support
(org.geotools.xsd:gt-xsd-gml3:14.3 - no url defined)
david.
