[jira] [Updated] (NIFI-2787) PersistentProvenanceRepository rollover can fail on immense indexed attributes
[ https://issues.apache.org/jira/browse/NIFI-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Moser updated NIFI-2787: Resolution: Fixed Status: Resolved (was: Patch Available) > PersistentProvenanceRepository rollover can fail on immense indexed attributes > -- > > Key: NIFI-2787 > URL: https://issues.apache.org/jira/browse/NIFI-2787 > Project: Apache NiFi > Issue Type: Bug > Components: Core Framework >Affects Versions: 1.0.0, 0.7.0 >Reporter: Michael Moser >Assignee: Michael Moser > Fix For: 1.1.0, 0.7.1 > > > Accidentally created an immense attribute (36,000 bytes), which I indexed > with nifi.provenance.repository.indexed.attributes. Received this error. > ERROR [Provenance Repository Rollover Thread-1] > o.a.n.p.PersistentProvenanceRepository Failed to rollover Provenance > repository due to java.lang.IllegalArgumentException: Document contains at > least one immense term in field="FOO" (whose UTF8 encoding is longer than the > max length 32766), all of which were skipped. Please correct the analyzer to > not produce such terms. > Perhaps this is as simple as changing > https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/RepositoryConfiguration.java#L37 > to 32766 to match Lucene. Investigation & testing needed. > For background, this Lucene ticket made exceeding the term size limit an > IllegalArgumentException https://issues.apache.org/jira/browse/LUCENE-5472 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (NIFI-2787) PersistentProvenanceRepository rollover can fail on immense indexed attributes
[ https://issues.apache.org/jira/browse/NIFI-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Moser updated NIFI-2787: Fix Version/s: 0.7.1 1.1.0 Status: Patch Available (was: Open) > PersistentProvenanceRepository rollover can fail on immense indexed attributes > -- > > Key: NIFI-2787 > URL: https://issues.apache.org/jira/browse/NIFI-2787 > Project: Apache NiFi > Issue Type: Bug > Components: Core Framework >Affects Versions: 0.7.0, 1.0.0 >Reporter: Michael Moser > Fix For: 1.1.0, 0.7.1 > > > Accidentally created an immense attribute (36,000 bytes), which I indexed > with nifi.provenance.repository.indexed.attributes. Received this error. > ERROR [Provenance Repository Rollover Thread-1] > o.a.n.p.PersistentProvenanceRepository Failed to rollover Provenance > repository due to java.lang.IllegalArgumentException: Document contains at > least one immense term in field="FOO" (whose UTF8 encoding is longer than the > max length 32766), all of which were skipped. Please correct the analyzer to > not produce such terms. > Perhaps this is as simple as changing > https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/RepositoryConfiguration.java#L37 > to 32766 to match Lucene. Investigation & testing needed. > For background, this Lucene ticket made exceeding the term size limit an > IllegalArgumentException https://issues.apache.org/jira/browse/LUCENE-5472 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
