[
https://issues.apache.org/jira/browse/NIFI-11269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
john-alan updated NIFI-11269:
-----------------------------
Description:
I'm using nifi to split a very big avro file (~500MB), but the processor is
throwing this error:
{code:java}
SplitAvro[id=d5f27b12-0186-1000-89b6-3171f53ce832] Processing halted: yielding
[1 sec]: org.apache.avro.AvroRuntimeException: Unrecognized codec: snappy{code}
I'm using NiFi 1.20.0
The thing is that in 1.13.2 it worked fine. After upgrading to 1.20.0 the
problem accrued.
After searching for a bit I've found this solution:
Add to nifi/nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/pom.xml this
dependency:
{code:java}
<dependency>
<groupId>org.xerial.snappy</groupId>
<artifactId>snappy-java</artifactId>
<version>1.1.8.4</version>
</dependency>{code}
After build and run this actually works! Would be very nice to add this to the
next patch.
This is a deal breaker because I want to upgrade to 1.20.0 from 1.13.2 and
can't because of this error.
was:
I'm using nifi to split a very big avro file (~500MB), but the processor is
throwing this error:
{code:java}
SplitAvro[id=d5f27b12-0186-1000-89b6-3171f53ce832] Processing halted: yielding
[1 sec]: org.apache.avro.AvroRuntimeException: Unrecognized codec: snappy{code}
I'm using NiFi 1.20.0
The thing is that in 1.13.2 it worked fine. After upgrading to 1.20.0 the
problem accrued.
After searching for a bit I've found this solution:
Add to nifi/nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/pom.xml this
dependency:
{code:java}
<dependency>
<groupId>org.xerial.snappy</groupId>
<artifactId>snappy-java</artifactId>
<version>1.1.8.4</version>
</dependency>{code}
After build and run this actually works! Would be very nice to add this to the
next patch.
This is a deal breaker because I want to upgrade to 1.20.0 from 1.13.2 and
can't because of this error.
PR: https://github.com/apache/nifi/pull/7034
> Adding snappy support for SplitAvro
> -----------------------------------
>
> Key: NIFI-11269
> URL: https://issues.apache.org/jira/browse/NIFI-11269
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.20.0
> Reporter: john-alan
> Priority: Major
> Original Estimate: 1h
> Time Spent: 20m
> Remaining Estimate: 40m
>
> I'm using nifi to split a very big avro file (~500MB), but the processor is
> throwing this error:
> {code:java}
> SplitAvro[id=d5f27b12-0186-1000-89b6-3171f53ce832] Processing halted:
> yielding [1 sec]: org.apache.avro.AvroRuntimeException: Unrecognized codec:
> snappy{code}
> I'm using NiFi 1.20.0
> The thing is that in 1.13.2 it worked fine. After upgrading to 1.20.0 the
> problem accrued.
>
> After searching for a bit I've found this solution:
> Add to nifi/nifi-nar-bundles/nifi-avro-bundle/nifi-avro-processors/pom.xml
> this dependency:
> {code:java}
> <dependency>
> <groupId>org.xerial.snappy</groupId>
> <artifactId>snappy-java</artifactId>
> <version>1.1.8.4</version>
> </dependency>{code}
> After build and run this actually works! Would be very nice to add this to
> the next patch.
>
> This is a deal breaker because I want to upgrade to 1.20.0 from 1.13.2 and
> can't because of this error.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
