Byunghwa Yun created NIFI-2811:
----------------------------------
Summary: JdbcCommon doesn't convert bigint(20) column.
Key: NIFI-2811
URL: https://issues.apache.org/jira/browse/NIFI-2811
Project: Apache NiFi
Issue Type: Bug
Components: Extensions
Affects Versions: 1.0.0
Reporter: Byunghwa Yun
JdbcCommon doesn't convert SQL-to-Avro that has bigint(20) column with the
small value.
Even column type is BIGINT(20), MySQL JDBC driver can return number type value
when the return value is small.
Related Exception:
2016-09-23 10:50:22,191 ERROR [Timer-Driven Process Thread-8]
o.a.n.p.standard.QueryDatabaseTable
org.apache.nifi.processor.exception.ProcessException: Error during database
query or conversion of records to Avro.
at
org.apache.nifi.processors.standard.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:255)
~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.processors.standard.QueryDatabaseTable$$Lambda$132/464322944.process(Unknown
Source) ~[na:na]
at
org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2123)
~[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.processors.standard.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:249)
~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1064)
[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_51]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[na:1.8.0_51]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_51]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_51]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_51]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_51]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
Caused by: org.apache.avro.file.DataFileWriter$AppendWriteException:
org.apache.avro.UnresolvedUnionException: Not in union ["null","string"]: 936398
at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:296)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.nifi.processors.standard.util.JdbcCommon.convertToAvroStream(JdbcCommon.java:207)
~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at
org.apache.nifi.processors.standard.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:253)
~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
... 14 common frames omitted
Caused by: org.apache.avro.UnresolvedUnionException: Not in union
["null","string"]: 936398
at
org.apache.avro.generic.GenericData.resolveUnion(GenericData.java:604)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.avro.generic.GenericDatumWriter.resolveUnion(GenericDatumWriter.java:151)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:71)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:114)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:104)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
~[avro-1.7.7.jar:1.7.7]
at
org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:58)
~[avro-1.7.7.jar:1.7.7]
at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:290)
~[avro-1.7.7.jar:1.7.7]
... 16 common frames omitted
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
