Sean Petrie created NIFI-13292:
----------------------------------
Summary: PutBigQuery error on loading CSV file with date fields
Key: NIFI-13292
URL: https://issues.apache.org/jira/browse/NIFI-13292
Project: Apache NiFi
Issue Type: Bug
Affects Versions: 2.0.0-M3
Reporter: Sean Petrie
When loading BQ tables with CSV files that contains Date fields, I'm getting
the following error;
{code:java}
[APP] 2024-05-24 14:54:52,826 ERROR [Timer-Driven Process Thread-3]
org.apache.nifi.processors.gcp.bigquery.PutBigQuery
PutBigQuery[id=a2093387-018f-1000-ffff-ffffbc7e5d2d] Stream processing failed
java.lang.IllegalArgumentException: Wrong object type used with protocol
message reflection. Field number: 3, field java type: INT, value type:
java.lang.String at
com.google.protobuf.FieldSet$Builder.verifyType(FieldSet.java:1255) at
com.google.protobuf.FieldSet$Builder.setField(FieldSet.java:1122) at
com.google.protobuf.DynamicMessage$Builder.setField(DynamicMessage.java:546) at
org.apache.nifi.processors.gcp.bigquery.proto.ProtoUtils.setField(ProtoUtils.java:111)
at
org.apache.nifi.processors.gcp.bigquery.proto.ProtoUtils.createMessage(ProtoUtils.java:98)
at
org.apache.nifi.processors.gcp.bigquery.PutBigQuery.recordToProtoMessage(PutBigQuery.java:285)
at
org.apache.nifi.processors.gcp.bigquery.PutBigQuery.writeRecordsToStream(PutBigQuery.java:259)
at
org.apache.nifi.processors.gcp.bigquery.PutBigQuery.onTrigger(PutBigQuery.java:243)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1274)
at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:244)
at
org.apache.nifi.controller.scheduling.AbstractTimeBasedSchedulingAgent.lambda$doScheduleOnce$0(AbstractTimeBasedSchedulingAgent.java:59)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) at
java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)
{code}
Field 3 for this file is actually a date field with "MM/dd/yyyy" format which
is also set the same in CSVReader. The BigQuery table also has that feild set
as DATE.
Thanks.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
