Re: How to add headers to CSV file

2017-08-02 Thread mayank rathi
e. > > Thanks > -Mark > > > > On Aug 2, 2017, at 3:36 AM, mayank rathi <mayank.ra...@gmail.com> wrote: > > > > Hello All, > > > > I am working on a NiFi flow to read data from a database and dump it > into a > > CSV file. > >

NiFi 1.4: PublishKafkaRecord_0_10: failed to process due to java.lang.NullPointerException

2017-08-11 Thread mayank rathi
Hello All, I am moving data to Kafka using NiFi's PublishKafkaRecord processor. I am using ConfluentSchemaRegistry Controller service and getting below error: 2017-08-11 20:54:25,937 ERROR [Timer-Driven Process Thread-4] o.a.n.p.k.pubsub.PublishKafkaRecord_0_10

Re: NiFi 1.4: PublishKafkaRecord_0_10: failed to process due to java.lang.NullPointerException

2017-08-11 Thread mayank rathi
Hello Joe, JIRA logged. https://issues.apache.org/jira/browse/NIFI-4290 Thanks!! On Fri, Aug 11, 2017 at 9:48 PM, Joe Witt <joe.w...@gmail.com> wrote: > Hello > > Can you please file a jira and attach the logs to the jira. > > Thanks > Joe > > On Aug 1

Re: NiFi 1.4: PublishKafkaRecord_0_10: failed to process due to java.lang.NullPointerException

2017-08-11 Thread mayank rathi
Attached are the logs after setting processors in Debug mode. Here is the flow: ExecuteSQL --> SplitAvro --> PublishKafkaRecord_0_10 Thanks!! On Fri, Aug 11, 2017 at 9:01 PM, mayank rathi <mayank.ra...@gmail.com> wrote: > Hello All, > > I am moving data to Kafka using NiFi

[NiFi-4290] Re: NiFi 1.4: PublishKafkaRecord_0_10: failed to process due to java.lang.NullPointerException

2017-08-14 Thread mayank rathi
d for > that publisher. > 2) You do not need to SplitAvro before sending it via publish kafka > record. Avoiding doing the split beforehand can result in vastly > superior performance. > > Thanks > Joe > > On Fri, Aug 11, 2017 at 8:03 PM, mayank rathi <mayank.ra.

NiFi 1.4.0-SNAPSHOT build failing

2017-08-04 Thread mayank rathi
Hello All, I am trying to build NiFi 1.4.0-SNAPSHOT from Git and I am getting below error. Does anyone know how to resolve this error? Thanks in advance !! [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18:test (default-test) on project nifi-grpc-processors:

Re: NiFi 1.4.0-SNAPSHOT build failing

2017-08-05 Thread mayank rathi
i up and running > immediately, you can also run maven with `-DskipTests` to avoid this right > now. > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com <alopresto.apa...@gmail.com>* > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

NiFi 1.4 release date?

2017-08-05 Thread mayank rathi
Hello All, What's the tentative release date for NiFi 1.4? Thanks!! -- NOTICE: This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the

Re: NiFi 1.4 release date?

2017-08-06 Thread mayank rathi
re you are looking for? > > Thanks > > On Sat, Aug 5, 2017 at 6:52 PM mayank rathi <mayank.ra...@gmail.com> > wrote: > > > Hello All, > > > > What's the tentative release date for NiFi 1.4? > > > > Thanks!! > > > > -- > > NOTICE:

Re: [EXT] Re: [DISCUSS} Closing in on a NiFi 1.4.0 release?

2017-09-20 Thread mayank rathi
Hello All, How can we find out list of fixes that will go in 1.4.0 release? Thanks!! On Wed, Sep 20, 2017 at 9:53 AM, Brandon DeVries wrote: > All, > > I think we should plan on calling for a vote on Friday. That gives two > days to wrap up any outstanding tickets that anyone

PutSQL: java.sql.BatchUpdateException: invalid batch command

2017-10-12 Thread mayank rathi
Hello All, Can someone please help in understanding what I am doing wrong here? I am passing following values to PutSQL processor sql.args.1.type 2005 sql.args.1.value V99|1.0| E99|BILLING|1234567|11049532|350|201706|201709| R03|350|11049532|4| |KK|174|A|07/27/1948| |322| |0|F| |

Re: PutSQL error: java.lang.String cannot be cast to oracle.sql.CLOB

2017-09-05 Thread mayank rathi
Hello All, Logged https://issues.apache.org/jira/browse/NIFI-4352 for this issue. Thanks!! On Mon, Sep 4, 2017 at 10:23 AM, mayank rathi <mayank.ra...@gmail.com> wrote: > > Hello All, > > I am passing sql.args.1.type = 2005 and sql.args.1.value as a CLOB value > to PutS

Output Port: Port X is invalid because Output Connection for port X is not defined

2017-09-04 Thread mayank rathi
Hello All, I dragged an Output Port in canvas inside a Process Group and I am getting error that - Port X is invalid because Output Connection for port X is not defined. What configuration am I missing? Thanks!!

CLOB in sql.args.N.value

2017-09-04 Thread mayank rathi
Hello All, Can I pass a CLOB as sql.args.N.value? Are their any size limitations for attributes? Thanks!!

PutSQL error: java.lang.String cannot be cast to oracle.sql.CLOB

2017-09-04 Thread mayank rathi
Hello All, I am passing sql.args.1.type = 2005 and sql.args.1.value as a CLOB value to PutSQL and it is throwing below error. How do I resolve this error? 2017-09-04 10:17:24,924 INFO [StandardProcessScheduler Thread-5] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled

Re: Reg. Nifi Clustering Load Balancing

2017-08-29 Thread mayank rathi
Does this help? [image: Inline image 1] On Tue, Aug 29, 2017 at 11:07 AM, Nishant Gupta wrote: > Hello Sir/Madam, > > I need to know how we can implement load balancing and single point access > to all data producer > > I have suppose 100 machines that produce

NiFi 1.3 - PublishKafka_0_10 - A message in the stream exceeds the maximum allowed message size of 1048576 bytes

2017-11-17 Thread mayank rathi
Hello All, I am getting this error in PublishKafka_0_10 processor for a message of size 2.08 MB. I have updated Max Request Size to 10 MB in processor properties and max.request.size to 10 MB in Kafka's server.properties. After reboot Kafka Broker I can see that max.request.size = 10 MB in Kafka

Re: NiFi 1.3 - PublishKafka_0_10 - A message in the stream exceeds the maximum allowed message size of 1048576 bytes

2017-11-20 Thread mayank rathi
emarcator.maxDataSize is set to the specified PublishKafka_0_10 > 'Max Request Size'. > > Does this issue still happen? If so, do you mind sharing your > processor configuration by exporting as a template? > > Thanks, > Koji > > > On Sat, Nov 18, 2017 at 1:54 AM, mayank