PutSQL Processor

2017-10-17 Thread shankhamajumdar
Hi, I am trying to insert some data in oracle table using PutSQL Processor. But getting the below error. 2017-10-17 14:53:58,409 ERROR [Timer-Driven Process Thread-1] o.apache.nifi.processors.standard.PutSQL PutSQL[id=24b8613d-015f-1000-2f70-88d0c843300b]

Re: FuzzyHashContent/CompareFuzzyHash processor

2017-10-10 Thread shankhamajumdar
Hi Andy, I am having multiple lines in the file. For example Col1 Col2 Col3 Col4 Col5 Test1Test2 Test3 Test4 Test5 Data1 Data2Data3Data4Data5 ..

Re: FuzzyHashContent/CompareFuzzyHash processor

2017-10-09 Thread shankhamajumdar
Hi Andy, Thanks for the reply. But I am still not able to solve my use case. For example I have a data file in the below structure. Col1 Col2 Col3 Col4 Col5 Test1Test2 Test3 Test4 Test5 I want to do a fuzzy matching on Col2 and Col3 and generate an output

FuzzyHashContent/CompareFuzzyHash processor

2017-10-06 Thread shankhamajumdar
Hi, I want to implement fuzzy logic on some fields in a data file using NiFi. I am trying to use FuzzyHashContent/CompareFuzzyHash processor but not sure how to implement the flow. Can you please provide me an example? Regards, Shankha -- Sent from:

Re: File Filter regular expression - GetFile

2017-06-30 Thread shankhamajumdar
Hi, I have one more requirement. I have 5 files in a directory. 1. Test1.txt 2. Test12.txt 3. Test123.txt 4. Test1234.txt 5. Test12345.txt I want to get all the files by using Test in the File Filter Regex section of ListFile processor. I don't want give full file name. Please let me know how

Re: File Filter regular expression - GetFile

2017-06-28 Thread shankhamajumdar
Thanks James, It's working fine. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/File-Filter-regular-expression-GetFile-tp16279p16291.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

File Filter regular expression - GetFile

2017-06-28 Thread shankhamajumdar
Hi, I want to get the list of files from a directory where file name starts with a. I am using File Filter regular expression where default value is [^\.].*. But using this value I am getting all the files. Please let me know what I need to use in the File Filter regular expression section so

PutElasticsearch Processor

2017-03-13 Thread shankhamajumdar
Hi, I am able to load single json to Elasticsearch using NiFi PutElasticsearch Processor but while trying to load json array I am getting error. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/PutElasticsearch-Processor-tp15111.html

NiFi processor for Google Drive

2017-03-03 Thread shankhamajumdar
Hi, I want to access the files from google drive using NiFi processor. I would like to use in build processor rather writing a Custom Processor. Is the any in build processor available for google drive? Regards, Shankha -- View this message in context:

Re: NiFi PutElasticsearch Processor

2017-02-20 Thread shankhamajumdar
Hi Mark, I have resolved json attribute issue by increasing the value of Maximum Capture Group Length in AttributesToJSON processor. I have one more question - For PutElasticsearch processor I am using elasticsearch2.2.0 version. Is it possible to use elasticsearch5 version for PutElasticsearch

Re: NiFi PutElasticsearch Processor

2017-02-20 Thread shankhamajumdar
Thanks Mark, your solution has worked! I am facing one more issue. I am trying to put the entire content in a single json attribute using AttributesToJSON processor. It's working fine but that particular attribute is not able to capture the entire content, it's able to capture around first 7 lines

Re: NiFi PutElasticsearch Processor

2017-02-17 Thread shankhamajumdar
Hi, I have added ExtractText processor and there added a new property called myAttribute with value (.+). Then added AttributesToJSON processor with Attributes List as myAttribute. As result I am getting the below json structure. {"myAttribute":"test elasticsearch"} But it's not working for

NiFi PutElasticsearch Processor

2017-02-14 Thread shankhamajumdar
Hi, I am working on a use case where I need to load a PDF document to ElasticSearch. I have written a Custom NiFi processor using apache Tika which is basically extracting the content of the PDF. The NiFi flow is mentioned below. 1. NiFi GetFile processor is getting the PDF file from the source

Re: NiFi Spark Processor

2016-11-18 Thread shankhamajumdar
Hi joey, I am trying the POC in different way now. 1. GetFile processor which is getting the files from the local drive. 2. Connecting the processor to the NiFi Output Port. 3. Written a Spark streaming Job which is connecting to the NiFi Output Port to stream the data. The Spark Job is able

NiFi Spark Processor

2016-11-16 Thread shankhamajumdar
Hi, I am trying to use custom Spark Nifi processor. I have downloaded the processor from https://github.com/qiansl127/nifi-spark-bundle and then executed the maven build. After the maven build I have copied nifi-spark-nar-0.3.0.nar inside NiFi lib folder and restarted the NiFi server which is not

Re: Issue on creating Custom Processor - Salesforce

2016-10-14 Thread shankhamajumdar
Hi Jeremy, There is one more issue. Actually I did the build inside D:\nifi-addons-master\Services\nifi-salesforce-service\nifi-salesforce-api-nar directory successfully. But ideally I should build inside D:\nifi-addons-master\Services directory which is failing. [ERROR] [ERROR] Some problems

Re: Issue on creating Custom Processor - Salesforce

2016-10-14 Thread shankhamajumdar
Thanks Jeremy, now the build is successful. Regards, Shankha -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Issue-on-creating-Custom-Processor-Salesforce-tp13603p13605.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Issue on creating Custom Processor - Salesforce

2016-10-14 Thread shankhamajumdar
Hi, I am trying to create the Custom Salesforce Processor for Nifi but getting the below error while doing the maven build. [ERROR] Failed to execute goal on project nifi-salesforce-processors: Could not resolve dependencies for project com.jeremydyer.nifi:nifi-salesforce-processors: jar:1.0.0: