Re: Bug/Unexpected behavior in ConvertJSONToSQL for boolean attributes

2018-01-02 Thread Joe Witt
merged to master. Thanks for the report Jennifer and the super fast PR Koji. On Tue, Jan 2, 2018 at 7:23 PM, Koji Kawamura wrote: > Submitted a PR to fix the issue. > https://issues.apache.org/jira/browse/NIFI-4729 > https://github.com/apache/nifi/pull/2366 > > I

Re: Bug/Unexpected behavior in ConvertJSONToSQL for boolean attributes

2018-01-02 Thread Koji Kawamura
Submitted a PR to fix the issue. https://issues.apache.org/jira/browse/NIFI-4729 https://github.com/apache/nifi/pull/2366 I confirmed that JSON Boolean values can be converted (ConvertJSONToSQL, true -> 1, false -> 0), inserted (PutSQL) then retrieved back into JSON object correctly (ExecuteSQL

Re: Bug/Unexpected behavior in ConvertJSONToSQL for boolean attributes

2018-01-02 Thread Koji Kawamura
Hi Jennifer, Thank you very much for reporting this. It seems the line converts a Boolean to "0" or "1" at ConvertJSONToSQL is implemented wrongly. Looks like a careless mistake. Sorry for the inconvenience.

Bug/Unexpected behavior in ConvertJSONToSQL for boolean attributes

2018-01-02 Thread Jennifer Kissinger
Good morning, We've uncovered a bug between 1.3.0 and 1.4.0 in the way ConvertJSONToSQL handles booleans, which is flipping true to false and vice versa in our data. Our input to ConvertJSONToSQL is a JSON array that contains true/false values, like this: [ { "foo": true }, {

Re: use record reader to read text file and get line counts

2018-01-02 Thread tzhu
Hi Joe, I'm not sure how I should read the text file. I don't care about the content but just want to get the count (which is the attribute "text.line.count" from SplitText suggested by Mark above) associated with "RouteText.Route" under the same filename. If I use MergeContent, which reader can

Re: use record reader to read text file and get line counts

2018-01-02 Thread Joe Witt
Hello If you want to aggregate data by some filename/pattern use MergeContent and its correlation attribute feature. Once you've done the merging then use SplitText technique to get total line count. Thanks Joe On Tue, Jan 2, 2018 at 11:16 AM, tzhu wrote: > Hi Matt, >

Re: use record reader to read text file and get line counts

2018-01-02 Thread tzhu
Hi Matt, Thank you for your help. Now I can get the number from SplitText, but I'm stuck on aggregating the information by filename. I use RouteText to get the lines containing different strings, and after SplitText I can get the count. Then I'll have to merge the files back so that I can get the

what data is transferred among nodes in a nifi cluster

2018-01-02 Thread 尹文才
Hi guys, I have written a custom processor trying to extract some data from a database and I'm currently using NiFi in standalone mode. I'm trying to migrate to use NiFi in clustered mode. However, I have a question about what data is transferred among the nodes in a cluster. For example, if I