Re: Writing files to MapR File system using putHDFS

Sumo, I'll try the MapR PR with your additional settings below. If they work, they'll need to be added to the doc (or ideally, the profile if possible). That's what I suspected had been missing but haven't had a chance to try yet, will do that shortly :) Thanks, Matt > On Jun 13, 2016, at 9:1

Re: Writing files to MapR File system using putHDFS

I had been using custom build nifi-hadoop-libraries-nar-0.6.1.nar that worked with MapR 4.02 make sure you add java.security.auth.login.config and follow mapR client setup on the NiFi server (https://github.com/xmlking/mapr-nifi-hadoop-libraries-bundle/blob/master/mapr-client.md

Re: Writing files to MapR File system using putHDFS

I'm not sure if this would make a difference, but typically the configuration resources would be the full paths to core-site.xml and hdfs-site.xml. Wondering if using those instead of yarn-site.xml changes anything. On Monday, June 13, 2016, Ravi Papisetti (rpapiset) wrote: > Yes, Aldrin. Tried

Re: Writing files to MapR File system using putHDFS

Yes, Aldrin. Tried listHDFS, gets the similar error complaining directory doesn't exist. NiFi – 0.6.1 MapR – 5.1 NiFi is local standalone instance. Target cluster is enabled with token based authentication. I am able to execute "hadoop fs –ls " from cli on the node with NiFi installed. Thank

Re: Writing files to MapR File system using putHDFS

Hi Ravi, Could you provide some additional details in terms of both your NiFi environment and the MapR destination? Is your NiFi a single instance or clustered? In the case of the latter, is security established for your ZooKeeper ensemble? Is your target cluster Kerberized? What version are y

Re: Writing files to MapR File system using putHDFS

Thanks Conrad for your reply. Yes, I have configured putHDFS with "Remove Owner" and "Renive Group" with same values as on HDFS. Also, nifi service is started under the same user. Thanks, Ravi Papisetti Technical Leader Services Technology Incubation Center

Re: Writing files to MapR File system using putHDFS

Hi, Sounds like a permissions problem. Have you set the Remote Owner and Remote Groups settings in the processor appropriate for HDFS permissions? Conrad From: "Ravi Papisetti (rpapiset)" Reply-To: "users@nifi.apache.org" Date: Monday, 13 June 2016 at 21:25 To: "users@nifi.apache.org" , "d...@n

Re: Replace Text

So it seems like its a UTF-8 issue, when i changed the string to use Hex instead of Text and using the HEXcode with 00 (2 BYte) the contentsplit worked. wrote: > thanks Joe, unfortunately since my xml has namespaces (xmlns ) that > approach wont work. > any thought on why spilt doesn't work usi

Writing files to MapR File system using putHDFS

Hi, We just started exploring apache nifi for data onboarding into MapR distribution. Have configured putHDFS with yarn-site.xml from on local mapr client where cluster information is provided, configured the "Directory" with mapr fs directory to write the files, configured nifi to run as user

Re: Replace Text

thanks Joe, unfortunately since my xml has namespaces (xmlns ) that approach wont work. any thought on why spilt doesn't work using the tag, does it accept UTF8 flow files ? Anuj On Mon, Jun 13, 2016 at 2:50 PM, ski n wrote: > You can also make your input XML well-formed by creating a custom r

Re: Replace Text

You can also make your input XML well-formed by creating a custom root element (e.g. ...xmldocuments and then use the SplitXML processor (or just the transformation step). 2016-06-13 18:04 GMT+02:00 Anuj Handa : > i have a text file which has multiple XML documents. which starts with > xmlns >

Re: Replace Text

i have a text file which has multiple XML documents. which starts with wrote: > Awesome, and what processor were you planning to use to split on "#|#|#"? > The SplitContent processor[1] can be used to split the content on a > sequence of text characters which could split on " without needing to a

Re: Replace Text

Awesome, and what processor were you planning to use to split on "#|#|#"? The SplitContent processor[1] can be used to split the content on a sequence of text characters which could split on "https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.SplitContent/index.

Best practice: template subdirectory?

What's everybody using as a subdirectory for templates copied over from one's own and other folks' work? Googling, I haven't found any opinions on this. I know that to import a template I can just browse for it, but where are some of you keeping them? Surely there's a smarter place than Downloa

Re: Replace Text

Yes that's exactly correct. > On Jun 13, 2016, at 11:14 AM, Joe Percivall wrote: > > Sorry I got a bit confused, in your original question you said that you > wanted to append the value and I took it that you just wanted to append the > value to the end of the line or text. > > Let me try a

Re: Replace Text

Sorry I got a bit confused, in your original question you said that you wanted to append the value and I took it that you just wanted to append the value to the end of the line or text. Let me try and restate your goal so I'm sure I understand, ultimately you want to split the incoming FlowFil

Re: How to call a stored procedure

Thanks for your instructions. Unfortunately I didn't get it working yet. 1) Firstly I want to avoid extra steps like evaluate xpath and replacetext. Would be easier if ${message} or ${file-content} or whatever variable in the expression language is available out-of-the-box (Camel provides this for

Re: Replace Text

Anuj Hi Joe, I modified the process per your suggestion but it only works to replace the first occurrence, There are multiple such tags which it doesn't replace. . when i used evaluation mode line by line it appended it to every line in the file and not to the one i waned too. [image: Inline imag

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

Basically realizing that there is no issue with your class path I wonder if this is some issue with 'exec-maven-plugin’ since it has its own “dependencies’ configuration. Oleg On Jun 13, 2016, at 10:51 AM, Oleg Zhurakousky mailto:ozhurakou...@hortonworks.com>> wrote: Donald Looking at your

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

Donald Looking at your project I am a bit puzzled First. The SLF4J is actually present as its being added as transient dependency from another project and the App program executes fine in IDE. Indeed I do see an issue while executing it from command line. Has to be some maven voodoo. . . lookin

Re: How to effectively log the data flow in NiFi?

Russ, Sorry for the lack of clarity. This change will occur in version 1.0.0. In the 0.x baseline, the log level for processors is set to INFO. Thanks -Mark > On Jun 13, 2016, at 10:37 AM, Russell Bateman > wrote: > > Mark, > > When did this happen? I'm looking at (an as yet unchanged from

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

Hi Bryan, That’s great to know. That might be easier. Cheers, Donald. > On 13 Jun 2016, at 16:32, Bryan Bende wrote: > > Hi Donald, > > I know this does not directly address the conflict in dependencies, but I > wanted to mention that it is not required to inherit from nifi-nar-bundles.

Re: Replace Text

Hello, In order to use ReplaceText[1] to solely append a value to the end of then entire text then change the "Replacement Strategy" to "Append" and leave "Evaluation Mode" as "Entire Text". This will take whatever is the "Replacement Value" and append it as a literal(without interpreting bac

Re: How to effectively log the data flow in NiFi?

Mark, When did this happen? I'm looking at (an as yet unchanged from original download) /co//nf///logback.xml/ in 0.6.1 and I'm seeing: - no string of characters "org.apache.nifi.processors" and - INFO all over in places like level="INFO"/> What am I missing? Was your comment valid from

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

Hi Donald, I know this does not directly address the conflict in dependencies, but I wanted to mention that it is not required to inherit from nifi-nar-bundles. The Maven archetype does that by default, but you can certainly remove it, there are some instructions on how to do so here: https://cwi

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

Hi Oleg, Thank you for your quick response. Unfortunately it’s still not working. I had tried these but had left them out by mistake when I’d tried mutation coding to get it all running. :-) I have added them in now so it can be tested. I’m still getting the same error. java.lang.reflect.Inv

Replace Text

Hi, I am trying to read a file and then use replaceText to append a string so I can spilt the line in the next step. I am nable to make the ReplaceText work. The flowfile is going through as success without the string being appended or replaced Any thoughts what i could be doing wrong [image: In

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

Donald What I see is that SLF4J is nowhere in your claspath, so by adding it to your pom should solve the issue. Also don’t forget to add specific bindings (e.g., log4j) and its implementation. Basically here is the example of what you need to have if you want to use Log4j: org.slf4j s

NoClassDefFoundError: org/slf4j/LoggerFactory

Hi All, First let me say I’m really enjoying using Nifi, it’s a great project. I have been creating some Processors and they are working very well. Now I want to include processors that talk to RethinkDB. When I include the dependency in Maven I get an java.lang.NoClassDefFoundError: org/slf4