This happened on NiFi 1.0.0 as well as 1.1.1

I have a flow that uses PutHDFS to write to a remote HDFS. It connects to
this remote MapR system using JAAS kerberos authentication configured in the
local MapR client. I build NiFi to incorporate the MapR libraries. 

Here is the flow writing data with data accumulated:
<http://apache-nifi-developer-list.39713.n7.nabble.com/file/n14535/QueueToPutHDFS_Flow.png>
 

Here is the status history (flow files out) for the queue immediately
preceding the PutHDFS processor:
<http://apache-nifi-developer-list.39713.n7.nabble.com/file/n14535/QueueToPutHDFS_FlowFilesOut_OneNode.png>
 

Why does is only write from the coordinator? Any Idea? I'm willing to fix
this in the code, and am planning on debugging into it to figure it out, but
I was hoping some one out there could point me to the right place.

I have to work around this by using PutFile to the local FS then manually
moving the files to the remove box. I was going for something a little less
manual. ;)

Thanks!



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/PutHDFS-does-not-write-on-all-nodes-of-a-cluster-only-the-on-the-coordinator-tp14535.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Reply via email to