Hello,

Regarding the distributed cache... ListHDFS references the
DistributedMapCacheClient, there is no direct reference between
DistributedMapCacheClient and DistributedMapCacheServer because they
communicate over a network connection.

In 1.x the HDFS processors no longer use the distributed cache for state
management, they use NiFi's internal state management API (which is backed
by Zookeeper in this case), but we left the distributed cache so that if
someone upgrades from NiFi 0.x to 1.x it will migrate the data from the
cache to ZooKeeper.

Regarding the other error, is there any chance there is a network issue
between your NiFi nodes and your zookeeper nodes? do you get that error
every time you try to view state or just sometimes? It is showing a
CONNECTIONLOSS which means NiFi lost connection to the ZooKeeper server.

-Bryan


On Mon, Jan 23, 2017 at 8:07 AM, Margus Roo <[email protected]> wrote:

> Hi
> I have set up cluster. I am using external zookeeper. I have the same
> connection strings in nifi.properties and state-management.xml files.
> DistributedMapCacheServer is set up under controller services. One
> interesting think I noticed that there is not any record under Referencing
> Components under DistributedMapCacheServer settings tab but I have set
> Distributed Cache Service property under ListHDFS processor.
>
> I can get ListHDFS processor record from zookeeper cluster:
> [zk: localhost:2181(CONNECTED) 1] get /nifi/components/cb084e86-
> 0159-1000-0000-00001b125b80
> 1484732837694listing.timestamp
> cZxid = 0x800000315
> ctime = Mon Jan 23 13:20:48 EET 2017
> mZxid = 0x8000022cf
> mtime = Mon Jan 23 14:55:47 EET 2017
> pZxid = 0x800000315
> cversion = 0
> dataVersion = 7091
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 77
> numChildren = 0
> [zk: localhost:2181(CONNECTED) 2]
>
> but trying to get state via NIFI I will get:
> Unable to get the state for the specified component
> cb084e86-0159-1000-0000-00001b125b80: java.io.IOException: Failed to
> obtain value from ZooKeeper for component with ID 
> cb084e86-0159-1000-0000-00001b125b80
> with exception code CONNECTIONLOSS
>
> any hint?
>
> --
> Margus (margusja) Roohttp://margus.roo.ee
> skype: margusjahttps://www.facebook.com/allan.tuuring+372 51 48 780 
> <+372%20514%208780>
>
>

Reply via email to