Ok, thanks for sharing that... Can you look in NIFI_HOME/logs/nifi-app.log and see if you can find that error message that says "Failed to receive data from HBase due to", and then there should be a whole stack trace that goes with that.
If you could paste that whole stacktrace here that would be helpful. Thanks, Bryan On Fri, May 6, 2016 at 10:14 AM, Venkatesh Bodapati < venkatesh.bodap...@inndata.in> wrote: > I am running NiFi, Hbase and Zookeeper in same machine. > > This my Hbase-site.xml : > <configuration> > <property> > <name>hbase.master</name> > <value>localhost:60000</value> > </property> > <property> > <name>hbase.rootdir</name> > <value>hdfs://localhost:8020/hbase</value> > </property> > <property> > <name>hbase.cluster.distributed</name> > <value>true</value> > </property> > <property> > <name>hbase.zookeeper.quorum</name> > <value>localhost</value> > </property> > <property> > <name>dfs.replication</name> > <value>1</value> > </property> > <property> > <name>hbase.zookeeper.property.clientPort</name> > <value>2181</value> > </property> > <property> > <name>hbase.zookeeper.property.dataDir</name> > <value>/usr/local/hadoop/hbase-1.1.2/zookeeper</value> > </property> > <property> > <name>zookeeper.znode.parent</name> > <value>/hbase</value> > </property> > </configuration> > > and my Hbase-client Service properties like this : > Hadoop Configuration FilesInfo : > /usr/local/hadoop/hadoop-2.6.0/etc/hadoop/core-site.xml,/usr/local/hadoop/hbase-1.1.2/conf/hbase-site.xml > ZooKeeper QuorumInfo : No value set > ZooKeeper Client PortInfo : No value set > ZooKeeper ZNode ParentInfo : /hbase > HBase Client RetriesInfo : 1 > > On Fri, May 6, 2016 at 7:13 PM, Bryan Bende <bbe...@gmail.com> wrote: > >> Can you describe your setup a little bit more, things like... >> >> Is NiFi running on the same machine that HBase and ZooKeeper are running >> on (it doesn't have to be, just want to understand the setup) ? >> >> What values do you have in hbase-site.xml for properties like... >> - hbase.zookeeper.quorum >> - hbase.zookeeper.property.clientPort >> >> Here is a template that is working for me: >> >> https://gist.githubusercontent.com/bbende/9457b5ed261e6eeb0f98995a5a2699e0/raw/38e050828c2545cb50e623d6dcf45dbbc9ad1d9d/FunWithHBaseUpdated.xml >> >> I am running NiFi on the HDP Sandbox so everything is local for me. >> >> >> On Fri, May 6, 2016 at 8:54 AM, Venkatesh Bodapati < >> venkatesh.bodap...@inndata.in> wrote: >> >>> " Missing Row id failure, routing to failure " issue solved . Still i >>> got the "failed to receive data from Hbase due to java net connection >>> exception :Connection Refused" error in GetHbase Processor. I update >>> Hbase-Site.xml and remove remaining properties like " Zookeeper Quorum >>> Info,Zookeeper Client Port Info . still i got the same error in GetHbase >>> processor. >>> >>> On Thu, May 5, 2016 at 9:07 PM, Bryan Bende <bbe...@gmail.com> wrote: >>> >>>> I was looking at this a little more and instead of needing the >>>> RouteOnAttribute, I think you can just update EvaluateJsonPath >>>> properties... >>>> >>>> Based on the JSON I see coming in, they should be: >>>> >>>> email = $.email >>>> firstName = $.name.first >>>> lastName = $.name.last >>>> ssn = $.id.value >>>> >>>> >>>> >>>> On Thu, May 5, 2016 at 11:30 AM, Bryan Bende <bbe...@gmail.com> wrote: >>>> >>>>> Hello, >>>>> >>>>> For HBaseClient, are you sure your ZooKeeper being used by HBase is >>>>> running on localhost:2181? >>>>> >>>>> Typically you don't really need to set the three ZooKeeper properties, >>>>> and you can instead just set the hbase-site.xml in the config resources. >>>>> >>>>> For example, my Hadoop Configuration Resources is set as: >>>>> /etc/hadoop/conf/core-site.xml,/etc/hbase/conf/hbase-site.xml >>>>> >>>>> And then I don't have anything specified for ZooKeeper QuorumInfo, >>>>> etc., because hbase-site.xml is providing all that information. >>>>> >>>>> The example template requires a Users table, so from Hbase shell: >>>>> create 'Users', {NAME => 'cf'} >>>>> >>>>> Then the template has a slight problem where it is using >>>>> EvaluteJsonPath to extract an attribute called "ssn" and using that for >>>>> the >>>>> row id... the problem is a lot of the ssn values are empty so they are >>>>> failing. >>>>> >>>>> If you stick a RouteOnAttribute right after EvaluateJsonPath, and add >>>>> a property "matched" = ${ssn:isEmpty():not()} that will filter out all the >>>>> empty SSNs, then connect RouteOnAttribute's matched relationship to the >>>>> HBase processors. >>>>> >>>>> Lets get the inserting side working and then I would expect the >>>>> GetHBase to work since they use the same underlying connection. >>>>> >>>>> Thanks, >>>>> >>>>> Bryan >>>>> >>>>> >>>>> On Thu, May 5, 2016 at 10:59 AM, Venkatesh Bodapati < >>>>> venkatesh.bodap...@inndata.in> wrote: >>>>> >>>>>> I am working on "Fun_With_Hbase.xml" Template. In this i will send >>>>>> data to hbase table, but i will not get data from hbase. I will get the >>>>>> "failed to receive data from hbase due to java net connection exception >>>>>> :Connection Refused" error in GetHbase Processor and In >>>>>> PutHbaseCell,PutHbaseJson Processor i got error Like This " Missing Row >>>>>> id >>>>>> failure, routing to failure ". >>>>>> >>>>>> This is my HbaseClient Properties : >>>>>> >>>>>> Hadoop Configuration FilesInfo : >>>>>> /usr/local/hadoop/hadoop-2.6.0/etc/hadoop/core-site.xml,/usr/local/hadoop/hadoop-2.6.0/etc/hadoop/hdfs-site.xml >>>>>> ZooKeeper QuorumInfo : localhost:2181 >>>>>> ZooKeeper Client PortInfo : 2181 >>>>>> ZooKeeper ZNode ParentInfo : /hbase >>>>>> HBase Client RetriesInfo : 1 >>>>>> >>>>>> >>>>>> How do i get data from Hbase Table in Nifi,Any suggesions please. >>>>>> >>>>> >>>>> >>>> >>> >> >
