Hi Anuruddha, This seems to be an issue with the HBase cluster itself rather than an integration issue. Could you check the HBase logs and see if anything is reported there? In any case, please also specify the zookeeper quorum property as well (hbase.zookeeper.quorum and specify the zk nodes)
Thanks, On 27 July 2015 at 11:45, Anuruddha Liyanarachchi <[email protected]> wrote: > Hi Gokul, > > Thanks for the reply. > > Yes this runs on a HBase cluster. I have added the properties and it fixed > the No FileSystem for scheme: file Error. Now I am getting following error. > > org.wso2.carbon.analytics.datasource.commons.exception.AnalyticsException: > Error checking existence of table __SHARD_INDEX_UPDATE_RECORDS__1 for > tenant -1000 > at > org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.tableExists(HBaseAnalyticsRecordStore.java:126) > at > org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.get(HBaseAnalyticsRecordStore.java:274) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationRecords(AnalyticsDataIndexer.java:554) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationUpdateRecords(AnalyticsDataIndexer.java:519) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.loadIndexOperationUpdateRecords(AnalyticsDataIndexer.java:515) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.processIndexUpdateOperations(AnalyticsDataIndexer.java:403) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.processIndexOperations(AnalyticsDataIndexer.java:491) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer.access$200(AnalyticsDataIndexer.java:118) > at > org.wso2.carbon.analytics.dataservice.indexing.AnalyticsDataIndexer$IndexWorker.run(AnalyticsDataIndexer.java:1744) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't > get the locations > at > org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:305) > at > org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:131) > at > org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:56) > at > org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) > at > org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:287) > at > org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:267) > at > org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:139) > at > org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:134) > at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:823) > at > org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:601) > at > org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:365) > at > org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:281) > at > org.wso2.carbon.analytics.datasource.hbase.HBaseAnalyticsRecordStore.tableExists(HBaseAnalyticsRecordStore.java:123) > ... 11 more > > > On Mon, Jul 27, 2015 at 10:54 AM, Gokul Balakrishnan <[email protected]> > wrote: > >> Hi Anuruddha, >> >> Are you running HBase on a cluster (i.e. on top of HDFS)? If yes, can you >> ensure that you have the following in the analytics-datasource.xml for the >> HBase datasource? >> >> <property> >> <name>fs.hdfs.impl</name> >> <value>org.apache.hadoop.hdfs.DistributedFileSystem</value> >> </property> >> <property> >> <name>fs.file.impl</name> >> <value>org.apache.hadoop.fs.LocalFileSystem</value> >> </property> >> >> Thanks, >> >> >> On 27 July 2015 at 10:43, Anuruddha Liyanarachchi <[email protected]> >> wrote: >> >>> Hi DAS team, >>> >>> I have created DAS receiver and analytics cluster as in the diagram [1]. >>> In the setup DAS receivers are connected to MySQL (FS_DB) and HBase >>> (EventStore). >>> >>> I am getting following errors when I start DAS receivers. What could be >>> the reason for this error ? >>> I have attached the carbon log as well. >>> >>> TID: [-1] [] [2015-07-27 04:37:40,838] WARN >>> {org.apache.hadoop.hbase.util.DynamicClassLoader} - Failed to identify the >>> fs of dir /opt/wso2das-3.0.0-SNAPSHOT/tmp/hbase-root/hbase/lib, ignored >>> {org.apac >>> he.hadoop.hbase.util.DynamicClassLoader} >>> java.io.IOException: No FileSystem for scheme: file >>> at >>> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584) >>> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591) >>> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) >>> at >>> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630) >>> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612) >>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370) >>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169) >>> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:354) >>> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) >>> at >>> org.apache.hadoop.hbase.util.DynamicClassLoader.<init>(DynamicClassLoader.java:104) >>> at >>> org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:229) >>> at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64) >>> at >>> org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75) >>> at >>> org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:86) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:833) >>> at >>> org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:623) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238) >>> at >>> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218) >>> at >>> org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119) >>> at >>> org.wso2.carbon.datasource.reader.hadoop.HadoopDataSourceReaderUtil.getHBaseConnection(HadoopDataSourceReaderUtil.java:79) >>> at >>> org.wso2.carbon.datasource.reader.hadoop.HBaseDataSourceReader.createDataSource(HBaseDataSourceReader.java:35) >>> at >>> org.wso2.carbon.ndatasource.core.DataSourceRepository.createDataSourceObject(DataSourceRepository.java:202) >>> at >>> org.wso2.carbon.ndatasource.core.DataSourceRepository.registerDataSource(DataSourceRepository.java:359) >>> at >>> org.wso2.carbon.ndatasource.core.DataSourceRepository.addDataSource(DataSourceRepository.java:473) >>> at >>> org.wso2.carbon.ndatasource.core.DataSourceManager.initSystemDataSource(DataSourceManager.java:185) >>> at >>> org.wso2.carbon.ndatasource.core.DataSourceManager.initSystemDataSources(DataSourceManager.java:164) >>> at >>> org.wso2.carbon.ndatasource.core.internal.DataSourceServiceComponent.initSystemDataSources(DataSourceServiceComponent.java:192) >>> at >>> org.wso2.carbon.ndatasource.core.internal.DataSourceServiceComponent.setSecretCallbackHandlerService(DataSourceServiceComponent.java:178) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at >>> org.eclipse.equinox.internal.ds.model.ComponentReference.bind(ComponentReference.java:376) >>> at >>> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.bindReference(ServiceComponentProp.java:430) >>> at >>> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.bind(ServiceComponentProp.java:218) >>> at >>> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.build(ServiceComponentProp.java:343) >>> at >>> org.eclipse.equinox.internal.ds.InstanceProcess.buildComponent(InstanceProcess.java:620) >>> at >>> org.eclipse.equinox.internal.ds.InstanceProcess.buildComponents(InstanceProcess.java:197) >>> at >>> org.eclipse.equinox.internal.ds.Resolver.getEligible(Resolver.java:343) >>> at >>> org.eclipse.equinox.internal.ds.SCRManager.serviceChanged(SCRManager.java:222) >>> at >>> org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:107) >>> at >>> org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:861) >>> at >>> org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230) >>> at >>> org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148) >>> at >>> org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:819) >>> at >>> org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:771) >>> at >>> org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.register(ServiceRegistrationImpl.java:130) >>> at >>> org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.registerService(ServiceRegistry.java:214) >>> at >>> org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:433) >>> at >>> org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:451) >>> at >>> org.wso2.carbon.securevault.internal.SecretManagerInitializerComponent.activate(SecretManagerInitializerComponent.java:48) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at >>> org.eclipse.equinox.internal.ds.model.ServiceComponent.activate(ServiceComponent.java:260) >>> at >>> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.activate(ServiceComponentProp.java:146) >>> at >>> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.build(ServiceComponentProp.java:345) >>> at >>> org.eclipse.equinox.internal.ds.InstanceProcess.buildComponent(InstanceProcess.java:620) >>> at >>> org.eclipse.equinox.internal.ds.InstanceProcess.buildComponents(InstanceProcess.java:197) >>> at >>> org.eclipse.equinox.internal.ds.Resolver.buildNewlySatisfied(Resolver.java:473) >>> at >>> org.eclipse.equinox.internal.ds.Resolver.enableComponents(Resolver.java:217) >>> at >>> org.eclipse.equinox.internal.ds.SCRManager.performWork(SCRManager.java:816) >>> at >>> org.eclipse.equinox.internal.ds.SCRManager$QueuedJob.dispatch(SCRManager.java:783) >>> at org.eclipse.equinox.internal.ds.WorkThread.run(WorkThread.java:89) >>> at java.lang.Thread.run(Thread.java:745) >>> >>> >>> >>> [1] >>> https://docs.google.com/a/wso2.com/drawings/d/1t4NVfkMIeCpRxVZBqr-HeMsg3Qh5mo8huVXED4sYoHE/edit?usp=sharing >>> >>> -- >>> *Thanks and Regards,* >>> Anuruddha Lanka Liyanarachchi >>> Software Engineer - WSO2 >>> Mobile : +94 (0) 712762611 >>> Tel : +94 112 145 345 >>> a <[email protected]>[email protected] >>> >> >> >> >> -- >> Gokul Balakrishnan >> Senior Software Engineer, >> WSO2, Inc. http://wso2.com >> Mob: +94 77 593 5789 | +1 650 272 9927 >> > > > > -- > *Thanks and Regards,* > Anuruddha Lanka Liyanarachchi > Software Engineer - WSO2 > Mobile : +94 (0) 712762611 > Tel : +94 112 145 345 > a <[email protected]>[email protected] > -- Gokul Balakrishnan Senior Software Engineer, WSO2, Inc. http://wso2.com Mob: +94 77 593 5789 | +1 650 272 9927
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
