[
https://issues.apache.org/jira/browse/KYLIN-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17074226#comment-17074226
]
Xiaoxiang Yu commented on KYLIN-4427:
-------------------------------------
Hi, sorry for my late reply, I have see two similar issue , another one is
https://issues.apache.org/jira/browse/KYLIN-4385 .
For the Wrong FIleSystem Exception, could you please add the following
configuration and try again.
Modify the tomcat/webapps/kylin/WEB-INF/classes/kylinMetrics.xml:
{code:java}
<bean id="initMetricsManager"
class="org.springframework.beans.factory.config.MethodInvokingFactoryBean">
<property name="targetClass"
value="org.apache.kylin.metrics.MetricsManager"/>
<property name="targetMethod" value="initMetricsManager"/>
<property name="arguments">
<list>
<ref bean="hiveSink"/>
<map key-type="org.apache.kylin.metrics.lib.ActiveReservoir"
value-type="java.util.List">
<entry key-ref="blockingReservoir">
<list>
<bean class="org.apache.kylin.common.util.Pair">
<property name="first"
value="org.apache.kylin.metrics.lib.impl.hive.HiveReservoirReporter"/>
<property name="second">
<props>
<prop key="fs.defaultFS">s3://BUCKET_NAME</prop>
</props>
</property>
</bean>
</list>
</entry>
</map>
</list>
</property>
</bean>{code}
> Wrong FileSystem error when trying to enable system cubes and Dashboard in
> Kylin 2.6.4
> --------------------------------------------------------------------------------------
>
> Key: KYLIN-4427
> URL: https://issues.apache.org/jira/browse/KYLIN-4427
> Project: Kylin
> Issue Type: Bug
> Components: Metrics
> Affects Versions: v2.6.4
> Reporter: Preeti V
> Assignee: Xiaoxiang Yu
> Priority: Major
>
> I am trying to enable system cubes for the Dashboard using Kylin version
> 2.6.4 The tables are created correctly and the cube builds successfully but
> there is no query or job data on the dashboard, it shows 0.
>
> We use Azure storage for Hive(wasb:// file system). I can see that there is
> no data being updated on the Hive_Metrics tables in Azure. In Kylin logs I
> see the below error
>
>
> 2020-03-12 20:02:41,790 ERROR [metrics-blocking-reservoir-scheduler-0]
> hive.HiveReservoirReporter:119 : Wrong FS:
> wasb://*****.blob.core.windows.net/hive/warehouse/kylin.db/hive_metrics_query_cube_qa/kday_date=2020-03-12,
> expected: hdfs://*****-prod-bn01
> java.lang.IllegalArgumentException: Wrong FS:
> wasb://*****.blob.core.windows.net/hive/warehouse/kylin.db/hive_metrics_query_cube_qa/kday_date=2020-03-12,
> expected: hdfs://*****-prod-bn01
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:666)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:214)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1442)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1438)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1454)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1448)
> at
> org.apache.kylin.metrics.lib.impl.hive.HiveProducer.write(HiveProducer.java:137)
> at
> org.apache.kylin.metrics.lib.impl.hive.HiveProducer.send(HiveProducer.java:122)
> at
> org.apache.kylin.metrics.lib.impl.hive.HiveReservoirReporter$HiveReservoirListener.onRecordUpdate(HiveReservoirReporter.java:117)
> at
> org.apache.kylin.metrics.lib.impl.BlockingReservoir.notifyListenerOfUpdatedRecord(BlockingReservoir.java:105)
>
>
> I checked the hive configs and it has the warehouse metastore dir correctly
> pointing to azure. I found another thread with similar problem where they are
> trying to use S3 instead of hdfs.
> [http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-4385-KYLIN-system-cube-failing-to-update-table-when-run-on-EMR-with-S3-as-storageS-td14234.html]
>
>
> I also followed the recommendations here
> [https://www.mail-archive.com/[email protected]/msg04347.html] and
> enabled all the necessary config values.
> Is this a bug in Kylin or a configuration issue on my cluster? Any help or
> guidance is appreciated.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
