[
https://issues.apache.org/jira/browse/KYLIN-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17076827#comment-17076827
]
Xiaoxiang Yu edited comment on KYLIN-4427 at 4/7/20, 12:45 PM:
---------------------------------------------------------------
Hi, friend, actually I think this is because it cannot find that file on HDFS
or AZure Object Storage, not *local file system*.
Please check this path: /hdp/apps/${hdp.version}/tez/lib/tez.tar.gz , on HDFS
and on Azure's Object Storage System, and make sure _tez.tar.gz_ exists both(if
you have).
If you still have any problem, maybe we can use slack other than JIRA to
discuss the issue, here is my email adress: [email protected] .
Hope we can solve this issue soon.
was (Author: hit_lacus):
Hi, friend, actually I think this is because it cannot find that file on HDFS
or AZure Object Storage, not *local file system*.
Please check this path: /hdp/apps/${hdp.version}/tez/lib/tez.tar.gz , on HDFS
and on Azure's Object Storage System, and make sure they both exists.
If you still have any problem, maybe we can use slack other than JIRA to
discuss the issue, here is my email adress: [email protected] .
Hope we can solve this issue soon.
> Wrong FileSystem error when trying to enable system cubes and Dashboard in
> Kylin 2.6.4
> --------------------------------------------------------------------------------------
>
> Key: KYLIN-4427
> URL: https://issues.apache.org/jira/browse/KYLIN-4427
> Project: Kylin
> Issue Type: Bug
> Components: Metrics
> Affects Versions: v2.6.4
> Reporter: Preeti V
> Assignee: Xiaoxiang Yu
> Priority: Major
> Attachments: KylinMetrics.JPG, image-2020-04-03-10-45-15-290.png,
> image-2020-04-03-10-45-20-859.png, image-2020-04-03-10-45-45-894.png,
> image-2020-04-06-15-46-37-356.png, image-2020-04-06-17-14-52-443.png
>
>
> I am trying to enable system cubes for the Dashboard using Kylin version
> 2.6.4 The tables are created correctly and the cube builds successfully but
> there is no query or job data on the dashboard, it shows 0.
>
> We use Azure storage for Hive(wasb:// file system). I can see that there is
> no data being updated on the Hive_Metrics tables in Azure. In Kylin logs I
> see the below error
>
>
> 2020-03-12 20:02:41,790 ERROR [metrics-blocking-reservoir-scheduler-0]
> hive.HiveReservoirReporter:119 : Wrong FS:
> wasb://*****.blob.core.windows.net/hive/warehouse/kylin.db/hive_metrics_query_cube_qa/kday_date=2020-03-12,
> expected: hdfs://*****-prod-bn01
> java.lang.IllegalArgumentException: Wrong FS:
> wasb://*****.blob.core.windows.net/hive/warehouse/kylin.db/hive_metrics_query_cube_qa/kday_date=2020-03-12,
> expected: hdfs://*****-prod-bn01
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:666)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:214)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1442)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1438)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1454)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1448)
> at
> org.apache.kylin.metrics.lib.impl.hive.HiveProducer.write(HiveProducer.java:137)
> at
> org.apache.kylin.metrics.lib.impl.hive.HiveProducer.send(HiveProducer.java:122)
> at
> org.apache.kylin.metrics.lib.impl.hive.HiveReservoirReporter$HiveReservoirListener.onRecordUpdate(HiveReservoirReporter.java:117)
> at
> org.apache.kylin.metrics.lib.impl.BlockingReservoir.notifyListenerOfUpdatedRecord(BlockingReservoir.java:105)
>
>
> I checked the hive configs and it has the warehouse metastore dir correctly
> pointing to azure. I found another thread with similar problem where they are
> trying to use S3 instead of hdfs.
> [http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-4385-KYLIN-system-cube-failing-to-update-table-when-run-on-EMR-with-S3-as-storageS-td14234.html]
>
>
> I also followed the recommendations here
> [https://www.mail-archive.com/[email protected]/msg04347.html] and
> enabled all the necessary config values.
> Is this a bug in Kylin or a configuration issue on my cluster? Any help or
> guidance is appreciated.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
