[GitHub] [kylin] GinaZhai opened a new pull request #518: Update Kylin configuration
GinaZhai opened a new pull request #518: Update Kylin configuration URL: https://github.com/apache/kylin/pull/518 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] asfgit commented on issue #518: Update Kylin configuration
asfgit commented on issue #518: Update Kylin configuration URL: https://github.com/apache/kylin/pull/518#issuecomment-473163628 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3852) Provide Flink binary package download script
[ https://issues.apache.org/jira/browse/KYLIN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793269#comment-16793269 ] ASF GitHub Bot commented on KYLIN-3852: --- shaofengshi commented on pull request #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Provide Flink binary package download script > > > Key: KYLIN-3852 > URL: https://issues.apache.org/jira/browse/KYLIN-3852 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
shaofengshi commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-473142831 Guangxu, thank you for the PR! We will review it soon. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3852) Provide Flink binary package download script
[ https://issues.apache.org/jira/browse/KYLIN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793270#comment-16793270 ] ASF subversion and git services commented on KYLIN-3852: Commit cc4128fe5c7381f4eeae0f85fc18493c1dc97c99 in kylin's branch refs/heads/engine-flink from yanghua [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cc4128f ] KYLIN-3852 Provide Flink binary package download script > Provide Flink binary package download script > > > Key: KYLIN-3852 > URL: https://issues.apache.org/jira/browse/KYLIN-3852 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] shaofengshi merged pull request #517: KYLIN-3852 Provide Flink binary package download script
shaofengshi merged pull request #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Resolved] (KYLIN-3865) Centralize the zookeeper related info
[ https://issues.apache.org/jira/browse/KYLIN-3865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhong Yanghong resolved KYLIN-3865. --- Resolution: Resolved > Centralize the zookeeper related info > - > > Key: KYLIN-3865 > URL: https://issues.apache.org/jira/browse/KYLIN-3865 > Project: Kylin > Issue Type: Improvement >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Major > Fix For: v3.0.0 > > > Currently zookeeper related infos, like zk path, curator client, are > scattered many places, like > ZookeeperDistributedLock, DistributedScheduler, CuratorScheduler. It's better > to centralize them. There'll be several benefits: > * Avoid creating multiple curator clients > * Easy to manage the zk path by leveraging zkChRoot -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3867) Enable JDBC to use key store & trust store for https connection
[
https://issues.apache.org/jira/browse/KYLIN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhong Yanghong resolved KYLIN-3867.
---
Resolution: Resolved
> Enable JDBC to use key store & trust store for https connection
> ---
>
> Key: KYLIN-3867
> URL: https://issues.apache.org/jira/browse/KYLIN-3867
> Project: Kylin
> Issue Type: Improvement
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v3.0.0
>
>
> In some cases, JDBC clients need to pass its client cert & key to the
> downstream for authentication. Then the JDBC needs to create a connection
> with key store & trust store.
> {code}
> import java.io.BufferedReader;
> import java.io.InputStream;
> import java.io.InputStreamReader;
> import java.net.URL;
> import javax.net.ssl.HttpsURLConnection;
> import javax.net.ssl.SSLSocketFactory;
>
> public class SSLContextTest5 {
>
> public static void main( String[] args )
> throws Exception
> {
> System.setProperty("javax.net.ssl.keyStoreType", "jks");
> System.setProperty("javax.net.ssl.trustStoreType", "jks");
> System.setProperty("javax.net.ssl.keyStore",
> "/export/home/miweng/test2/mystore.jks");
> System.setProperty("javax.net.ssl.trustStore",
> "/export/home/miweng/test2/truststore.jks");
> System.setProperty("javax.net.ssl.keyStorePassword", "changeit");
> System.setProperty("javax.net.ssl.trustStorePassword", "changeit");
>
> //System.setProperty("https.protocols", "TLSv1.2");
>
> try {
> URL url = new URL( "https://manage-proxy.vip.xxx.com/ws/spf";);
> HttpsURLConnection con = (HttpsURLConnection) url.openConnection();
>
> SSLSocketFactory sslsocketfactory = (SSLSocketFactory)
> SSLSocketFactory.getDefault();
> con.setSSLSocketFactory(sslsocketfactory);
> InputStream inputstream = con.getInputStream();
> InputStreamReader inputstreamreader = new
> InputStreamReader(inputstream);
> BufferedReader bufferedreader = new BufferedReader(inputstreamreader);
>
> String string = null;
> while ((string = bufferedreader.readLine()) != null) {
> System.out.println("Received " + string);
> }
> } catch (Exception e) { e.printStackTrace(); }
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] yanghua commented on issue #517: KYLIN-3852 Provide Flink binary package download script
yanghua commented on issue #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517#issuecomment-473127492 cc @shaofengshi This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io commented on issue #517: KYLIN-3852 Provide Flink binary package download script
codecov-io commented on issue #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517#issuecomment-472850098 # [Codecov](https://codecov.io/gh/apache/kylin/pull/517?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`engine-flink@3e5eda7`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/kylin/pull/517?src=pr&el=tree) ```diff @@ Coverage Diff @@ ## engine-flink #517 +/- ## === Coverage? 24.27% Complexity ? 5029 === Files ? 1166 Lines ?70903 Branches?10078 === Hits?17215 Misses ?51948 Partials? 1740 ``` -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/517?src=pr&el=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/517?src=pr&el=footer). Last update [3e5eda7...24c3c03](https://codecov.io/gh/apache/kylin/pull/517?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3852) Provide Flink binary package download script
[ https://issues.apache.org/jira/browse/KYLIN-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792614#comment-16792614 ] ASF GitHub Bot commented on KYLIN-3852: --- yanghua commented on pull request #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517 JIRA ref : https://issues.apache.org/jira/browse/KYLIN-3852 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Provide Flink binary package download script > > > Key: KYLIN-3852 > URL: https://issues.apache.org/jira/browse/KYLIN-3852 > Project: Kylin > Issue Type: Sub-task > Components: Flink Engine >Reporter: vinoyang >Assignee: vinoyang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #517: KYLIN-3852 Provide Flink binary package download script
asfgit commented on issue #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517#issuecomment-472836534 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] yanghua opened a new pull request #517: KYLIN-3852 Provide Flink binary package download script
yanghua opened a new pull request #517: KYLIN-3852 Provide Flink binary package download script URL: https://github.com/apache/kylin/pull/517 JIRA ref : https://issues.apache.org/jira/browse/KYLIN-3852 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] codecov-io commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
codecov-io commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-472811473 # [Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@d23d2bd`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0%`. [](https://codecov.io/gh/apache/kylin/pull/516?src=pr&el=tree) ```diff @@Coverage Diff@@ ## master #516 +/- ## = Coverage ? 24.44% Complexity? 5024 = Files ? 1160 Lines ?70390 Branches ?10013 = Hits ?17204 Misses?51450 Partials ? 1736 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/516?src=pr&el=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...apache/kylin/storage/hbase/steps/CubeHFileJob.java](https://codecov.io/gh/apache/kylin/pull/516/diff?src=pr&el=tree#diff-c3RvcmFnZS1oYmFzZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc3RvcmFnZS9oYmFzZS9zdGVwcy9DdWJlSEZpbGVKb2IuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr&el=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/516?src=pr&el=footer). Last update [d23d2bd...fd0bc97](https://codecov.io/gh/apache/kylin/pull/516?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
[
https://issues.apache.org/jira/browse/KYLIN-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792555#comment-16792555
]
ASF GitHub Bot commented on KYLIN-3874:
---
guangxuCheng commented on pull request #516: KYLIN-3874 "Convert Cuboid Data to
HFile" failed when HBase and MR use different HDFS clusters
URL: https://github.com/apache/kylin/pull/516
Detail: https://issues.apache.org/jira/browse/KYLIN-3874
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS
> clusters
> ---
>
> Key: KYLIN-3874
> URL: https://issues.apache.org/jira/browse/KYLIN-3874
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Reporter: Guangxu Cheng
>Assignee: Guangxu Cheng
>Priority: Major
>
> {panel:title=exception}
> 2019-03-14 16:33:45,113 INFO [main]
> org.apache.hadoop.service.AbstractService: Service
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException:
> Couldn't create proxy provider class
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
> ...
> Caused by: java.lang.RuntimeException: Could not find any configured
> addresses for URI
> hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
> at
> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
> ... 31 more
> {panel}
> {color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used
> by HBase.
> In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
> {code:java|title=CubeHFileJob.java|borderStyle=solid}
> // use current hbase configuration
> Configuration configuration = new
> Configuration(HBaseConnection.getCurrentHBaseConfiguration());
> merge(configuration, getConf());
> {code}
> "getConf()" contains only the HDFS configuration of MR, and "configuration"
> contains the HDFS configuration both HBase and MR. See:
> [HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
> So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration
> to be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
asfgit commented on issue #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516#issuecomment-472804056 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] guangxuCheng opened a new pull request #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
guangxuCheng opened a new pull request #516: KYLIN-3874 "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters URL: https://github.com/apache/kylin/pull/516 Detail: https://issues.apache.org/jira/browse/KYLIN-3874 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Created] (KYLIN-3874) "Convert Cuboid Data to HFile" failed when HBase and MR use different HDFS clusters
Guangxu Cheng created KYLIN-3874:
Summary: "Convert Cuboid Data to HFile" failed when HBase and MR
use different HDFS clusters
Key: KYLIN-3874
URL: https://issues.apache.org/jira/browse/KYLIN-3874
Project: Kylin
Issue Type: Bug
Components: Job Engine
Reporter: Guangxu Cheng
Assignee: Guangxu Cheng
{panel:title=exception}
2019-03-14 16:33:45,113 INFO [main] org.apache.hadoop.service.AbstractService:
Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED;
cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
java.io.IOException: Couldn't create proxy provider class
org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
...
Caused by: java.lang.RuntimeException: Could not find any configured addresses
for URI
hdfs://{color:#ff}hbase-ns-test{color}/kylin/kylin_metadata/kylin-cd4db32e-42b6-44f2-7fa9-ef6c46334249/derived_meta_global/hfile
at
org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.(ConfiguredFailoverProxyProvider.java:116)
... 31 more
{panel}
{color:#ff}hbase-ns-test{color} is the nameservice of HDFS which is used by
HBase.
In our kylin environment, HBase and MR/HIVE use different HDFS clusters.
{code:java|title=CubeHFileJob.java|borderStyle=solid}
// use current hbase configuration
Configuration configuration = new
Configuration(HBaseConnection.getCurrentHBaseConfiguration());
merge(configuration, getConf());
{code}
"getConf()" contains only the HDFS configuration of MR, and "configuration"
contains the HDFS configuration both HBase and MR. See:
[HBaseConnection#addHBaseClusterNNHAConfiguration()|https://github.com/apache/kylin/blob/d23d2bddab3263d39059492b91f71d8091198057/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/HBaseConnection.java#L205]
So "merge(configuration, getConf())" will lead to HBASE's HDFS configuration to
be covered. Mainly parameter "dfs.nameservices"
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Issue Comment Deleted] (KYLIN-3870) Kylin support count(column)
[ https://issues.apache.org/jira/browse/KYLIN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhixiong Chen updated KYLIN-3870: - Comment: was deleted (was: So this jira is meaning to support count(column) as a measure ?) > Kylin support count(column) > --- > > Key: KYLIN-3870 > URL: https://issues.apache.org/jira/browse/KYLIN-3870 > Project: Kylin > Issue Type: Improvement >Reporter: jinguowei >Assignee: xiaodongzhang >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Reopened] (KYLIN-3841) Build Global Dict by MR/Hive
[ https://issues.apache.org/jira/browse/KYLIN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaofeng SHI reopened KYLIN-3841: - > Build Global Dict by MR/Hive > > > Key: KYLIN-3841 > URL: https://issues.apache.org/jira/browse/KYLIN-3841 > Project: Kylin > Issue Type: Improvement >Reporter: jinguowei >Assignee: jinguowei >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] codecov-io commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
codecov-io commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-472747723 # [Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@d23d2bd`). [Click here to learn what that means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit). > The diff coverage is `0.27%`. [](https://codecov.io/gh/apache/kylin/pull/515?src=pr&el=tree) ```diff @@Coverage Diff@@ ## master #515 +/- ## = Coverage ? 24.31% Complexity? 5025 = Files ? 1162 Lines ?70754 Branches ?10065 = Hits ?17206 Misses?51813 Partials ? 1735 ``` | [Impacted Files](https://codecov.io/gh/apache/kylin/pull/515?src=pr&el=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...ain/java/org/apache/kylin/job/JoinedFlatTable.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-Y29yZS1qb2Ivc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2pvYi9Kb2luZWRGbGF0VGFibGUuamF2YQ==) | `0% <ø> (ø)` | `0 <0> (?)` | | | [...apache/kylin/measure/bitmap/BitmapMeasureType.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWVhc3VyZS9iaXRtYXAvQml0bWFwTWVhc3VyZVR5cGUuamF2YQ==) | `18.86% <0%> (ø)` | `4 <0> (?)` | | | [...ain/java/org/apache/kylin/cube/model/CubeDesc.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL21vZGVsL0N1YmVEZXNjLmphdmE=) | `63.44% <0%> (ø)` | `179 <0> (?)` | | | [...rg/apache/kylin/source/hive/BeelineHiveClient.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0JlZWxpbmVIaXZlQ2xpZW50LmphdmE=) | `4.05% <0%> (ø)` | `5 <0> (?)` | | | [...apache/kylin/source/hive/CreateMrHiveDictStep.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0NyZWF0ZU1ySGl2ZURpY3RTdGVwLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...va/org/apache/kylin/source/hive/CLIHiveClient.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL0NMSUhpdmVDbGllbnQuamF2YQ==) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...lin/engine/mr/steps/FactDistinctColumnsMapper.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-ZW5naW5lLW1yL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvbXIvc3RlcHMvRmFjdERpc3RpbmN0Q29sdW1uc01hcHBlci5qYXZh) | `5.17% <0%> (ø)` | `0 <0> (?)` | | | [.../java/org/apache/kylin/common/KylinConfigBase.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-Y29yZS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL2NvbW1vbi9LeWxpbkNvbmZpZ0Jhc2UuamF2YQ==) | `13.92% <0%> (ø)` | `41 <0> (?)` | | | [...a/org/apache/kylin/source/hive/MRHiveDictUtil.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-c291cmNlLWhpdmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3NvdXJjZS9oaXZlL01SSGl2ZURpY3RVdGlsLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | [...ache/kylin/engine/mr/common/BaseCuboidBuilder.java](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree#diff-ZW5naW5lLW1yL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9lbmdpbmUvbXIvY29tbW9uL0Jhc2VDdWJvaWRCdWlsZGVyLmphdmE=) | `0% <0%> (ø)` | `0 <0> (?)` | | | ... and [2 more](https://codecov.io/gh/apache/kylin/pull/515/diff?src=pr&el=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr&el=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/kylin/pull/515?src=pr&el=footer). Last update [d23d2bd...bd39cae](https://codecov.io/gh/apache/kylin/pull/515?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
[GitHub] [kylin] javalife0312 commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
javalife0312 commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-472743079 Useage： Configuration Overwrites kylin.dictionary.mr-hive.columns ORDER_CITY_CITY_NAME ORDER_CITY_CITY_NAME = tableAlias_columnName This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Commented] (KYLIN-3841) Build Global Dict by MR/Hive
[ https://issues.apache.org/jira/browse/KYLIN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792432#comment-16792432 ] ASF GitHub Bot commented on KYLIN-3841: --- javalife0312 commented on pull request #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515 add steps: 1、Global Dict Mr/Hive extract dict_val from Data 2、Global Dict Mr/Hive build dict_val 3、Global Dict Mr/Hive replace dict_val to Data optimize: 1、Extract Fact Table Distinct Columns reduce mr-hive-dict-column option 2、Build Dimension Dictionary reduce mr-hive-dict-column option 3、Build Base Cuboid reduce dict option This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Build Global Dict by MR/Hive > > > Key: KYLIN-3841 > URL: https://issues.apache.org/jira/browse/KYLIN-3841 > Project: Kylin > Issue Type: Improvement >Reporter: jinguowei >Assignee: jinguowei >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] [kylin] asfgit commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive
asfgit commented on issue #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515#issuecomment-472740917 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] javalife0312 opened a new pull request #515: KYLIN-3841 Build Global Dict by MR/Hive
javalife0312 opened a new pull request #515: KYLIN-3841 Build Global Dict by MR/Hive URL: https://github.com/apache/kylin/pull/515 add steps: 1、Global Dict Mr/Hive extract dict_val from Data 2、Global Dict Mr/Hive build dict_val 3、Global Dict Mr/Hive replace dict_val to Data optimize: 1、Extract Fact Table Distinct Columns reduce mr-hive-dict-column option 2、Build Dimension Dictionary reduce mr-hive-dict-column option 3、Build Base Cuboid reduce dict option This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[jira] [Resolved] (KYLIN-3872) Kylin web UI http 404 error
[
https://issues.apache.org/jira/browse/KYLIN-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mimimiracle resolved KYLIN-3872.
Resolution: Fixed
Fix Version/s: v2.6.1
> Kylin web UI http 404 error
>
>
> Key: KYLIN-3872
> URL: https://issues.apache.org/jira/browse/KYLIN-3872
> Project: Kylin
> Issue Type: Bug
>Affects Versions: v2.6.1
> Environment: CDH6.1
> Hadoop3.0.0+cdh6.1.0
> HDFS 3.0.0+cdh6.1.0
> YARN 3.0.0+cdh6.1.0
> HBase 2.1.0+cdh6.1.0
> Hive 2.1.1+cdh6.1.0
> spark 2.4.0+cdh6.1.0
> ZooKeeper 3.4.5+cdh6.1.0
>Reporter: mimimiracle
>Priority: Blocker
> Labels: Kylin, tomcat
> Fix For: v2.6.1
>
>
> kylin server is started but the web cannot be access
> {code:java}
> [root@server1 logs]# netstat -anp| grep 7070
> tcp 0 0 0.0.0.0:7070 0.0.0.0:* LISTEN 11487/java
> {code}
> below is some of log records
> {code:java}
> 2019-03-13 18:28:18,697 WARN [localhost-startStop-1]
> scan.StandardJarScanner:146 : Failed to scan
> [file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_ja_JP.jar]
> from classloader hierarchy
> java.io.FileNotFoundException:
> /opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_ja_JP.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.(ZipFile.java:225)
> at java.util.zip.ZipFile.(ZipFile.java:155)
> at java.util.jar.JarFile.(JarFile.java:166)
> at java.util.jar.JarFile.(JarFile.java:130)
> at
> org.apache.tomcat.util.compat.JreCompat.jarFileNewInstance(JreCompat.java:196)
> at
> org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:65)
> at
> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:49)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:374)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.processURLs(StandardJarScanner.java:309)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.doScanClassPath(StandardJarScanner.java:266)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.scan(StandardJarScanner.java:229)
> at
> org.apache.catalina.startup.ContextConfig.processJarsForWebFragments(ContextConfig.java:1888)
> at
> org.apache.catalina.startup.ContextConfig.webConfig(ContextConfig.java:1116)
> at
> org.apache.catalina.startup.ContextConfig.configureStart(ContextConfig.java:765)
> at
> org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:299)
> at
> org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:94)
> at
> org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5154)
> at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
> at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:754)
> at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:730)
> java.io.FileNotFoundException:
> /opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_pt_BR.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.(ZipFile.java:225)
> at java.util.zip.ZipFile.(ZipFile.java:155)
> at java.util.jar.JarFile.(JarFile.java:166)
> at java.util.jar.JarFile.(JarFile.java:130)
> at
> org.apache.tomcat.util.compat.JreCompat.jarFileNewInstance(JreCompat.java:196)
> at
> org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:65)
> at
> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:49)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:374)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.processURLs(StandardJarScanner.java:309)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.doScanClassPath(StandardJarScanner.java:266)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
> at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761)
> at
> org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(Ab
[jira] [Commented] (KYLIN-3872) Kylin web UI http 404 error
[
https://issues.apache.org/jira/browse/KYLIN-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792413#comment-16792413
]
mimimiracle commented on KYLIN-3872:
I think the reason is in $KYLIN_HOME/spark, In Kylin2.6.1 there is no spark
folder, I had copied CDH/lib/spark to $KYLIN_HOME/spark then issue appeared,
finally I download a new complete spark2.4 package and put it into
$KYLIN_HOME/spark then all done.
> Kylin web UI http 404 error
>
>
> Key: KYLIN-3872
> URL: https://issues.apache.org/jira/browse/KYLIN-3872
> Project: Kylin
> Issue Type: Bug
>Affects Versions: v2.6.1
> Environment: CDH6.1
> Hadoop3.0.0+cdh6.1.0
> HDFS 3.0.0+cdh6.1.0
> YARN 3.0.0+cdh6.1.0
> HBase 2.1.0+cdh6.1.0
> Hive 2.1.1+cdh6.1.0
> spark 2.4.0+cdh6.1.0
> ZooKeeper 3.4.5+cdh6.1.0
>Reporter: mimimiracle
>Priority: Blocker
> Labels: Kylin, tomcat
>
> kylin server is started but the web cannot be access
> {code:java}
> [root@server1 logs]# netstat -anp| grep 7070
> tcp 0 0 0.0.0.0:7070 0.0.0.0:* LISTEN 11487/java
> {code}
> below is some of log records
> {code:java}
> 2019-03-13 18:28:18,697 WARN [localhost-startStop-1]
> scan.StandardJarScanner:146 : Failed to scan
> [file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_ja_JP.jar]
> from classloader hierarchy
> java.io.FileNotFoundException:
> /opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_ja_JP.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.(ZipFile.java:225)
> at java.util.zip.ZipFile.(ZipFile.java:155)
> at java.util.jar.JarFile.(JarFile.java:166)
> at java.util.jar.JarFile.(JarFile.java:130)
> at
> org.apache.tomcat.util.compat.JreCompat.jarFileNewInstance(JreCompat.java:196)
> at
> org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:65)
> at
> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:49)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:374)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.processURLs(StandardJarScanner.java:309)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.doScanClassPath(StandardJarScanner.java:266)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.scan(StandardJarScanner.java:229)
> at
> org.apache.catalina.startup.ContextConfig.processJarsForWebFragments(ContextConfig.java:1888)
> at
> org.apache.catalina.startup.ContextConfig.webConfig(ContextConfig.java:1116)
> at
> org.apache.catalina.startup.ContextConfig.configureStart(ContextConfig.java:765)
> at
> org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:299)
> at
> org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:94)
> at
> org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5154)
> at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
> at
> org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:754)
> at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:730)
> java.io.FileNotFoundException:
> /opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/derbyLocale_pt_BR.jar
> (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.(ZipFile.java:225)
> at java.util.zip.ZipFile.(ZipFile.java:155)
> at java.util.jar.JarFile.(JarFile.java:166)
> at java.util.jar.JarFile.(JarFile.java:130)
> at
> org.apache.tomcat.util.compat.JreCompat.jarFileNewInstance(JreCompat.java:196)
> at
> org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:65)
> at
> org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:49)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:374)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.processURLs(StandardJarScanner.java:309)
> at
> org.apache.tomcat.util.scan.StandardJarScanner.doScanClassPath(StandardJarScanner.java:266)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
> at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
> at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
> at
> org.springfram
