Shaofeng SHI created KYLIN-2763:
---
Summary: Release Kylin 2.1
Key: KYLIN-2763
URL: https://issues.apache.org/jira/browse/KYLIN-2763
Project: Kylin
Issue Type: Task
Reporter
Shaofeng SHI created KYLIN-2762:
---
Summary: Get "Owner required" error on saving data model
Key: KYLIN-2762
URL: https://issues.apache.org/jira/browse/KYLIN-2762
Project: Kylin
Issue
; Hive table,no lookup table
> >
> > create table tem(a varchar(1),b bigint,c bigint);
> >
> > insert into tem values('A',null,1);
> > insert into tem values('A',1,1);
> > insert into tem values('A',2,1);
> > insert into tem values('B',3,1);
> > insert into tem values('B',1,1);
> > insert into tem values('C',4,1);
> >
> >
> >
> >
> >
> >
> > apache_...@163.com
> >
>
>
--
Best regards,
Shaofeng Shi 史少锋
add topics about
cloud deployments in Kylin website.
Thanks.
--
Best regards,
Shaofeng Shi 史少锋
e Hbase list for years and wasn't possible before
>
> http://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html
>
> Sent from my iPhone
>
> On May 30, 2017, at 6:48 PM, ShaoFeng Shi <shaofeng...@apache.org> wrote:
>
> Zhuoran, what's the problem you encountered?
h...@cndatacom.com
>
--
Best regards,
Shaofeng Shi 史少锋
row 'kylin_metadata_acl,,' on table 'hbase:meta’
>
> I have no idea why it happen
>
>
--
Best regards,
Shaofeng Shi 史少锋
rtment can only
> > access part of cube columns, Have any plans to support the Cube view?
> >
> >
> >
> > apache_...@163.com
> >
>
--
Best regards,
Shaofeng Shi 史少锋
all
> but it's not working.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Timeout-visiting-cube-tp8540p8541.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
Shaofeng SHI created KYLIN-2757:
---
Summary: Couldn't get cube size if using Azure Data Lake Store
Key: KYLIN-2757
URL: https://issues.apache.org/jira/browse/KYLIN-2757
Project: Kylin
Issue Type
> OFFSET” (to comply with PostgreSQL) and “OFFSET … FETCH” (to comply with
> the standard). But if you specify both LIMIT and FETCH it will ignore the
> LIMIT.
>
> Julian
>
>
> > On Jul 21, 2017, at 8:11 PM, ShaoFeng Shi <shaofeng...@apache.org>
> wrote:
>
Shaofeng SHI created KYLIN-2756:
---
Summary: Let "LIMIT" be optional in "Inspect" page
Key: KYLIN-2756
URL: https://issues.apache.org/jira/browse/KYLIN-2756
Project: Kylin
se version is in Kaisen's personal blog:
http://blog.bcmeng.com/
Thanks Kaisen's sharing!
If anyone want to contribute Kylin tech blog, please contact me.
--
Best regards,
Shaofeng Shi 史少锋
DISTINCT ] query } [ ORDER BY orderItem [, orderItem ]* ]
> [ LIMIT { count | ALL } ] [ OFFSET start { ROW | ROWS } ] [ FETCH { FIRST |
> NEXT } [ count ] { ROW | ROWS } ]
>
>
>
> apache_...@163.com
>
--
Best regards,
Shaofeng Shi 史少锋
sponse status_code是200，cube没有被删除
> 2 如果想要每个小时都增量构建streaming cube，并且有几十个cube都需要这样做，那么并发的job会很多，会造成OOM或者job
> pending吗？我们如何用api来监控所有job的状态，像web UI中的monitor那样，有返回所有job
> status的API吗？目前好像只有返回指定的job status的API。
>
--
Best regards,
Shaofeng Shi 史少锋
n context: http://apache-kylin.74782.x6.
> nabble.com/Upgrade-from-kylin-1-5-to-kylin-2-0-tp8515.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
this-
> configuration-item-each-time-I-use-the-pass-argument-tp8470p8502.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
gt; to
> >> the branch as well for the same.
> >>
> >> In Nutshell:
> >> We need any Kylin that works with CDH 5.10.x OR 5.11.x; The branch name
> to
> >> point to as we need some custom patches to be applied.
> >>
> >> Let me know in case of any queries.
> >>
> >> Thanks,
> >> Ketan
>
>
--
Best regards,
Shaofeng Shi 史少锋
gt; Nirav
>
> On Tue, Jul 18, 2017 at 8:59 AM, Nirav Patel <npa...@xactlycorp.com>
> wrote:
>
> > Thanks. Is it okay if I create a patch from my own fork repo and attach
> it
> > to JIRA? will you be still able to inspect and apply?
> >
> > On Mon, Jul 17,
gt;:
> shaofeng,
>
> thinks.
>
> Is it(measures result) calculated during the cube running or calculated
> at query time?
>
>
>
>
>
>
> apache_...@163.com
>
> From: ShaoFeng Shi
> Date: 2017-07-18 17:31
> To: dev
> Subject: Re: about Measur
You're welcome. Thanks for the feedback.
2017-07-18 18:15 GMT+08:00 jianhui.yi <jianhui...@zhiyoubao.com>:
> Thank you Shaofeng, The facts as you said, I'm going to serialize the
> build task to avoid this problem, a JIRA will be submitted later
>
> -邮件原件-----
&
hive.ql.parse.SemanticException: Table not
> found kylin_intermediate_DW_ZYB_V_DIM_SCENIC
>
> at
> org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer$
> QualifiedNameUtil.getTab
> leName(DDLSemanticAnalyzer.java:1835)
>
> at
> org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.
> analyzeDescribeTable(DDL
> SemanticAnalyzer.java:1985)
>
> at
> org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.
> analyzeInternal(DDLSeman
> ticAnalyzer.java:316)
>
> at
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.
> analyze(BaseSemanticAna
> lyzer.java:223)
>
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:488)
>
> at
> org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1274)
>
> at
> org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1261)
>
> at
> org.apache.hive.service.cli.operation.SQLOperation.
> prepare(SQLOperation.java
> :134)
>
> ... 26 more
>
>
--
Best regards,
Shaofeng Shi 史少锋
,
>
> I have a question, when i create model(have many measures) ,and run a
> cube base this model
>what store about measures result in hbase , Other Single hbase
> table ?
>
>
>
> apache_...@163.com
>
--
Best regards,
Shaofeng Shi 史少锋
ration> [image: Twitter]
> <https://twitter.com/Xactly> [image: Facebook]
> <https://www.facebook.com/XactlyCorp> [image: YouTube]
> <http://www.youtube.com/xactlycorporation>
>
--
Best regards,
Shaofeng Shi 史少锋
ating Hive version in
> pom.xml file and compile it.
> It seems everything working fine so far.
> Just wondering would you foresee any issue if I do it like this way?
>
--
Best regards,
Shaofeng Shi 史少锋
ER_IDENTIFIER"
> ]
> },
> {
> "name": "REPAIR_TASK_ID",
> "table": "SERVICE_DELIVERY_PART_ORDER_DIM",
> "column": null,
> "derived": [
> "REPAIR_TASK_ID"
> ]
> },
> {
> "name": "TASK_TYPE_INTERNAL_ID",
> "table": "TASK_TYPE_DIM",
> "column": null,
> "derived": [
> "TASK_TYPE_INTERNAL_ID"
> ]
> },
> {
> "name": "TASK_TYPE_INTERNAL_NAME",
> "table": "TASK_TYPE_DIM",
> "column": null,
> "derived": [
> "TASK_TYPE_INTERNAL_NAME"
> ]
> }
> ],
> "measures": [
> {
> "name": "TOTAL_COUNT",
> "function": {
> "expression": "COUNT",
> "parameter": {
> "type": "constant",
> "value": "1"
> },
> "returntype": "bigint"
> }
> },
> {
> "name": "CASE_COUNT",
> "function": {
> "expression": "SUM",
> "parameter": {
> "type": "column",
> "value": "KY_SA_CU_FACT.CASE_COUNT"
> },
> "returntype": "bigint"
> }
> },
> {
> "name": "EVENT_COUNT",
> "function": {
> "expression": "SUM",
> "parameter": {
> "type": "column",
> "value": "KY_SA_CU_FACT.EVENT_COUNT"
> },
> "returntype": "bigint"
> }
> }
> ],
> "dictionaries": [],
> "rowkey": {
> "rowkey_columns": [
> {
> "column": "KY_SA_CU_FACT.EVENT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.CASE_NUMBER",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.ASSET_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.ACCOUNT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.PRODUCT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.LOCATION_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column":
> "KY_SA_CU_FACT.SERVICE_DELIVERY_PART_ORDER_LINE_INTERNAL_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.SERVICE_DELIVERY_TASK_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.SERVICE_DELIVERY_PART_ORDER_INTERNAL_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.TASK_TYPE_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.USER_INT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.CREATED_TIMESTAMP",
> "encoding": "time",
> "isShardBy": false
> },
> {
> "column": "KY_SA_CU_FACT.UPDATE_GMT_TIMESTAMP",
> "encoding": "time",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.ACCOUNT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.ASSET_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.LOCATION_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.CASE_INTERNAL_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.PRODUCT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.CASE_NUMBER",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.ASSET_SERIAL_NUMBER",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.ASSET_COUNTRY_TEXT",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.COUNTRY_NAME",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.COVERAGE_RESPONSE_TEXT",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.ORDER_TYPE_CODE",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.ORIGIN_NAME",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.RECORD_NAME",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.RESOLUTION_CODE",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.SERVICE_PORTFOLIO_TEXT",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.STATUS_TEXT",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.MISSION_CRITICAL_FLAG",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.CREATED_TIMESTAMP",
> "encoding": "time",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.INSERT_GMT_TIMESTAMP",
> "encoding": "time",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.UPDATE_GMT_TIMESTAMP",
> "encoding": "time",
> "isShardBy": false
> },
> {
> "column": "SERVICE_DELIVERY_CASE_DIM.CLOSED_DATE_TIMESTAMP",
> "encoding": "time",
> "isShardBy": false
> },
> {
> "column": "EVENT_DIM.EVENT_ID",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "EVENT_DIM.CASE_NUMBER",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "EVENT_DIM.PROBLEM_AREA",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "EVENT_DIM.PROBLEM_DESCRIPTION",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "EVENT_DIM.CASE_TYPE",
> "encoding": "dict",
> "isShardBy": false
> },
> {
> "column": "EVENT_DIM.SEVERITY_NAME",
> "encoding": "dict",
> "isShardBy": false
> }
> ]
> },
> "hbase_mapping": {
> "column_family": [
> {
> "name": "F1",
> "columns": [
> {
> "qualifier": "M",
> "measure_refs": [
> "TOTAL_COUNT",
> "CASE_COUNT",
> "EVENT_COUNT"
> ]
> }
> ]
> }
> ]
> },
> "aggregation_groups": [
> {
> "includes": [
> "KY_SA_CU_FACT.EVENT_ID",
> "KY_SA_CU_FACT.CASE_NUMBER",
> "KY_SA_CU_FACT.ASSET_ID",
> "KY_SA_CU_FACT.ACCOUNT_ID",
> "KY_SA_CU_FACT.PRODUCT_ID",
> "KY_SA_CU_FACT.LOCATION_ID",
> "KY_SA_CU_FACT.SERVICE_DELIVERY_PART_ORDER_LINE_INTERNAL_ID",
> "KY_SA_CU_FACT.SERVICE_DELIVERY_TASK_ID",
> "KY_SA_CU_FACT.SERVICE_DELIVERY_PART_ORDER_INTERNAL_ID",
> "KY_SA_CU_FACT.TASK_TYPE_ID",
> "KY_SA_CU_FACT.USER_INT_ID"
> ],
> "select_rule": {
> "hierarchy_dims": [],
> "mandatory_dims": [],
> "joint_dims": []
> }
> }
> ],
> "signature": "hSVaBE8XqLJWMa5OvpeANA==",
> "notify_list": [],
> "status_need_notify": [
> "ERROR",
> "DISCARDED",
> "SUCCEED"
> ],
> "partition_date_start": 0,
> "partition_date_end": 31536,
> "auto_merge_time_ranges": [
> 60480,
> 241920
> ],
> "retention_range": 0,
> "engine_type": 2,
> "storage_type": 2,
> "override_kylin_properties": {}
> }
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Apache-Kylin-2-0v-Error-No-model-found-forrel-
> 993-OLAPTableScan-OLAP-tp8409.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
on these approaches ?
>
> Thanks,
> Nirav
>
> On Sat, Jul 8, 2017 at 7:54 AM, ShaoFeng Shi <shaofeng...@apache.org>
> wrote:
>
>> The core modules like core-cube, core-storage are totally independent of
>> HBase; while some others like engine-mr, engine-spark has d
You can define it as "jointed" relationship with the deriving dimension, so
to reduce the cube size.
2017-07-07 21:57 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
> Extended column couldn't be used as filtering condition, because it
> doesn't appear in the HBase rowkey
,ADPOS_NAME,DT_MONTH ) where ADPOS_NAME in
> ('banner2','banner3','wps')
> LIMIT 5
>
>
> my question :
> how to solve multi extended column type dimension as filter condition to
> query?
>
> sincerely yours
>
--
Best regards,
Shaofeng Shi 史少锋
Please do not use JIRA to ask questions. JIRA is for confirmed issue, and
> should be reproducible.
>
>
> 2017-07-05 18:30 GMT+08:00 血染风采 <275041...@qq.com>:
>
> > Ask for help, to help look at this problem
> >
> > https://issues.apache.org/jira/browse/KYLIN-2712
>
--
Best regards,
Shaofeng Shi 史少锋
ooking forward to your reply，thanks.
>
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Lookup-Table-Enumerator-high-memory-tp1397p8384.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
ironment Kylin encountered a problem, because the
> ZookeeperDistributedLock.java
> > file specified kylin lock path, which can not be configured.
>
> > This.zkPathBase = fixSlash ("/ kylin /" + KylinConfig.getInstanceFromEnv
> (). GetMetadataUrlPrefix ());
> > Can I add zk path configuration in subsequent releases?
>
>
>
--
Best regards,
Shaofeng Shi 史少锋
这边遇到了高基数维度构建的问题，比如说userid这种可能会超过1亿的数据量。构建的时候很容易失败，
> 求问kylin有这方面的构建成功的案例吗？
> 我们的集群比较大，但是kylin申请的资源不太合理，很容易出现数据倾斜的情况，一个reduce失败。
>
>
>
> bhbdata2...@gmail.com
>
--
Best regards,
Shaofeng Shi 史少锋
onException: Error creating
> bean
> with name 'userService': Invocation of init method failed; nested exception
> is java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.HTableDescriptor.addFamily(
> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/
> HTableDescriptor;
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/cdh5-4-1-and-apache-kylin-2-0-0-bin-cdh57-can-t-work-together-
> tp8366p8368.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
he.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2035) ... 4
> more
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/cdh5-4-1-and-apache-kylin-2-0-0-bin-cdh57-
> can-t-work-together-tp8366.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
ylin.properties”?
>
> Thanks!
>
>
>
--
Best regards,
Shaofeng Shi 史少锋
*Anmol Ghosh*
> > > [mobile] +917836019775 *|* [skype] anmolghosh007 *|* [linkedIn]
> > > *https://www.linkedin.com/in/anmolghosh
> > > <https://www.linkedin.com/in/anmolghosh>*
> > > [email] anmolghosh2...@gmail.com <anmol.gh...@joshtechnologygroup.com>
> > >
> >
>
> --
>
>
> [image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>
>
> <https://www.nyse.com/quote/XNYS:XTLY> [image: LinkedIn]
> <https://www.linkedin.com/company/xactly-corporation> [image: Twitter]
> <https://twitter.com/Xactly> [image: Facebook]
> <https://www.facebook.com/XactlyCorp> [image: YouTube]
> <http://www.youtube.com/xactlycorporation>
>
--
Best regards,
Shaofeng Shi 史少锋
Global dict couldn't be used for Dimension encoding.
2017-06-23 15:52 GMT+08:00 Alberto Ramón <a.ramonporto...@gmail.com>:
> Global dict can be used for Dim now? or only for measures
>
> On 22 June 2017 at 07:06, Shaofeng SHI (JIRA) <j...@apache.org> wrote:
>
> > S
lin/kylin_metadata/
> kylin-63afefb3-bada-4e64-93a9-fbed446f7b5b/c_tourist_city/cuboid/
> -jobname Kylin_Cube_Builder_c_tourist_city -cubingJobId
> 63afefb3-bada-4e64-93a9-fbed446f7b5b","interrupt_cmd":
> null,"exec_start_time":1495701151507,"exec_end_time":
> 1495701
t;
> + }
>
> 2,org.apache.calcite.adapter.enumerable.EnumerableRelImplementor
>
> line 159 return Expressions.classDecl(Modifier.PUBLIC,
>
> -line 160 "Baz",
>
> +line 160 "Baz"+System.currentTimeMillis(),
>
> line 161 null,
>
> line 162 Collections.singletonList(Bindable.class),
>
> line 163 memberDeclarations);
>
--
Best regards,
Shaofeng Shi 史少锋
Store.createResourceStore(
> ResourceStore.java:99)
> at org.apache.kylin.common.persistence.ResourceStore.
> getStore(ResourceStore.java:110)
> at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:820)
> at org.apache.kylin.cube.CubeManager.loadAllCubeInstance(
> CubeManager.java:740)
> at org.apache.kyl
Thank you for your suggestion, Shaofeng Shi, I try to use hadoop client
> 2.7.3, it worked. But I met another probelm:
> -- --
> -- --
> 17/06/21 20:20:39 WARN TaskSetManager: Lost task 0.0 in stage
n_metadata/
>
> Is it safe to delete these folders manually and how to cleanup with kylin?
>
> Thanks.
>
>
--
Best regards,
Shaofeng Shi 史少锋
-4-amd64 #1 SMP Debian 3.2.82-1 x86_64 GNU/Linux
> -
>
> 2017-06-20
>
> skyyws
>
>
>
> 发件人：ShaoFeng Shi <shaofeng...@apache.org>
> 发送时间：2017-06-20 00:10
> 主题：Re: Build sample error with spark on kylin 2.0.0
> 收件人："dev"<de
1)
> org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
> How is it happened? How can I fixed the issue? Please help me.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Build-Cube-via-Spark-Engine-tp8274.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
execute ./check-env.sh,
> >
> >
> > [hadoop@hadoop10 bin]$ ./check-env.sh
> > Retrieving hadoop conf dir...
> > /home/bigdata/kylin/current/hadoop-conf is override as the
> > kylin_hadoop_conf_dir
> > KYLIN_HOME is set to /home/hadoop/bigdata/kylin/current
> > -mkdir: java.net.UnknownHostException: cdh5
> > Usage: hadoop fs [generic options] -mkdir [-p] ...
> > Failed to create /kylin20. Please make sure the user has right to
> > access /kylin20
> >
> >
> > My HDFS with HA， fs.defaultFS is "cdh5"，when I don't set
> > "kylin.env.hadoop-conf-dir", and use HADOOP_CONF_DIR, HIVE_CONF,
> > HBASE_CONF_DIR from envionment variables （/etc/profile）， it was correct.
> >
> >
> > Best Regards!
> > lxw
> >
>
--
Best regards,
Shaofeng Shi 史少锋
entation.createAsyncProcess(ConnectionManager.java:2433)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$
> HConnectionImplementation.(ConnectionManager.java:712)
> at
> org.apache.hadoop.hbase.client.ConnectionManager$
> HConnectionImplementation.(ConnectionManager.java:652)
> ... 33 more
>
>
> Do you have any idea about that?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Is-kylin-support-kerberos-while-using-cube-connecting-to-HBASE-
> tp8028p8268.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
> var textFile = sc.textFile("hdfs:////README.md")
> textFile.count()
> textFile.first()
> textFile.filter(line => line.contains("hello")).count()
>
> -
> Here is the env info:
> kylin version is 2.0.0
> hadoop version is 2.7.*
> spark version is 1.6.*
>
> -
> Anyone can help me?THX
>
>
> 2017-06-19
> skyyws
--
Best regards,
Shaofeng Shi 史少锋
e/lock/
>
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/kylin2-0-0-streaming-build-pending-tp8202p8206.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
t; }
> }
>
> Thus do you have any idea about what should I do to solve this problem?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Is-kylin-support-kerberos-while-using-cube-connecting-to-HBASE-
> tp8028p8241.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
-MS-SSAS-tp8148.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
4 more
>
>
> I had configured this option in hbase-site.xml:
>
> hbase.fs.tmp.dir
> hdfs://master:9000/hbase/tmp/hadoop-staging
>
> i have tried these configurations
>
>
> I had even configured this option in kylin_job_conf.xm
oller.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1807)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:169)
>
> According to others' suggest,i had copy jars which in hadoop-2.8.0 to
> hbase-1.2.5,but the problem is still not resolved.
>
> How can we solve the problem?
>
> Thanks a lot.
>
--
Best regards,
Shaofeng Shi 史少锋
t; at java.lang.Thread.run(Thread.java:745)
>
> I don't know why this happened, I need your help. Thanks.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Failed-to-find-metadata-store-when-cubing-by-spark-tp8167.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
ache-kylin.74782.x6.
> nabble.com/Sample-Cube-Build-fail-at-Step-3-tp8134p8137.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
gt; 如果需要修改cube以增加新的维度，这时候就需要先purge这个cube。
> 但是这个cube已经存在一段时间，如果只能purge后才能修改cube，那只能修改后重新build整个cube，这期间可能需要很长时间，而且这段时间cube
> 处于不可用状态，相当于终止服务。
> 其实很多场景下能够接受历史数据不包含新增加的维度或者指标，查询时返回null，但是长时间终止服务
>
>
> 请问这种场景下应该如何处理？。
--
Best regards,
Shaofeng Shi 史少锋
e-File-does-not-exist-hdfs-kylin-spark-
> history-tp8159p8164.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
park.deploy.SparkSubmit$.main(SparkSubmit.
> scala:121)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/File-does-not-exist-hdfs-kylin-spark-history-tp8154.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
6.
> nabble.com/Sample-Cube-Build-fail-at-Step-3-tp8134p8140.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
cube时遇到了一个疑问：
> 下图是我们建立cube中的一个步骤：
>
> 这里我们尝试用建立多个ag group来降维（因为实际情况远远比这复杂，所以mandatory和hierarchy不足够完全帮我们解
> 决这个点），但build之后得到的结果如下：
>
> 我期望得到两个cuboid但却只有一个（第一个），请问这过程中有哪部分出了问题？
>
> 谢谢！
>
--
Best regards,
Shaofeng Shi 史少锋
gt; history-segment-without-purge-data-tp8138.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
05)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<
> init>(RetryingHMSHandler.java:78)
> ... 41 more
>
> result code:2
>
>
> Please Help!
>
> Thank you!
> Barry Han
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Sample-Cube-Build-fail-at-Step-3-tp8134.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
Don't forget to use the IP address with your environment's.
2017-05-31 9:42 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
> Hi Tokayer,
>
> Yes it works; I just verified that works, the only additional work is
> copying one property from /etc/hbase/conf.dist/hbase-site.x
ontact the sender and
> delete the material from your computer.
>
--
Best regards,
Shaofeng Shi 史少锋
Shaofeng SHI created KYLIN-2651:
---
Summary: Couldn't find global dict index file
Key: KYLIN-2651
URL: https://issues.apache.org/jira/browse/KYLIN-2651
Project: Kylin
Issue Type: Bug
8088.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
hat's the problem? Help.
>
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Resume-Job-Error-Step1-Step-Name-Create-
> Intermediate-Flat-Hive-Table-tp8105.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
op.hdfs.DistributedFileSystem.access$
> > 000(DistributedFileSystem.java:106)
> > at org.apache.hadoop.hdfs.DistributedFileSystem$19.
> > doCall(DistributedFileSystem.java:1215)
> > at org.apache.hadoop.hdfs.DistributedFileSystem$19.
> > doCall(DistributedFileSystem.java:1211)
> > at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(
> > FileSystemLinkResolver.java:81)
> > at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(
> > DistributedFileSystem.java:1211)
> > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1413)
> > at org.apache.kylin.storage.hbase.steps.
> > HDFSPathGarbageCollectionStep.dropHdfsPathOnCluster(
> > HDFSPathGarbageCollectionStep.java:85)
> > at org.apache.kylin.storage.hbase.steps.
> > HDFSPathGarbageCollectionStep.doWork(HDFSPathGarbageCollectionStep.
> > java:65)
> > at org.apache.kylin.job.execution.AbstractExecutable.
> > execute(AbstractExecutable.java:124)
> > ... 6 more
> >
> >
> >
> > --
> > This message was sent by Atlassian JIRA
> > (v6.3.15#6346)
> >
>
--
Best regards,
Shaofeng Shi 史少锋
Hi John, please check: https://kylin.apache.org/community/
在 2017年5月27日 上午11:41，john-126 <xiongnan...@126.com>写道：
> 如何退订邮件，谢谢！
>
>
>
> --
>
> Best regards！
>
> John.xiong
>
>
>
>
--
Best regards,
Shaofeng Shi 史少锋
ed-KYLIN-2638-Cannot-install-Kylin-tp8057p8076.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
Hi Zhang Lei,
Did you solve the problem?
2017-05-17 17:13 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
> Kylin runs good with EMR 5.5 on AWS Oregon zone, I verfied that today;
> also Spark engine runs well.
>
> 2017-05-16 23:02 GMT+08:00 ShaoFeng Shi <shaofeng...@apa
ConnectionManager$HConnectionImplementation:
> Closing
> master protocol: MasterService
> 17/05/23 17:26:04 INFO SparkContext: Invoking stop() from shutdown hook
> 17/05/23 17:26:04 INFO ConnectionManager$HConnectionImplementation:
> Closing
> zookeeper sessionid=0x15c204d83ab
>
> Could you help me? Thand you!
>
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/It-does-not-work-use-Kylin-2-0-spark-1-5-2-
> hadoop-2-7-tp8073.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
O_CHAR, (If I remove to_char, SUBSTR still not found).
>
> Is there any plane to support these transform functions?
> Or what alternative way can I choose?
>
> Thank you!
>
--
Best regards,
Shaofeng Shi 史少锋
d和year
> *生成CUBE，共700M。*
>
> 按理解，聚合方案1应该产生更多的CUBOID，聚合方案2应该产生更少的CUBOID，当不明白为什么聚合方案2的数据量更大呢？
>
> 谢谢！
>
>
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/-tp8046.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
--
Best regards,
Shaofeng Shi 史少锋
p://kylin.apache.org/blog/2015/08/15/fast-cubing/
> Is this algorithm named "Fast Algorithm" a "In-Mem" algorithm??
>
> Best Regards,
> Bartt
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/IN-MEM-Algorithm-how-it-works-tp8069.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
,but Kylin official website advise that use version
> 5.7/5.8,what should I do?
>
> for CDH 5.7/5.8 - apache-kylin-2.0.0-bin-cdh57.tar.gz [asc] [md5]
>
>
>
>
> Kérjük, gondoljon a környezetére, mielőtt kinyomtatja ezt a levelet!
> Please think of environment before printing this e-mail!
>
--
Best regards,
Shaofeng Shi 史少锋
Shaofeng SHI created KYLIN-2633:
---
Summary: Upgrade Spark to 2.x
Key: KYLIN-2633
URL: https://issues.apache.org/jira/browse/KYLIN-2633
Project: Kylin
Issue Type: Improvement
a:64)
> > at org.apache.spark.scheduler.ShuffleMapTask.runTask(
> > ShuffleMapTask.scala:73)
> > at org.apache.spark.scheduler.ShuffleMapTask.runTask(
> > ShuffleMapTask.scala:41)
> > at org.apache.spark.scheduler.Task.run(Task.scala:89)
> > at org.apache.spark.executor.Executor$TaskRunner.run(
> > Executor.scala:227)
> > at java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.IllegalArgumentException: File not exist by
> > 'kylin_metadata@hbase': /mnt/disk2/yarn/nm/usercache/
> > kylin/appcache/application_1493867056374_0598/container_
> > e21_1493867056374_0598_01_02/kylin_metadata@hbase
> > at org.apache.kylin.common.persistence.FileResourceStore.
> > (FileResourceStore.java:49)
> > ... 29 more
> >
> >
>
--
Best regards,
Shaofeng Shi 史少锋
Hi Zuoran, did you check Spark history server to see what's wrong in the
executors? Is your kylin running it on a cluster and some nodes couldn't
connect with hbase, or the "hbase-site.xml" uses address that couldn't
visit from external nodes? Please do a check.
2017-05-17 13:40 GMT+08:00 吕卓然
The mailing list filters attachement. Could you please paste it directly,
or share it with gist?
2017-05-17 12:17 GMT+08:00 吕卓然 <lvzhuo...@fosun.com>:
> Hi Shaofeng,
>
>
>
> I’ve attached the error log in the attachment..
>
>
>
>
>
>
>
>
>
>
&
java:1142)
>
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
>
>
> Any suggestions would help.
>
>
>
> Thanks,
>
> Zhuoran
>
--
Best regards,
Shaofeng Shi 史少锋
Hi Lei,
How did you create the EMR cluster? did you select "HCatalog" component?
2017-05-15 17:38 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
> ok the script looks good, thanks lei; I will check that.
>
> 2017-05-15 13:51 GMT+08:00 张磊 <121762...@qq.com>:
&g
; problem, I will write it down here.
> Thanks a lot!
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Connecting-with-Kylin-to-CDH-from-another-
> computer-tp7979p8005.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
Some of my cents: usually Kylin runs on a Hadoop client node (or say edge
node). You just need install Hadoop/Hive/HBase client binary and jars with
the proper *-site.xml files (core-site.xml, yarn-site.xml, hive-site.xml,
hbase-site.xml) there. Then Kylin will try to locate these configurations
.kylin.cube.inmemcubing.ConcurrentDiskStore$Writer$1.
> write(ConcurrentDiskStore.java:298)
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) at
> java.io.FilterOutputStream.close(FilterOutputStream.java:158) at
> java.io.FilterOutputStream.close(FilterOutputStream.java:159) ... 7 more
> Container killed by the ApplicationMaster. Container killed on request.
> Exit code is 143 Container exited with a non-zero exit code 143Regards,
> Suresh
>
--
Best regards,
Shaofeng Shi 史少锋
OME:-/usr/lib/zookeeper}
> export HBASE_CLASSPATH=$HADOOP_CONF:$HADOOP_HOME/*:$HADOOP_HOME/
> lib/*:$ZOOKEEPER_HOME/*:$ZOOKEEPER_HOME/lib/*:$HBASE_CLASSPATH
>
>
> exec /usr/lib/hbase/bin/hbase "$@"
>
>
>
>
>
> -- 原始邮件 --
> 发件
0.8.4, HBase 1.3.0, ZooKeeper 3.4.10, Spark
> 2.1.0, HCatalog 2.1.1
>
>
>
> -- 原始邮件 ------
> 发件人: "ShaoFeng Shi";<shaofeng...@apache.org>;
> 发送时间: 2017年5月15日(星期一) 上午9:39
> 收件人: "dev"<dev@kylin.apache.org>;
>
&
op.hive.ql.
> session.SessionState
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1858)
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1701)
> ... 10 more
--
Best regards,
Shaofeng Shi 史少锋
>写道：
> Dear All:
>史少峰大牛在1024大数据峰会上提出“Kylin提供了一个工具，几分钟就可以将一个Cube从Staging环境迁移到Prod
> uction环境”。想请问下是什么工具，如何获取。谢谢
--
Best regards,
Shaofeng Shi 史少锋
b/zookeeper}
> export HBASE_CLASSPATH=$HADOOP_CONF:$HADOOP_HOME/*:$HADOOP_HOME/
> lib/*:$ZOOKEEPER_HOME/*:$ZOOKEEPER_HOME/lib/*:$HBASE_CLASSPATH
>
>
> exec /usr/lib/hbase/bin/hbase "$@"
>
>
>
> I find HBASE_CLASSPATH is appended
>
>
>
>
>
>
>
&g
t; 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
> meizu.com
>
>
> *From:* 赵天烁 <zhaotians...@meizu.com>
> *Date:* 2017-05-04 17:59
> *To:* ShaoFeng Shi <shaofeng...@apache.org>; user <u
.lang.ClassNotFoundException:
> org.apache.hadoop.hive.ql.session.SessionStateat
> org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1858) at org.apache.catalina.loader.
> WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1701) ... 10
> more
--
Best regards,
Shaofeng Shi 史少锋
file new JIRA for
> this one.
>
> 2017-05-06 22:58 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
>
> > Hi Hong Wei,
> >
> > That's cool, thanks for the update and detail summary!
> >
> > For the issue 2, the workround modifies source code, which ne
at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:103)
> > >..
> > >INFOhive.metastore:602 :Connect to metastore.
> > >INFOcommon.AbstractHadoopJob:506 : tempMetaFileString is
com>:
> Hello
> Boy!
> I want to know How to configure kylin based on cas implementation sso?
> Could you help me?
>
--
Best regards,
Shaofeng Shi 史少锋
Shaofeng SHI created KYLIN-2587:
---
Summary: "Convert Cuboid Data to HFile" failed on EMR 5.5
Key: KYLIN-2587
URL: https://issues.apache.org/jira/browse/KYLIN-2587
Project: Kylin
Issue
onnectionHand
> ler.process(AbstractProtocol.java:625)
> at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.ru
> n(JIoEndpoint.java:316)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadP
> oolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread
> PoolExecutor.java:615)
> at org.apache.tomcat.util.threads.TaskThread$WrappingRunnabl
> e.run(TaskThread.java:61)
> at java.lang.Thread.run(Thread.java:745)
>
>
> --
>
> 赵天烁
>
> Kevin Zhao
>
> *zhaotians...@meizu.com <zhaotians...@meizu.com>*
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
> meizu.com
>
>
--
Best regards,
Shaofeng Shi 史少锋
n previous quarter)
>
> - u...@kylin.apache.org:
> - 270 subscribers (up 52 in the last 3 months):
> - 239 emails sent to list (320 in previous quarter)
>
> ## JIRA activity:
>
> - 164 JIRA tickets created in the last 3 months
> - 151 JIRA tickets closed/resolved in the last 3 months
>
--
Best regards,
Shaofeng Shi 史少锋
Cool! thanks for the update.
2017-05-02 16:19 GMT+08:00 35925...@qq.com <35925...@qq.com>:
> 问题已经找到
> 原因是我的hive中的javax.jdo.option.ConnectionURL 的连接默认字符集为latin1
> mysql中character_set_database 的值为latin1
>而其他值，例如character_set_client、character_set_connection、
>
701 - 800 of 1287 matches
Mail list logo
