Re: 答复: 答复: 答复: snapshot table not update

[ShaoFeng Shi]

Issue created, please subscribe it for update:
https://issues.apache.org/jira/browse/KYLIN-1780

2016-06-12 11:54 GMT+08:00 yubo-...@yolo24.com :

> Yes. All rows in the table changed
>
> 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto:
> ml-node+s74782n4911...@n6.nabble.com]
> 发送时间: 2016年6月12日 11:11
> 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> 主题: Re: 答复: 答复: snapshot table not update
>
> Is the table content changed in between?
>
> 2016-06-12 10:55 GMT+08:00 [hidden
> email] <[hidden
> email]>:
>
> > I updated all the rows.
> >
> > Actually, I dropped the table and created it again.
> >
> > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto:
> > [hidden email]]
> > 发送时间: 2016年6月12日 10:07
> > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> > 主题: Re: 答复: snapshot table not update
> >
> > I checked the code, it is very likely a bug; Before start working on
> that,
> > I want to know what kind of change was made in your lookup table:
> > add/delete record, or update a couple of rows? Thanks.
> >
> > 2016-06-12 9:08 GMT+08:00 [hidden
> > email] <[hidden
> > email]>:
> >
> > > Yes,right
> > >
> > > 发件人: Yang [via Apache Kylin] [mailto:[hidden
> > email]]
> > > 发送时间: 2016年6月12日 6:32
> > > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> > > 主题: Re: snapshot table not update
> > >
> > > To confirm understanding. You built a cube, updated the lookup table in
> > > hive, and built it again. And the second build didn't pick up the
> latest
> > > lookup table. Is that correct?
> > >
> > > On Wed, Jun 8, 2016 at 11:45 AM, [hidden
> > > email] <[hidden
> > > email]>
> > > wrote:
> > >
> > > > I define a loopup table in a cube,when data changed in lookup table,
> > > > snapshot not updated .
> > > >
> > > > I can find logs as below:
> > > >
> > > >
> > > >
> > > > 2016-06-08 11:03:07,443 INFO  [pool-5-thread-7]
> > > lookup.SnapshotManager:181
> > > > :
> > > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd
> > > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true
> > > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7]
> > > lookup.SnapshotManager:187
> > > > :
> > > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08
> > > > 42-432b-be99-2ba2bb1a852d.snapshot
> > > > 2016-06-08 11:03:07,447 INFO  [pool-5-thread-7]
> > > lookup.SnapshotManager:130
> > > > :
> > > > Identical snapshot content org.apache.kylin.dict.lookup.Snap
> > > > shotTable@9652a8b3, reuse existing snapshot at
> > > >
> > >
> >
> /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot
> > > >
> > > >
> > > > --
> > > > View this message in context:
> > > >
> > >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html
> > > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > > >
> > >
> > > 
> > > If you reply to this email, your message will be added to the
> discussion
> > > below:
> > >
> > >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html
> > > To start a new topic under Apache Kylin, email
> > > [hidden email]
> > > To unsubscribe from Apache Kylin, click here<
> > > >.
> > > NAML<
> > >
> >
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> > > >
> > >
> > >
> > > --
> > > View this message in context:
> > >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html
> > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi
> >
> > 
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html
> > To start a new topic under Apache Kylin, email
> > [hidden email]
> > To unsubscribe from Apache Kylin, click here<
> > >.
> > NAML<
> >
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> > >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
> 
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4911.html
> 

答复: 答复: 答复: snapshot table not update

[yubo-...@yolo24.com]

Yes. All rows in the table changed

发件人: ShaoFeng Shi-2 [via Apache Kylin] 
[mailto:ml-node+s74782n4911...@n6.nabble.com]
发送时间: 2016年6月12日 11:11
收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
主题: Re: 答复: 答复: snapshot table not update

Is the table content changed in between?

2016-06-12 10:55 GMT+08:00 [hidden 
email] <[hidden 
email]>:

> I updated all the rows.
>
> Actually, I dropped the table and created it again.
>
> 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto:
> [hidden email]]
> 发送时间: 2016年6月12日 10:07
> 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> 主题: Re: 答复: snapshot table not update
>
> I checked the code, it is very likely a bug; Before start working on that,
> I want to know what kind of change was made in your lookup table:
> add/delete record, or update a couple of rows? Thanks.
>
> 2016-06-12 9:08 GMT+08:00 [hidden
> email] <[hidden
> email]>:
>
> > Yes,right
> >
> > 发件人: Yang [via Apache Kylin] [mailto:[hidden
> email]]
> > 发送时间: 2016年6月12日 6:32
> > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> > 主题: Re: snapshot table not update
> >
> > To confirm understanding. You built a cube, updated the lookup table in
> > hive, and built it again. And the second build didn't pick up the latest
> > lookup table. Is that correct?
> >
> > On Wed, Jun 8, 2016 at 11:45 AM, [hidden
> > email] <[hidden
> > email]>
> > wrote:
> >
> > > I define a loopup table in a cube,when data changed in lookup table,
> > > snapshot not updated .
> > >
> > > I can find logs as below:
> > >
> > >
> > >
> > > 2016-06-08 11:03:07,443 INFO  [pool-5-thread-7]
> > lookup.SnapshotManager:181
> > > :
> > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd
> > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true
> > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7]
> > lookup.SnapshotManager:187
> > > :
> > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08
> > > 42-432b-be99-2ba2bb1a852d.snapshot
> > > 2016-06-08 11:03:07,447 INFO  [pool-5-thread-7]
> > lookup.SnapshotManager:130
> > > :
> > > Identical snapshot content org.apache.kylin.dict.lookup.Snap
> > > shotTable@9652a8b3, reuse existing snapshot at
> > >
> >
> /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot
> > >
> > >
> > > --
> > > View this message in context:
> > >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html
> > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > >
> >
> > 
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html
> > To start a new topic under Apache Kylin, email
> > [hidden email]
> > To unsubscribe from Apache Kylin, click here<
> > >.
> > NAML<
> >
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> > >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
> 
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html
> To start a new topic under Apache Kylin, email
> [hidden email]
> To unsubscribe from Apache Kylin, click here<
> >.
> NAML<
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> >
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



--
Best regards,

Shaofeng Shi


If you reply to this email, your message will be added to the discussion below:
http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4911.html
To start a new topic under Apache Kylin, email ml-node+s74782n1...@n6.nabble.com
To unsubscribe from Apache Kylin, click 
here.

[jira] [Created] (KYLIN-1781) kylin.properties encoding while contain chinese prop key or value

[zhaotianshuo (JIRA)]

zhaotianshuo created KYLIN-1781:
---

 Summary: kylin.properties encoding while contain chinese prop key 
or value
 Key: KYLIN-1781
 URL: https://issues.apache.org/jira/browse/KYLIN-1781
 Project: Kylin
  Issue Type: Bug
  Components: General
Affects Versions: v1.5.1
Reporter: zhaotianshuo


kylin.properties encoding while contain chinese prop key or value
=
situation:
try to configure ldap authentication method,but ldap entry contain chinese 
chars that represent user's role.but roles can not be matched because of the 
encoding error.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1780) Potential issue in SnapshotTable.equas()

[Shaofeng SHI (JIRA)]

Shaofeng SHI created KYLIN-1780:
---

 Summary: Potential issue in SnapshotTable.equas()
 Key: KYLIN-1780
 URL: https://issues.apache.org/jira/browse/KYLIN-1780
 Project: Kylin
  Issue Type: Bug
Reporter: Shaofeng SHI
Assignee: Shaofeng SHI


SnapshotTable.equas()



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Blog to introduce the Diagnosis Tool

[hongbin ma]

cool! hope it could help people more from the community :)

On Sun, Jun 12, 2016 at 11:37 AM, Dong Li  wrote:

> Hello community,
>
>
> I wrote a blog about the Diagnosis functionality introduced since 1.5.2.
>
> http://kylin.apache.org/blog/2016/06/10/diagnosis-tool/
>
>
> Please have a view if you need it.
>
> Thanks,
> Dong
>



-- 
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone

Blog to introduce the Diagnosis Tool

[Dong Li]

Hello community,


I wrote a blog about the Diagnosis functionality introduced since 1.5.2.
http://kylin.apache.org/blog/2016/06/10/diagnosis-tool/


Please have a view if you need it.


Thanks,
Dong

Re: 答复: 答复: snapshot table not update

[ShaoFeng Shi]

Is the table content changed in between?

2016-06-12 10:55 GMT+08:00 yubo-...@yolo24.com :

> I updated all the rows.
>
> Actually, I dropped the table and created it again.
>
> 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto:
> ml-node+s74782n490...@n6.nabble.com]
> 发送时间: 2016年6月12日 10:07
> 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> 主题: Re: 答复: snapshot table not update
>
> I checked the code, it is very likely a bug; Before start working on that,
> I want to know what kind of change was made in your lookup table:
> add/delete record, or update a couple of rows? Thanks.
>
> 2016-06-12 9:08 GMT+08:00 [hidden
> email] <[hidden
> email]>:
>
> > Yes,right
> >
> > 发件人: Yang [via Apache Kylin] [mailto:[hidden
> email]]
> > 发送时间: 2016年6月12日 6:32
> > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> > 主题: Re: snapshot table not update
> >
> > To confirm understanding. You built a cube, updated the lookup table in
> > hive, and built it again. And the second build didn't pick up the latest
> > lookup table. Is that correct?
> >
> > On Wed, Jun 8, 2016 at 11:45 AM, [hidden
> > email] <[hidden
> > email]>
> > wrote:
> >
> > > I define a loopup table in a cube,when data changed in lookup table,
> > > snapshot not updated .
> > >
> > > I can find logs as below:
> > >
> > >
> > >
> > > 2016-06-08 11:03:07,443 INFO  [pool-5-thread-7]
> > lookup.SnapshotManager:181
> > > :
> > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd
> > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true
> > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7]
> > lookup.SnapshotManager:187
> > > :
> > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08
> > > 42-432b-be99-2ba2bb1a852d.snapshot
> > > 2016-06-08 11:03:07,447 INFO  [pool-5-thread-7]
> > lookup.SnapshotManager:130
> > > :
> > > Identical snapshot content org.apache.kylin.dict.lookup.Snap
> > > shotTable@9652a8b3, reuse existing snapshot at
> > >
> >
> /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot
> > >
> > >
> > > --
> > > View this message in context:
> > >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html
> > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > >
> >
> > 
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html
> > To start a new topic under Apache Kylin, email
> > [hidden email]
> > To unsubscribe from Apache Kylin, click here<
> > >.
> > NAML<
> >
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> > >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
> 
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html
> To start a new topic under Apache Kylin, email
> ml-node+s74782n1...@n6.nabble.com
> To unsubscribe from Apache Kylin, click here<
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code=1=eXViby1kczFAeW9sbzI0LmNvbXwxfC0xMTE5OTYzOTg4
> >.
> NAML<
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> >
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Best regards,

Shaofeng Shi

答复: 答复: snapshot table not update

[yubo-...@yolo24.com]

I updated all the rows.

Actually, I dropped the table and created it again.

发件人: ShaoFeng Shi-2 [via Apache Kylin] 
[mailto:ml-node+s74782n490...@n6.nabble.com]
发送时间: 2016年6月12日 10:07
收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
主题: Re: 答复: snapshot table not update

I checked the code, it is very likely a bug; Before start working on that,
I want to know what kind of change was made in your lookup table:
add/delete record, or update a couple of rows? Thanks.

2016-06-12 9:08 GMT+08:00 [hidden 
email] <[hidden 
email]>:

> Yes,right
>
> 发件人: Yang [via Apache Kylin] [mailto:[hidden 
> email]]
> 发送时间: 2016年6月12日 6:32
> 收件人: yubo-ds1(于渤.大数据中心.大数据平台部)
> 主题: Re: snapshot table not update
>
> To confirm understanding. You built a cube, updated the lookup table in
> hive, and built it again. And the second build didn't pick up the latest
> lookup table. Is that correct?
>
> On Wed, Jun 8, 2016 at 11:45 AM, [hidden
> email] <[hidden
> email]>
> wrote:
>
> > I define a loopup table in a cube,when data changed in lookup table,
> > snapshot not updated .
> >
> > I can find logs as below:
> >
> >
> >
> > 2016-06-08 11:03:07,443 INFO  [pool-5-thread-7]
> lookup.SnapshotManager:181
> > :
> > Loading snapshotTable from /table_snapshot/siteidmapping/8bd
> > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true
> > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7]
> lookup.SnapshotManager:187
> > :
> > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08
> > 42-432b-be99-2ba2bb1a852d.snapshot
> > 2016-06-08 11:03:07,447 INFO  [pool-5-thread-7]
> lookup.SnapshotManager:130
> > :
> > Identical snapshot content org.apache.kylin.dict.lookup.Snap
> > shotTable@9652a8b3, reuse existing snapshot at
> >
> /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot
> >
> >
> > --
> > View this message in context:
> >
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
> 
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html
> To start a new topic under Apache Kylin, email
> [hidden email]
> To unsubscribe from Apache Kylin, click here<
> >.
> NAML<
> http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml
> >
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



--
Best regards,

Shaofeng Shi


If you reply to this email, your message will be added to the discussion below:
http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html
To start a new topic under Apache Kylin, email ml-node+s74782n1...@n6.nabble.com
To unsubscribe from Apache Kylin, click 
here.
NAML


--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: How to do DateDiff in Kylin

[ShaoFeng Shi]

Thanks Julian; I added the time unit, there is no SQL syntax error anymore;
Although the diff values are all "+0", it should be Kylin's issue;

Uma, please try the query, if you see the same result, then pls open a JIRA
to Kylin: http://issues.apache.org/jira/secure/Dashboard.jspa

Thanks;

2016-06-12 8:18 GMT+08:00 Julian Hyde :

> You need to include a time unit, e.g. DAY or MONTH or YEAR TO MONTH. The
> syntax is
>
>   (datetime - datetime) timeunit
>
> e.g.
>
>   (d2 - d1) DAY
>   (d2 - d1) YEAR TO MONTH
>
> This has been in Calcite for quite a few releases.
>
>
>
> > On Jun 11, 2016, at 3:27 AM, ShaoFeng Shi 
> wrote:
> >
> > Julian, from which version Calcite supports the minus operation between
> two
> > dates?
> >
> > I tried "select cal_dt, (current_date - cal_dt) as diff from
> kylin_cal_dt"
> > in Kylin, but get this error:
> >
> > Error while executing SQL "select cal_dt, (current_date - cal_dt) as diff
> > from kylin_cal_dt LIMIT 5": From line 1, column 17 to line 1, column
> > 37: Cannot apply '-' to arguments of type ' - '. Supported
> > form(s): ' - ' ' -
> > ' ' - '
> >
> > Kylin uses Calcite 1.6.0 now; Is an upgrade or type cast needed? Thanks!
> >
> > 2016-06-11 6:02 GMT+08:00 Julian Hyde :
> >
> >> In Calcite you can do
> >>
> >>  (currentdate - cal_date) DAYS
> >>
> >> which returns an INTERVAL DAYS value.
> >>
> >> In https://issues.apache.org/jira/browse/CALCITE-1124 we added
> >> TIMESTAMPADD, TIMESTAMPDIFF.
> >>
> >> DATEDIFF is mentioned in
> >> https://issues.apache.org/jira/browse/CALCITE-759 but that has not
> >> been implemented.
> >>
> >> Julian
> >>
> >>
> >> On Fri, Jun 10, 2016 at 7:54 AM, ShaoFeng Shi 
> >> wrote:
> >>> I don't see such a function in Calcite (Kylin's SQL parser):
> >>> https://calcite.apache.org/docs/reference.html#datetime-functions
> >>>
> >>>
> >>> 2016-06-10 10:04 GMT+08:00 Uma Maheshwar Kamuni  >:
> >>>
>  i want make DateDiff between currentdate and cal_date (which contains
> >> date)
> 
>  
>  From: ShaoFeng Shi 
>  Sent: Thursday, June 9, 2016 8:22:08 PM
>  To: dev@kylin.apache.org
>  Subject: Re: How to do DateDiff in Kylin
> 
>  Hi Uma, could you please give a sample SQL with DateDiff?
> 
>  2016-06-09 13:49 GMT+08:00 Uma Maheshwar Kamuni  >:
> 
> > is there any function for DateDiff in Kylin.
> >
> 
> 
> 
>  --
>  Best regards,
> 
>  Shaofeng Shi
> 
> >>>
> >>>
> >>>
> >>> --
> >>> Best regards,
> >>>
> >>> Shaofeng Shi
> >>
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi
>
>


-- 
Best regards,

Shaofeng Shi

[jira] [Created] (KYLIN-1779) Add descriptions to derived dimensions & hierarchy dimensions

[Yinwei Li (JIRA)]

Yinwei Li created KYLIN-1779:


 Summary: Add descriptions to derived dimensions & hierarchy 
dimensions
 Key: KYLIN-1779
 URL: https://issues.apache.org/jira/browse/KYLIN-1779
 Project: Kylin
  Issue Type: New Feature
Reporter: Yinwei Li
Priority: Minor


As we all know, derived dimensions & hierarchy dimensions are followded by hive 
columns, but hive columns' name can not be named in other languages but 
English, If we want to show cube metadata to endusers whose mother tongue is 
other languages such as Chinese, the current version kylin can not supported. 
Add a comment or descripiton field may help.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: How to do DateDiff in Kylin

[Julian Hyde]

You need to include a time unit, e.g. DAY or MONTH or YEAR TO MONTH. The syntax 
is

  (datetime - datetime) timeunit

e.g.

  (d2 - d1) DAY
  (d2 - d1) YEAR TO MONTH

This has been in Calcite for quite a few releases.



> On Jun 11, 2016, at 3:27 AM, ShaoFeng Shi  wrote:
> 
> Julian, from which version Calcite supports the minus operation between two
> dates?
> 
> I tried "select cal_dt, (current_date - cal_dt) as diff from kylin_cal_dt"
> in Kylin, but get this error:
> 
> Error while executing SQL "select cal_dt, (current_date - cal_dt) as diff
> from kylin_cal_dt LIMIT 5": From line 1, column 17 to line 1, column
> 37: Cannot apply '-' to arguments of type ' - '. Supported
> form(s): ' - ' ' -
> ' ' - '
> 
> Kylin uses Calcite 1.6.0 now; Is an upgrade or type cast needed? Thanks!
> 
> 2016-06-11 6:02 GMT+08:00 Julian Hyde :
> 
>> In Calcite you can do
>> 
>>  (currentdate - cal_date) DAYS
>> 
>> which returns an INTERVAL DAYS value.
>> 
>> In https://issues.apache.org/jira/browse/CALCITE-1124 we added
>> TIMESTAMPADD, TIMESTAMPDIFF.
>> 
>> DATEDIFF is mentioned in
>> https://issues.apache.org/jira/browse/CALCITE-759 but that has not
>> been implemented.
>> 
>> Julian
>> 
>> 
>> On Fri, Jun 10, 2016 at 7:54 AM, ShaoFeng Shi 
>> wrote:
>>> I don't see such a function in Calcite (Kylin's SQL parser):
>>> https://calcite.apache.org/docs/reference.html#datetime-functions
>>> 
>>> 
>>> 2016-06-10 10:04 GMT+08:00 Uma Maheshwar Kamuni :
>>> 
 i want make DateDiff between currentdate and cal_date (which contains
>> date)
 
 
 From: ShaoFeng Shi 
 Sent: Thursday, June 9, 2016 8:22:08 PM
 To: dev@kylin.apache.org
 Subject: Re: How to do DateDiff in Kylin
 
 Hi Uma, could you please give a sample SQL with DateDiff?
 
 2016-06-09 13:49 GMT+08:00 Uma Maheshwar Kamuni :
 
> is there any function for DateDiff in Kylin.
> 
 
 
 
 --
 Best regards,
 
 Shaofeng Shi
 
>>> 
>>> 
>>> 
>>> --
>>> Best regards,
>>> 
>>> Shaofeng Shi
>> 
> 
> 
> 
> -- 
> Best regards,
> 
> Shaofeng Shi

Re: How to name derived dimensions & hierarchy dimensions in Chinese

[Li Yang]

The rule of thumb is: who want it, who build it. You can open a JIRA first.

On Wed, Jun 8, 2016 at 5:44 PM, 251469031 <251469...@qq.com> wrote:

> Thank you for you suggestion.
>
>
> Whether kylin will add a description to derived & hierarchy dimensions in
> the future or not?
>
>
>
>
>
>
> -- 原始邮件 --
> 发件人: "Li Yang";;
> 发送时间: 2016年6月8日(星期三) 下午5:34
> 收件人: "dev";
>
> 主题: Re: How to name derived dimensions & hierarchy dimensions in Chinese
>
>
>
> You can have a name mapping outside of Kylin.
>
> On Wed, Jun 8, 2016 at 10:47 AM, 251469031 <251469...@qq.com> wrote:
>
> > Hi all:
> >
> >
> > I want to display the cube metadata by calling the RESTful API of
> > kylinhost:7070/api/cubes/{cubeName} so that the  endusers can know the
> cube
> > details, as the endusers' mother tongue is Chinese, so I want to set the
> > CubeName, Dimension Name( including derived dimensions & hierarchy
> > dimensions)  and messures name can be in Chinese.
> >
> >
> > But as we know, the derived dimensions & hierarchy dimensions is
> > followed by hive columns and hive columns can not be set to Chinese, so
> > would you tell me how to name derived dimensions & hierarchy dimensions
> in
> > Chinese.
>

Re: snapshot table not update

[Li Yang]

To confirm understanding. You built a cube, updated the lookup table in
hive, and built it again. And the second build didn't pick up the latest
lookup table. Is that correct?

On Wed, Jun 8, 2016 at 11:45 AM, yubo-...@yolo24.com 
wrote:

> I define a loopup table in a cube,when data changed in lookup table,
> snapshot not updated .
>
> I can find logs as below:
>
>
>
> 2016-06-08 11:03:07,443 INFO  [pool-5-thread-7] lookup.SnapshotManager:181
> :
> Loading snapshotTable from /table_snapshot/siteidmapping/8bd
> d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true
> 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] lookup.SnapshotManager:187
> :
> Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08
> 42-432b-be99-2ba2bb1a852d.snapshot
> 2016-06-08 11:03:07,447 INFO  [pool-5-thread-7] lookup.SnapshotManager:130
> :
> Identical snapshot content org.apache.kylin.dict.lookup.Snap
> shotTable@9652a8b3, reuse existing snapshot at
> /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot
>
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>

Re: select * from fact_table

[Luke Han]

Cool Xiaoyu!


Best Regards!
-

Luke Han

On Wed, Jun 8, 2016 at 10:57 AM, Li Yang  wrote:

> Yeah~~ Thanks Xiaoyu!
>
> On Sun, Jun 5, 2016 at 8:47 PM, 王晓雨  wrote:
>
> > I add a document about RAW measure.
> > see:
> > http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/
> >
> > 在 2016年5月26日，11:08，王晓雨 >
> 写道：
> >
> > Comming soon!
> >
> > 在 2016年05月26日 11:02, Mars J 写道:
> > I'm looking forward the documents too~
> >
> > 2016-05-26 9:48 GMT+08:00 赵天烁  zhaotians...@meizu.com>>:
> >
> > Waiting for the release note~
> >
> > -
> >
> > 赵天烁
> > Kevin Zhao
> > Java工程师
> > 研发中心-Flyme-大数据-平台研发
> > + 86 18826908281 | zhaotians...@meizu.com
> >
> > 珠海市魅族科技有限公司
> > MEIZU Technology Co., Ltd.
> > 广东省珠海市科技创新海岸魅族科技楼
> > MEIZU Tech Bldg., Technology & Innovation Coast
> > Zhuhai, 519085, Guangdong, China
> >
> >
> > meizu.com
> >
> >
> >
> > -邮件原件-
> > 发件人: lidong [mailto:lid...@apache.org]
> > 发送时间: 2016年5月26日 9:48
> > 收件人: dev@kylin.apache.org
> > 主题: Re: 答复: select * from fact_table
> >
> > It’s under voting currently.
> >
> >
> >
> http://apache-kylin.74782.x6.nabble.com/VOTE-Release-apache-kylin-1-5-2-release-candidate-3-td4672.html
> > If the vote got passed in 72 hrs, the binary release will roll out soon.
> >
> >
> > Thanks,
> > Dong
> >
> >
> > Original Message
> > Sender:赵天烁zhaotians...@meizu.com
> > Recipient:dev@kylin.apache.org...@kylin.apache.org
> > Date:Thursday, May 26, 2016 09:21
> > Subject:答复: select * from fact_table
> >
> >
> > Seems like already,
> > https://github.com/apache/kylin/releases/tag/kylin-1.5.2
> > - 赵天烁 Kevin Zhao
> > Java工程师 研发中心-Flyme-大数据-平台研发 + 86 18826908281 | zhaotians...@meizu.com
> > 珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech
> Bldg.,
> > Technology  Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com
> > -邮件原件- 发件人: Mars J [mailto:xujiao.myc...@gmail.com] 发送时间:
> > 2016年5月26日 9:16 收件人: dev@kylin.apache.org 主题: Re: select * from
> > fact_table when 1.5.2 release ? 2016-05-22 13:28 GMT+08:00 Li Yang
> > liy...@apache.org:  The coming 1.5.2 release has this fixed. Before
> that,
> > please specify  the aggregation function or use group by clause.   On
> Wed,
> > May 18, 2016 at 3:16 PM, Mars J xujiao.myc...@gmail.com wrote:Hello
> > all,   after build a cube , using the sql select * from fact_table, it
> >  will not return actual fact table data but rather the follow one,I
>  have
> > define 3   measure include count/min/raw [image: 内嵌图片 1] DIMA_ID
> > and DIMC_ID are dimension columns defined in model   dimensions  step.
> >  Why 'select * from fact_table' doesn't return real fact data ? how   to
> > query the all fact data ?
> >
> >
> >
> >
>

Re: kylin.war not deployed correctly with version 1.5

[Luke Han]

If you have installed v1.2/v1.3 and now you directly install v1.5.x, you
should very carefully to check the metadata URI to make sure it points to
right one (ensure the new instance, say v1.5.x will not use old one).

Thanks.


Best Regards!
-

Luke Han

On Fri, Jun 10, 2016 at 10:31 PM, Jie Tao  wrote:

> I find another error in localhost.log. This may be related. Is
> kylin_metadata in Hbase created during deploying kylin.war? Is this the
> real reson that the ip:7070/kylin gets stuck?
>
>
>
> Jun 10, 2016 4:17:11 PM org.apache.catalina.core.StandardContext
> listenerStart
> fatal: Exception sending context initialized event to listener instance of
> class org.springframework.web.context.ContextLoaderListener
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'cacheService': Invocation of init method failed; nested
> exception is java.lang.IllegalArgumentException: Failed to find metadata
> store by url: kylin_metadata@hbase
>
> Cheers,
>
> Jie
>
>
> Am 10.06.2016 um 15:46 schrieb Jie Tao:
>
>> sorry! There do have problems in catalina.log:
>>
>> INFORMATION: Starting service Catalina
>> .
>> INFORMATION: Deploying web application archive
>> /home/bi-operator/apache-kylin-1.5.2.1-bin/tomcat/webapps/kylin.war
>>
>> .
>> Jun 10, 2016 2:46:30 PM org.apache.catalina.core.StandardContext
>> startInternal
>>
>> fatal: Error listenerStart
>>
>> fatal: Context [/kylin] startup failed due to previous errors
>>
>> fatal: The web application [/kylin] appears to have started a thread
>> named [localhost-startStop-1-SendThread(our-zookeeper:2181)] but has failed
>> to stop it. This is very likely to create a memory leak.
>>
>> So: kylin is not correctly deployed. How to solve this problem?
>>
>>
>> Cheers,
>>
>> Jie
>>
>> Am 10.06.2016 um 15:11 schrieb Jie Tao:
>>
>>> I tried on a cluster of apache BIGTOP installation with Hadoop 2.4.1,
>>> hive 0.13.1 and HBase 0.98.5-hadoop2. Kylin is started and there is no
>>> exception in either catalina.log or kylin.log. But: the URL
>>> http://10.106.4.10:7070/kylin/ keeps connecting and after some time (I
>>> guess it is timeout) it shows:
>>>
>>> Firefox can't establish a connection to the server at
>>> my-kylin-server-ip:8080
>>>
>>> As 8080 is the TOMCAT port number, so I guess that TOMCAT does not work
>>> correctly. How can I further debug this issue? In catalina.log I only see
>>> infos like:
>>>
>>> INFORMATION: Starting service Catalina
>>> Jun 10, 2016 2:50:36 PM org.apache.catalina.core.StandardEngine
>>> startInternal
>>> INFORMATION: Starting Servlet Engine: Apache Tomcat/7.0.59
>>> Jun 10, 2016 2:50:36 PM org.apache.catalina.startup.HostConfig deployWAR
>>> INFORMATION: Deploying web application archive
>>> /home/bi-operator/apache-kylin-1.5.2.1-bin/tomcat/webapps/kylin.war
>>>
>>> By the way, Kylin 1.3 runs well with my environment. Maybe something
>>> others with kylin 1.5 related to TOMCAT?
>>>
>>> Cheers,
>>>
>>> Jie
>>>
>>> Am 07.06.2016 um 08:40 schrieb Jie Tao:
>>>
 Thanks for the reply. The same error is in kylin.log. I think it is
 version conflict. I will try on another Hadoop version and see if the same
 happens.

 Cheers,

 Jie

 Am 07.06.2016 um 02:39 schrieb Li Yang:

> The log is not related. What's in the kylin.out?
>
> On Mon, May 30, 2016 at 10:09 PM, Jie Tao 
> wrote:
>
> after starting Kylin this URL (http://localhost:7070/kylin/) keeps
>> connecting to local host but shows nothing. This happened with 1.5.0,
>> 1.5.1
>> and 1.5.2. In catalina.log there is a warning:
>> java.io.FileNotFoundException:
>> /home/tao/hadoop-2.7.1/contrib/capacity-scheduler/*.jar not found.
>> After
>> the warning there is no further log information.
>>
>> But the same warning can be seen with version 1.2, where after the
>> warning
>> I see:
>> INFORMATION: Deployment of web application archive
>> /home/tao/apache-kylin-1.2-bin/tomcat/webapps/kylin.war has finished
>> in
>> 12,411 ms
>>
>> I earlier tested version 1.2 using the sample cube. Then I installed
>> version 1.5 on the same hadoop. Hbase and Hive environment. This
>> means that
>> Hive and Hbase already contain data from testing v1.2. Can this be a
>> problem? I have: hbase-0.98.17-hadoop2 and Hive 0.13.0, hadoop 2.7.1.
>>
>> The following is the detail in catalina.log:
>>
>> INFORMATION: Deploying web application archive
>> /home/tao/Downloads/apache-kylin-1.5.2-bin/tomcat/webapps/kylin.war
>> Mai 30, 2016 3:48:59 PM
>> org.apache.tomcat.util.scan.StandardJarScanner scan
>> WARNING: Failed to scan
>> [file:/home/tao/hadoop-2.7.1/contrib/capacity-scheduler/*.jar] from
>> classloader hierarchy
>> java.io.FileNotFoundException:
>> /home/tao/hadoop-2.7.1/contrib/capacity-scheduler/*.jar (file 

Re: How to do DateDiff in Kylin

[ShaoFeng Shi]

Julian, from which version Calcite supports the minus operation between two
dates?

I tried "select cal_dt, (current_date - cal_dt) as diff from kylin_cal_dt"
in Kylin, but get this error:

Error while executing SQL "select cal_dt, (current_date - cal_dt) as diff
from kylin_cal_dt LIMIT 5": From line 1, column 17 to line 1, column
37: Cannot apply '-' to arguments of type ' - '. Supported
form(s): ' - ' ' -
' ' - '

Kylin uses Calcite 1.6.0 now; Is an upgrade or type cast needed? Thanks!

2016-06-11 6:02 GMT+08:00 Julian Hyde :

> In Calcite you can do
>
>   (currentdate - cal_date) DAYS
>
> which returns an INTERVAL DAYS value.
>
> In https://issues.apache.org/jira/browse/CALCITE-1124 we added
> TIMESTAMPADD, TIMESTAMPDIFF.
>
> DATEDIFF is mentioned in
> https://issues.apache.org/jira/browse/CALCITE-759 but that has not
> been implemented.
>
> Julian
>
>
> On Fri, Jun 10, 2016 at 7:54 AM, ShaoFeng Shi 
> wrote:
> > I don't see such a function in Calcite (Kylin's SQL parser):
> > https://calcite.apache.org/docs/reference.html#datetime-functions
> >
> >
> > 2016-06-10 10:04 GMT+08:00 Uma Maheshwar Kamuni :
> >
> >> i want make DateDiff between currentdate and cal_date (which contains
> date)
> >>
> >> 
> >> From: ShaoFeng Shi 
> >> Sent: Thursday, June 9, 2016 8:22:08 PM
> >> To: dev@kylin.apache.org
> >> Subject: Re: How to do DateDiff in Kylin
> >>
> >> Hi Uma, could you please give a sample SQL with DateDiff?
> >>
> >> 2016-06-09 13:49 GMT+08:00 Uma Maheshwar Kamuni :
> >>
> >> > is there any function for DateDiff in Kylin.
> >> >
> >>
> >>
> >>
> >> --
> >> Best regards,
> >>
> >> Shaofeng Shi
> >>
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi
>



-- 
Best regards,

Shaofeng Shi