Re: 答复: 答复: 答复: snapshot table not update
Issue created, please subscribe it for update: https://issues.apache.org/jira/browse/KYLIN-1780 2016-06-12 11:54 GMT+08:00 yubo-...@yolo24.com <yubo-...@yolo24.com>: > Yes. All rows in the table changed > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > ml-node+s74782n4911...@n6.nabble.com] > 发送时间: 2016年6月12日 11:11 > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > 主题: Re: 答复: 答复: snapshot table not update > > Is the table content changed in between? > > 2016-06-12 10:55 GMT+08:00 [hidden > email] <[hidden > email]>: > > > I updated all the rows. > > > > Actually, I dropped the table and created it again. > > > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > > [hidden email]] > > 发送时间: 2016年6月12日 10:07 > > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > > 主题: Re: 答复: snapshot table not update > > > > I checked the code, it is very likely a bug; Before start working on > that, > > I want to know what kind of change was made in your lookup table: > > add/delete record, or update a couple of rows? Thanks. > > > > 2016-06-12 9:08 GMT+08:00 [hidden > > email] <[hidden > > email]>: > > > > > Yes,right > > > > > > 发件人: Yang [via Apache Kylin] [mailto:[hidden > > email]] > > > 发送时间: 2016年6月12日 6:32 > > > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > > > 主题: Re: snapshot table not update > > > > > > To confirm understanding. You built a cube, updated the lookup table in > > > hive, and built it again. And the second build didn't pick up the > latest > > > lookup table. Is that correct? > > > > > > On Wed, Jun 8, 2016 at 11:45 AM, [hidden > > > email] <[hidden > > > email]> > > > wrote: > > > > > > > I define a loopup table in a cube,when data changed in lookup table, > > > > snapshot not updated . > > > > > > > > I can find logs as below: > > > > > > > > > > > > > > > > 2016-06-08 11:03:07,443 INFO [pool-5-thread-7] > > > lookup.SnapshotManager:181 > > > > : > > > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd > > > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true > > > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] > > > lookup.SnapshotManager:187 > > > > : > > > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08 > > > > 42-432b-be99-2ba2bb1a852d.snapshot > > > > 2016-06-08 11:03:07,447 INFO [pool-5-thread-7] > > > lookup.SnapshotManager:130 > > > > : > > > > Identical snapshot content org.apache.kylin.dict.lookup.Snap > > > > shotTable@9652a8b3, reuse existing snapshot at > > > > > > > > > > /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot > > > > > > > > > > > > -- > > > > View this message in context: > > > > > > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html > > > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > > > > > > > > If you reply to this email, your message will be added to the > discussion > > > below: > > > > > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html > > > To start a new topic under Apache Kylin, email > > > [hidden email] > > > To unsubscribe from Apache Kylin, click here< > > > >. > > > NAML< > > > > > > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > > > > > > > > > -- > > > View this message in context: > > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html > > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > > > > > > -- > > Best regards, > > > > Shaofeng Shi > > > > > > If you reply to this email, your message will be added to the discussion > > below: > > > > > http://apache-kylin.74782.x6
答复: 答复: 答复: snapshot table not update
Yes. All rows in the table changed 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto:ml-node+s74782n4911...@n6.nabble.com] 发送时间: 2016年6月12日 11:11 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) 主题: Re: 答复: 答复: snapshot table not update Is the table content changed in between? 2016-06-12 10:55 GMT+08:00 [hidden email] <[hidden email]>: > I updated all the rows. > > Actually, I dropped the table and created it again. > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > [hidden email]] > 发送时间: 2016年6月12日 10:07 > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > 主题: Re: 答复: snapshot table not update > > I checked the code, it is very likely a bug; Before start working on that, > I want to know what kind of change was made in your lookup table: > add/delete record, or update a couple of rows? Thanks. > > 2016-06-12 9:08 GMT+08:00 [hidden > email] <[hidden > email]>: > > > Yes,right > > > > 发件人: Yang [via Apache Kylin] [mailto:[hidden > email]] > > 发送时间: 2016年6月12日 6:32 > > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > > 主题: Re: snapshot table not update > > > > To confirm understanding. You built a cube, updated the lookup table in > > hive, and built it again. And the second build didn't pick up the latest > > lookup table. Is that correct? > > > > On Wed, Jun 8, 2016 at 11:45 AM, [hidden > > email] <[hidden > > email]> > > wrote: > > > > > I define a loopup table in a cube,when data changed in lookup table, > > > snapshot not updated . > > > > > > I can find logs as below: > > > > > > > > > > > > 2016-06-08 11:03:07,443 INFO [pool-5-thread-7] > > lookup.SnapshotManager:181 > > > : > > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd > > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true > > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] > > lookup.SnapshotManager:187 > > > : > > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08 > > > 42-432b-be99-2ba2bb1a852d.snapshot > > > 2016-06-08 11:03:07,447 INFO [pool-5-thread-7] > > lookup.SnapshotManager:130 > > > : > > > Identical snapshot content org.apache.kylin.dict.lookup.Snap > > > shotTable@9652a8b3, reuse existing snapshot at > > > > > > /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot > > > > > > > > > -- > > > View this message in context: > > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html > > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > > > > If you reply to this email, your message will be added to the discussion > > below: > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html > > To start a new topic under Apache Kylin, email > > [hidden email] > > To unsubscribe from Apache Kylin, click here< > > >. > > NAML< > > > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > > > > > -- > > View this message in context: > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > -- > Best regards, > > Shaofeng Shi > > > If you reply to this email, your message will be added to the discussion > below: > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html > To start a new topic under Apache Kylin, email > [hidden email] > To unsubscribe from Apache Kylin, click here< > >. > NAML< > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regar
Re: 答复: 答复: snapshot table not update
Is the table content changed in between? 2016-06-12 10:55 GMT+08:00 yubo-...@yolo24.com <yubo-...@yolo24.com>: > I updated all the rows. > > Actually, I dropped the table and created it again. > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > ml-node+s74782n490...@n6.nabble.com] > 发送时间: 2016年6月12日 10:07 > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > 主题: Re: 答复: snapshot table not update > > I checked the code, it is very likely a bug; Before start working on that, > I want to know what kind of change was made in your lookup table: > add/delete record, or update a couple of rows? Thanks. > > 2016-06-12 9:08 GMT+08:00 [hidden > email] <[hidden > email]>: > > > Yes,right > > > > 发件人: Yang [via Apache Kylin] [mailto:[hidden > email]] > > 发送时间: 2016年6月12日 6:32 > > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > > 主题: Re: snapshot table not update > > > > To confirm understanding. You built a cube, updated the lookup table in > > hive, and built it again. And the second build didn't pick up the latest > > lookup table. Is that correct? > > > > On Wed, Jun 8, 2016 at 11:45 AM, [hidden > > email] <[hidden > > email]> > > wrote: > > > > > I define a loopup table in a cube,when data changed in lookup table, > > > snapshot not updated . > > > > > > I can find logs as below: > > > > > > > > > > > > 2016-06-08 11:03:07,443 INFO [pool-5-thread-7] > > lookup.SnapshotManager:181 > > > : > > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd > > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true > > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] > > lookup.SnapshotManager:187 > > > : > > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08 > > > 42-432b-be99-2ba2bb1a852d.snapshot > > > 2016-06-08 11:03:07,447 INFO [pool-5-thread-7] > > lookup.SnapshotManager:130 > > > : > > > Identical snapshot content org.apache.kylin.dict.lookup.Snap > > > shotTable@9652a8b3, reuse existing snapshot at > > > > > > /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot > > > > > > > > > -- > > > View this message in context: > > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html > > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > > > > If you reply to this email, your message will be added to the discussion > > below: > > > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html > > To start a new topic under Apache Kylin, email > > [hidden email] > > To unsubscribe from Apache Kylin, click here< > > >. > > NAML< > > > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > > > > > -- > > View this message in context: > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > -- > Best regards, > > Shaofeng Shi > > > If you reply to this email, your message will be added to the discussion > below: > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html > To start a new topic under Apache Kylin, email > ml-node+s74782n1...@n6.nabble.com > To unsubscribe from Apache Kylin, click here< > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code=1=eXViby1kczFAeW9sbzI0LmNvbXwxfC0xMTE5OTYzOTg4 > >. > NAML< > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi
答复: 答复: snapshot table not update
I updated all the rows. Actually, I dropped the table and created it again. 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto:ml-node+s74782n490...@n6.nabble.com] 发送时间: 2016年6月12日 10:07 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) 主题: Re: 答复: snapshot table not update I checked the code, it is very likely a bug; Before start working on that, I want to know what kind of change was made in your lookup table: add/delete record, or update a couple of rows? Thanks. 2016-06-12 9:08 GMT+08:00 [hidden email] <[hidden email]>: > Yes,right > > 发件人: Yang [via Apache Kylin] [mailto:[hidden > email]] > 发送时间: 2016年6月12日 6:32 > 收件人: yubo-ds1(于渤.大数据中心.大数据平台部) > 主题: Re: snapshot table not update > > To confirm understanding. You built a cube, updated the lookup table in > hive, and built it again. And the second build didn't pick up the latest > lookup table. Is that correct? > > On Wed, Jun 8, 2016 at 11:45 AM, [hidden > email] <[hidden > email]> > wrote: > > > I define a loopup table in a cube,when data changed in lookup table, > > snapshot not updated . > > > > I can find logs as below: > > > > > > > > 2016-06-08 11:03:07,443 INFO [pool-5-thread-7] > lookup.SnapshotManager:181 > > : > > Loading snapshotTable from /table_snapshot/siteidmapping/8bd > > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true > > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] > lookup.SnapshotManager:187 > > : > > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08 > > 42-432b-be99-2ba2bb1a852d.snapshot > > 2016-06-08 11:03:07,447 INFO [pool-5-thread-7] > lookup.SnapshotManager:130 > > : > > Identical snapshot content org.apache.kylin.dict.lookup.Snap > > shotTable@9652a8b3, reuse existing snapshot at > > > /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot > > > > > > -- > > View this message in context: > > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > If you reply to this email, your message will be added to the discussion > below: > > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4902.html > To start a new topic under Apache Kylin, email > [hidden email] > To unsubscribe from Apache Kylin, click here< > >. > NAML< > http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4906.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi If you reply to this email, your message will be added to the discussion below: http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4908.html To start a new topic under Apache Kylin, email ml-node+s74782n1...@n6.nabble.com To unsubscribe from Apache Kylin, click here<http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code=1=eXViby1kczFAeW9sbzI0LmNvbXwxfC0xMTE5OTYzOTg4>. NAML<http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> -- View this message in context: http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854p4910.html Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: snapshot table not update
To confirm understanding. You built a cube, updated the lookup table in hive, and built it again. And the second build didn't pick up the latest lookup table. Is that correct? On Wed, Jun 8, 2016 at 11:45 AM, yubo-...@yolo24.com <yubo-...@yolo24.com> wrote: > I define a loopup table in a cube,when data changed in lookup table, > snapshot not updated . > > I can find logs as below: > > > > 2016-06-08 11:03:07,443 INFO [pool-5-thread-7] lookup.SnapshotManager:181 > : > Loading snapshotTable from /table_snapshot/siteidmapping/8bd > d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true > 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] lookup.SnapshotManager:187 > : > Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08 > 42-432b-be99-2ba2bb1a852d.snapshot > 2016-06-08 11:03:07,447 INFO [pool-5-thread-7] lookup.SnapshotManager:130 > : > Identical snapshot content org.apache.kylin.dict.lookup.Snap > shotTable@9652a8b3, reuse existing snapshot at > /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html > Sent from the Apache Kylin mailing list archive at Nabble.com. >
snapshot table not update
I define a loopup table in a cube,when data changed in lookup table, snapshot not updated . I can find logs as below: 2016-06-08 11:03:07,443 INFO [pool-5-thread-7] lookup.SnapshotManager:181 : Loading snapshotTable from /table_snapshot/siteidmapping/8bd d3aba-0842-432b-be99-2ba2bb1a852d.snapshot, with loadData: true 2016-06-08 11:03:07,447 DEBUG [pool-5-thread-7] lookup.SnapshotManager:187 : Loaded snapshot at /table_snapshot/siteidmapping/8bdd3aba-08 42-432b-be99-2ba2bb1a852d.snapshot 2016-06-08 11:03:07,447 INFO [pool-5-thread-7] lookup.SnapshotManager:130 : Identical snapshot content org.apache.kylin.dict.lookup.Snap shotTable@9652a8b3, reuse existing snapshot at /table_snapshot/siteidmapping/8bdd3aba-0842-432b-be99-2ba2bb1a852d.snapshot -- View this message in context: http://apache-kylin.74782.x6.nabble.com/snapshot-table-not-update-tp4854.html Sent from the Apache Kylin mailing list archive at Nabble.com.
