Re: Not able to edit cube from UI

[Billy Liu]

"Ready segment" means the segment is built successfully.

2017-05-12 13:06 GMT+08:00 Nirav Patel :

> What do you mean by "ready segments"? Cube that went through Build process?
>
> On Thu, May 11, 2017 at 7:21 PM, Billy Liu  wrote:
>
>> If the cube has ready segments, the edit is not available.
>>
>> 2017-05-12 9:17 GMT+08:00 Nirav Patel :
>>
>>> Looks like I had to 'Disable' cube first in order to edit it. So this
>>> means no queries would be served from this cube while I am modifying it.
>>>
>>> On Thu, May 11, 2017 at 6:13 PM, Nirav Patel 
>>> wrote:
>>>
 Looks like there's an Edit action under Actions but I can't seem to
 modify anything. Name, Dimensions, Measures nothing. I am logged in as an
 Admin and I created the cube few minutes back. Cube is built at well. Am I
 missing anything here?

>>>
>>>
>>>
>>>
>>> [image: What's New with Xactly] 
>>>
>>>   [image: LinkedIn]
>>>   [image: Twitter]
>>>   [image: Facebook]
>>>   [image: YouTube]
>>> 
>>>
>>
>>
>
>
>
> [image: What's New with Xactly] 
>
>   [image: LinkedIn]
>   [image: Twitter]
>   [image: Facebook]
>   [image: YouTube]
> 
>

Re: A problem in cube moving

[Billy Liu]

Copy from Shaofeng‘s reply
"Hi,

To migrate/move a cube from staging Kylin to production Kylin, you can use
the tool CubeMigrationCLI, e.g, on v2.0, run :

$KYLIN_HOME/bin/kylin.sh org.apache.kylin.tool.CubeMigrationCLI

it will print out the usage info. Follow the instruction to go ahead.

(in 1.x the package name is different, pls check the source repository)

Please note the precondition is your staging/production Kylin are running
on the same Hadoop/HBase cluster; This migration only move Cube metadata
and files on same HDFS, it doesn't across Hadoop clusters."

2017-05-12 12:03 GMT+08:00 吕卓然 :

> Hi all,
>
>
>
> I heard from the website that there is a tool used for moving a cube from
> test environment to product environment. I was wondering if someone is
> using this tool. What is the name of the tool and how can I use it?
>
>
>
> Thanks a lot!
>
> Zhuoran
>

Re: Not able to edit cube from UI

[Nirav Patel]

What do you mean by "ready segments"? Cube that went through Build process?

On Thu, May 11, 2017 at 7:21 PM, Billy Liu  wrote:

> If the cube has ready segments, the edit is not available.
>
> 2017-05-12 9:17 GMT+08:00 Nirav Patel :
>
>> Looks like I had to 'Disable' cube first in order to edit it. So this
>> means no queries would be served from this cube while I am modifying it.
>>
>> On Thu, May 11, 2017 at 6:13 PM, Nirav Patel 
>> wrote:
>>
>>> Looks like there's an Edit action under Actions but I can't seem to
>>> modify anything. Name, Dimensions, Measures nothing. I am logged in as an
>>> Admin and I created the cube few minutes back. Cube is built at well. Am I
>>> missing anything here?
>>>
>>
>>
>>
>>
>> [image: What's New with Xactly] 
>>
>>   [image: LinkedIn]
>>   [image: Twitter]
>>   [image: Facebook]
>>   [image: YouTube]
>> 
>>
>
>

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

A problem in cube moving

[吕卓然]

Hi all,

I heard from the website that there is a tool used for moving a cube from test 
environment to product environment. I was wondering if someone is using this 
tool. What is the name of the tool and how can I use it?

Thanks a lot!
Zhuoran

Re: Not able to edit cube from UI

[Billy Liu]

If the cube has ready segments, the edit is not available.

2017-05-12 9:17 GMT+08:00 Nirav Patel :

> Looks like I had to 'Disable' cube first in order to edit it. So this
> means no queries would be served from this cube while I am modifying it.
>
> On Thu, May 11, 2017 at 6:13 PM, Nirav Patel 
> wrote:
>
>> Looks like there's an Edit action under Actions but I can't seem to
>> modify anything. Name, Dimensions, Measures nothing. I am logged in as an
>> Admin and I created the cube few minutes back. Cube is built at well. Am I
>> missing anything here?
>>
>
>
>
>
> [image: What's New with Xactly] 
>
>   [image: LinkedIn]
>   [image: Twitter]
>   [image: Facebook]
>   [image: YouTube]
> 
>

Re: Not able to edit cube from UI

[Nirav Patel]

Looks like I had to 'Disable' cube first in order to edit it. So this means
no queries would be served from this cube while I am modifying it.

On Thu, May 11, 2017 at 6:13 PM, Nirav Patel  wrote:

> Looks like there's an Edit action under Actions but I can't seem to modify
> anything. Name, Dimensions, Measures nothing. I am logged in as an Admin
> and I created the cube few minutes back. Cube is built at well. Am I
> missing anything here?
>

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Not able to edit cube from UI

[Nirav Patel]

Looks like there's an Edit action under Actions but I can't seem to modify
anything. Name, Dimensions, Measures nothing. I am logged in as an Admin
and I created the cube few minutes back. Cube is built at well. Am I
missing anything here?

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Re: How to apply historical Updates to existing cube data

[Nirav Patel]

First link says you can do incremental based on "range of segments". Is it
a timestamp/date range that we define during cube creation?
ANd since data is stored in hbase will kylin just overwrite new data with
new one with same rowkeys?

Thanks

On Thu, May 11, 2017 at 1:26 PM, Alberto Ramón 
wrote:

> Q1- Check this previous mailList about late data:
> http://apache-kylin.74782.x6.nabble.com/Reloading-data-td5669.html
>
> You only will need recalculate segments involved
>
> Q2- Check Shardin (https://issues.apache.org/jira/browse/KYLIN-1453)
>   Partition by time column is not reoomended (It Will create hotspot in
> HBase)
>
>
>
> On 11 May 2017 at 19:43, Nirav Patel  wrote:
>
>> Hi,
>>
>> Correct me if I am wrong but currently you can not update existing kylin
>> cube without refreshing entire cube. Does it mean if I am pulling new data
>> from hive based on lets say customerId, Timestamp for which I already built
>> cube before I have to rebuild entire cube from scratch? Or can I say
>> refresh between startTime and endTime which will update cube data for that
>> timeframe only.
>>
>> Also Hive data can be partitioned by any keys(columns) not just
>> timestamp. so why not allow kylin cube updates based on any arbitrary
>> partition strategy that user have defined on their hive table?
>> e.g. update part of the cube based on timestamp, customerid, batchid etc.
>>
>> Thanks,
>> Nirav
>>
>>
>>
>> [image: What's New with Xactly] 
>>
>>   [image: LinkedIn]
>>   [image: Twitter]
>>   [image: Facebook]
>>   [image: YouTube]
>> 
>
>
>

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Document that explain how Kylin query, indexing, metadata engine works

[Nirav Patel]

I see there are documents that explains how kylin ingest hive tables and
build cubes/cuboids using MR and/or spark but there is nothing about how it
generates metadata about cubes/segments, how it builds indexes
(dictionaries, inverted index if any) and how that helps querying against
cubes stored on hbase. There are some slides/papers but they all date back
to 2014/15 which is quite old.

Are there any recent documents/articles on these ?

Thanks

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Re: REST APIs for Create/Update models and cubes and selecting datasources

[Nirav Patel]

On Thu, May 11, 2017 at 2:55 PM, Nirav Patel  wrote:

> Hi,
>
> I see APIs to Build existing cube but I don's see any thing for
> Create/Update of Model and Cubes itself. Is there a way to modify cube
> properties (dimensions, measures, refresh settings) programmatically?
>
> Thanks,
> Nirav
>

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

REST APIs for Create/Update models and cubes and selecting datasources

[Nirav Patel]

Hi,

I see APIs to Build existing cube but I don's see any thing for
Create/Update of Model and Cubes itself. Is there a way to modify cube
properties (dimensions, measures, refresh settings) programmatically?

Thanks,
Nirav

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Re: How to apply historical Updates to existing cube data

[Alberto Ramón]

Q1- Check this previous mailList about late data:
http://apache-kylin.74782.x6.nabble.com/Reloading-data-td5669.html

You only will need recalculate segments involved

Q2- Check Shardin (https://issues.apache.org/jira/browse/KYLIN-1453)
  Partition by time column is not reoomended (It Will create hotspot in
HBase)



On 11 May 2017 at 19:43, Nirav Patel  wrote:

> Hi,
>
> Correct me if I am wrong but currently you can not update existing kylin
> cube without refreshing entire cube. Does it mean if I am pulling new data
> from hive based on lets say customerId, Timestamp for which I already built
> cube before I have to rebuild entire cube from scratch? Or can I say
> refresh between startTime and endTime which will update cube data for that
> timeframe only.
>
> Also Hive data can be partitioned by any keys(columns) not just timestamp.
> so why not allow kylin cube updates based on any arbitrary partition
> strategy that user have defined on their hive table?
> e.g. update part of the cube based on timestamp, customerid, batchid etc.
>
> Thanks,
> Nirav
>
>
>
> [image: What's New with Xactly] 
>
>   [image: LinkedIn]
>   [image: Twitter]
>   [image: Facebook]
>   [image: YouTube]
> 

How to apply historical Updates to existing cube data

[Nirav Patel]

Hi,

Correct me if I am wrong but currently you can not update existing kylin
cube without refreshing entire cube. Does it mean if I am pulling new data
from hive based on lets say customerId, Timestamp for which I already built
cube before I have to rebuild entire cube from scratch? Or can I say
refresh between startTime and endTime which will update cube data for that
timeframe only.

Also Hive data can be partitioned by any keys(columns) not just timestamp.
so why not allow kylin cube updates based on any arbitrary partition
strategy that user have defined on their hive table?
e.g. update part of the cube based on timestamp, customerid, batchid etc.

Thanks,
Nirav

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Read write isolation; Availability of cube for query while rebuild/refresh

[Nirav Patel]

Hi,

I understand currently kylin does't support partial changes to existing
cube data. In which case entire cube has to be rebuild. WHat is the impact
of it on clients/query interface? Do they have to wait when cube is getting
refreshed?
Also what happens during incremental refresh? If some client query for new
data which are being built would kylin allow dirty read on cube that is
being built?

Thanks,
Nirav

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube]