Re: VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-30 Thread ShaoFeng Shi 
I reproduced this problem from GUI; so this is a regression, or the fix was
only made in 1.x branch; we need check this.

2016-03-30 18:21 GMT+08:00 Li Yang :

> The column under "rowkey" section should be "TXN_BOOK_DT_KEY" instead of
> "DT_KEY". If the cube is created through GUI then pls report a JIRA.
>
> Btw this bug has been fixed in earlier version. It come back again?!
>
> On Tue, Mar 29, 2016 at 11:21 AM, ShaoFeng Shi 
> wrote:
>
> > This is a bug, could you please report it as a JIRA?
> >
> > To bypass this error for now, please use the FK on fact table as the
> > dimension ("TXN_BOOK_DT_KEY" in this case).
> >
> > 2016-03-28 22:35 GMT+08:00 sdangi :
> >
> > > I have designed model/cubes in the past on version 1.2 and 1.3 no
> issue.
> > > I'm
> > > hitting this issue with 1.5.  Please check the model and cube JSON and
> > let
> > > me know if there is anything that stands out to cause this.
> > >
> > >
> > > *Error Message
> > > Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]*
> > >
> > >
> > > MODEL:
> > > 
> > > {
> > >   "uuid": "dd8395e2-0da3-48b1-8a0c-4165d477e7c5",
> > >   "version": "1.5.0",
> > >   "name": "TEST_MODEL",
> > >   "description": "",
> > >   "lookups": [
> > > {
> > >   "table": "SCHM.DT_DIM_ORC",
> > >   "join": {
> > > "type": "inner",
> > > "primary_key": [
> > >   "DT_KEY"
> > > ],
> > > "foreign_key": [
> > >   "TXN_BOOK_DT_KEY"
> > > ]
> > >   }
> > > },
> > > {
> > >   "table": "SCHM.CST_DIM_ORC",
> > >   "join": {
> > > "type": "inner",
> > > "primary_key": [
> > >   "CST_KEY"
> > > ],
> > > "foreign_key": [
> > >   "FIRM_CST_KEY"
> > > ]
> > >   }
> > > }
> > >   ],
> > >   "dimensions": [
> > > {
> > >   "table": "SCHM.TXN_FCT_ORC_SM",
> > >   "columns": []
> > > },
> > > {
> > >   "table": "SCHM.DT_DIM_ORC",
> > >   "columns": [
> > > "DT_KEY"
> > >   ]
> > > },
> > > {
> > >   "table": "SCHM.CST_DIM_ORC",
> > >   "columns": [
> > > "CST_NM"
> > >   ]
> > > }
> > >   ],
> > >   "metrics": [
> > > "USD_TXN_AMT"
> > >   ],
> > >   "capacity": "MEDIUM",
> > >   "last_modified": 1459175903495,
> > >   "fact_table": "SCHM.TXN_FCT_ORC_SM",
> > >   "filter_condition": "",
> > >   "partition_desc": {
> > > "partition_date_column": "SCHM.TXN_FCT_ORC_SM.TXN_BOOK_DT_KEY",
> > > "partition_time_column": null,
> > > "partition_date_start": 0,
> > > "partition_date_format": "-MM-dd",
> > > "partition_time_format": "HH:mm:ss",
> > > "partition_type": "APPEND",
> > > "partition_condition_builder":
> > >
> > >
> >
> "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
> > >   }
> > > }
> > >
> > >
> > > CUBE:
> > > ===
> > >
> > > {
> > >   "name": "TEST_CUBE",
> > >   "model_name": "TEST_MODEL",
> > >   "description": "",
> > >   "dimensions": [
> > > {
> > >   "name": "CST_DIM_CST_NM",
> > >   "table": "SCHM.CST_DIM_ORC",
> > >   "derived": null,
> > >   "column": "CST_NM"
> > > },
> > > {
> > >   "name": "DT_DIM_DT_KEY",
> > >   "table": "SCHM.DT_DIM_ORC",
> > >   "derived": null,
> > >   "column": "DT_KEY"
> > > }
> > >   ],
> > >   "measures": [
> > > {
> > >   "name": "_COUNT_",
> > >   "function": {
> > > "expression": "COUNT",
> > > "returntype": "bigint",
> > > "parameter": {
> > >   "type": "constant",
> > >   "value": "1",
> > >   "next_parameter": null
> > > }
> > >   }
> > > },
> > > {
> > >   "name": "USD_TXN_AMT",
> > >   "function": {
> > > "expression": "SUM",
> > > "returntype": "decimal(32,8)",
> > > "parameter": {
> > >   "type": "column",
> > >   "value": "USD_TXN_AMT",
> > >   "next_parameter": null
> > > }
> > >   }
> > > }
> > >   ],
> > >   "rowkey": {
> > > "rowkey_columns": [
> > >   {
> > > "column": "CST_NM",
> > > "encoding": "dict"
> > >   },
> > >   {
> > > "column": "DT_KEY",
> > > "encoding": "dict"
> > >   }
> > > ]
> > >   },
> > >   "aggregation_groups": [
> > > {
> > >   "includes": [
> > > "CST_NM",
> > > "DT_KEY"
> > >   ],
> > >   "select_rule": {
> > > "hierarchy_dims": [],
> > > "mandatory_dims": [],
> > > "joint_dims": []
> > >   }
> > > }
> > >   ],
> > >   "partition_date_start": 138853440,
> > >   "notify_list": [],
> > >   "hbase_mapping": {
> > > "column_family": [
> > >   {
> > > "name": "f1",
> > > "columns": [
> > >

Re: VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-30 Thread Li Yang 
The column under "rowkey" section should be "TXN_BOOK_DT_KEY" instead of
"DT_KEY". If the cube is created through GUI then pls report a JIRA.

Btw this bug has been fixed in earlier version. It come back again?!

On Tue, Mar 29, 2016 at 11:21 AM, ShaoFeng Shi 
wrote:

> This is a bug, could you please report it as a JIRA?
>
> To bypass this error for now, please use the FK on fact table as the
> dimension ("TXN_BOOK_DT_KEY" in this case).
>
> 2016-03-28 22:35 GMT+08:00 sdangi :
>
> > I have designed model/cubes in the past on version 1.2 and 1.3 no issue.
> > I'm
> > hitting this issue with 1.5.  Please check the model and cube JSON and
> let
> > me know if there is anything that stands out to cause this.
> >
> >
> > *Error Message
> > Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]*
> >
> >
> > MODEL:
> > 
> > {
> >   "uuid": "dd8395e2-0da3-48b1-8a0c-4165d477e7c5",
> >   "version": "1.5.0",
> >   "name": "TEST_MODEL",
> >   "description": "",
> >   "lookups": [
> > {
> >   "table": "SCHM.DT_DIM_ORC",
> >   "join": {
> > "type": "inner",
> > "primary_key": [
> >   "DT_KEY"
> > ],
> > "foreign_key": [
> >   "TXN_BOOK_DT_KEY"
> > ]
> >   }
> > },
> > {
> >   "table": "SCHM.CST_DIM_ORC",
> >   "join": {
> > "type": "inner",
> > "primary_key": [
> >   "CST_KEY"
> > ],
> > "foreign_key": [
> >   "FIRM_CST_KEY"
> > ]
> >   }
> > }
> >   ],
> >   "dimensions": [
> > {
> >   "table": "SCHM.TXN_FCT_ORC_SM",
> >   "columns": []
> > },
> > {
> >   "table": "SCHM.DT_DIM_ORC",
> >   "columns": [
> > "DT_KEY"
> >   ]
> > },
> > {
> >   "table": "SCHM.CST_DIM_ORC",
> >   "columns": [
> > "CST_NM"
> >   ]
> > }
> >   ],
> >   "metrics": [
> > "USD_TXN_AMT"
> >   ],
> >   "capacity": "MEDIUM",
> >   "last_modified": 1459175903495,
> >   "fact_table": "SCHM.TXN_FCT_ORC_SM",
> >   "filter_condition": "",
> >   "partition_desc": {
> > "partition_date_column": "SCHM.TXN_FCT_ORC_SM.TXN_BOOK_DT_KEY",
> > "partition_time_column": null,
> > "partition_date_start": 0,
> > "partition_date_format": "-MM-dd",
> > "partition_time_format": "HH:mm:ss",
> > "partition_type": "APPEND",
> > "partition_condition_builder":
> >
> >
> "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
> >   }
> > }
> >
> >
> > CUBE:
> > ===
> >
> > {
> >   "name": "TEST_CUBE",
> >   "model_name": "TEST_MODEL",
> >   "description": "",
> >   "dimensions": [
> > {
> >   "name": "CST_DIM_CST_NM",
> >   "table": "SCHM.CST_DIM_ORC",
> >   "derived": null,
> >   "column": "CST_NM"
> > },
> > {
> >   "name": "DT_DIM_DT_KEY",
> >   "table": "SCHM.DT_DIM_ORC",
> >   "derived": null,
> >   "column": "DT_KEY"
> > }
> >   ],
> >   "measures": [
> > {
> >   "name": "_COUNT_",
> >   "function": {
> > "expression": "COUNT",
> > "returntype": "bigint",
> > "parameter": {
> >   "type": "constant",
> >   "value": "1",
> >   "next_parameter": null
> > }
> >   }
> > },
> > {
> >   "name": "USD_TXN_AMT",
> >   "function": {
> > "expression": "SUM",
> > "returntype": "decimal(32,8)",
> > "parameter": {
> >   "type": "column",
> >   "value": "USD_TXN_AMT",
> >   "next_parameter": null
> > }
> >   }
> > }
> >   ],
> >   "rowkey": {
> > "rowkey_columns": [
> >   {
> > "column": "CST_NM",
> > "encoding": "dict"
> >   },
> >   {
> > "column": "DT_KEY",
> > "encoding": "dict"
> >   }
> > ]
> >   },
> >   "aggregation_groups": [
> > {
> >   "includes": [
> > "CST_NM",
> > "DT_KEY"
> >   ],
> >   "select_rule": {
> > "hierarchy_dims": [],
> > "mandatory_dims": [],
> > "joint_dims": []
> >   }
> > }
> >   ],
> >   "partition_date_start": 138853440,
> >   "notify_list": [],
> >   "hbase_mapping": {
> > "column_family": [
> >   {
> > "name": "f1",
> > "columns": [
> >   {
> > "qualifier": "m",
> > "measure_refs": [
> >   "_COUNT_",
> >   "USD_TXN_AMT"
> > ]
> >   }
> > ]
> >   }
> > ]
> >   },
> >   "retention_range": "0",
> >   "auto_merge_time_ranges": [
> > 60480,
> > 241920
> >   ],
> >   "engine_type": 2,
> >   "storage_type": 2
> > }
> >
> > Thanks,
> > Regards,
> >
> > --
> > View this message in context:
> >
>

Re: VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-28 Thread ShaoFeng Shi 
This is a bug, could you please report it as a JIRA?

To bypass this error for now, please use the FK on fact table as the
dimension ("TXN_BOOK_DT_KEY" in this case).

2016-03-28 22:35 GMT+08:00 sdangi :

> I have designed model/cubes in the past on version 1.2 and 1.3 no issue.
> I'm
> hitting this issue with 1.5.  Please check the model and cube JSON and let
> me know if there is anything that stands out to cause this.
>
>
> *Error Message
> Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]*
>
>
> MODEL:
> 
> {
>   "uuid": "dd8395e2-0da3-48b1-8a0c-4165d477e7c5",
>   "version": "1.5.0",
>   "name": "TEST_MODEL",
>   "description": "",
>   "lookups": [
> {
>   "table": "SCHM.DT_DIM_ORC",
>   "join": {
> "type": "inner",
> "primary_key": [
>   "DT_KEY"
> ],
> "foreign_key": [
>   "TXN_BOOK_DT_KEY"
> ]
>   }
> },
> {
>   "table": "SCHM.CST_DIM_ORC",
>   "join": {
> "type": "inner",
> "primary_key": [
>   "CST_KEY"
> ],
> "foreign_key": [
>   "FIRM_CST_KEY"
> ]
>   }
> }
>   ],
>   "dimensions": [
> {
>   "table": "SCHM.TXN_FCT_ORC_SM",
>   "columns": []
> },
> {
>   "table": "SCHM.DT_DIM_ORC",
>   "columns": [
> "DT_KEY"
>   ]
> },
> {
>   "table": "SCHM.CST_DIM_ORC",
>   "columns": [
> "CST_NM"
>   ]
> }
>   ],
>   "metrics": [
> "USD_TXN_AMT"
>   ],
>   "capacity": "MEDIUM",
>   "last_modified": 1459175903495,
>   "fact_table": "SCHM.TXN_FCT_ORC_SM",
>   "filter_condition": "",
>   "partition_desc": {
> "partition_date_column": "SCHM.TXN_FCT_ORC_SM.TXN_BOOK_DT_KEY",
> "partition_time_column": null,
> "partition_date_start": 0,
> "partition_date_format": "-MM-dd",
> "partition_time_format": "HH:mm:ss",
> "partition_type": "APPEND",
> "partition_condition_builder":
>
> "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
>   }
> }
>
>
> CUBE:
> ===
>
> {
>   "name": "TEST_CUBE",
>   "model_name": "TEST_MODEL",
>   "description": "",
>   "dimensions": [
> {
>   "name": "CST_DIM_CST_NM",
>   "table": "SCHM.CST_DIM_ORC",
>   "derived": null,
>   "column": "CST_NM"
> },
> {
>   "name": "DT_DIM_DT_KEY",
>   "table": "SCHM.DT_DIM_ORC",
>   "derived": null,
>   "column": "DT_KEY"
> }
>   ],
>   "measures": [
> {
>   "name": "_COUNT_",
>   "function": {
> "expression": "COUNT",
> "returntype": "bigint",
> "parameter": {
>   "type": "constant",
>   "value": "1",
>   "next_parameter": null
> }
>   }
> },
> {
>   "name": "USD_TXN_AMT",
>   "function": {
> "expression": "SUM",
> "returntype": "decimal(32,8)",
> "parameter": {
>   "type": "column",
>   "value": "USD_TXN_AMT",
>   "next_parameter": null
> }
>   }
> }
>   ],
>   "rowkey": {
> "rowkey_columns": [
>   {
> "column": "CST_NM",
> "encoding": "dict"
>   },
>   {
> "column": "DT_KEY",
> "encoding": "dict"
>   }
> ]
>   },
>   "aggregation_groups": [
> {
>   "includes": [
> "CST_NM",
> "DT_KEY"
>   ],
>   "select_rule": {
> "hierarchy_dims": [],
> "mandatory_dims": [],
> "joint_dims": []
>   }
> }
>   ],
>   "partition_date_start": 138853440,
>   "notify_list": [],
>   "hbase_mapping": {
> "column_family": [
>   {
> "name": "f1",
> "columns": [
>   {
> "qualifier": "m",
> "measure_refs": [
>   "_COUNT_",
>   "USD_TXN_AMT"
> ]
>   }
> ]
>   }
> ]
>   },
>   "retention_range": "0",
>   "auto_merge_time_ranges": [
> 60480,
> 241920
>   ],
>   "engine_type": 2,
>   "storage_type": 2
> }
>
> Thanks,
> Regards,
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/VER1-5-Cannot-find-rowkey-column-DT-KEY-in-cube-CubeDesc-name-TEST-CUBE-tp3982.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Best regards,

Shaofeng Shi

VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-28 Thread sdangi 
I have designed model/cubes in the past on version 1.2 and 1.3 no issue.  I'm
hitting this issue with 1.5.  Please check the model and cube JSON and let
me know if there is anything that stands out to cause this.


*Error Message
Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]*


MODEL:

{
  "uuid": "dd8395e2-0da3-48b1-8a0c-4165d477e7c5",
  "version": "1.5.0",
  "name": "TEST_MODEL",
  "description": "",
  "lookups": [
{
  "table": "SCHM.DT_DIM_ORC",
  "join": {
"type": "inner",
"primary_key": [
  "DT_KEY"
],
"foreign_key": [
  "TXN_BOOK_DT_KEY"
]
  }
},
{
  "table": "SCHM.CST_DIM_ORC",
  "join": {
"type": "inner",
"primary_key": [
  "CST_KEY"
],
"foreign_key": [
  "FIRM_CST_KEY"
]
  }
}
  ],
  "dimensions": [
{
  "table": "SCHM.TXN_FCT_ORC_SM",
  "columns": []
},
{
  "table": "SCHM.DT_DIM_ORC",
  "columns": [
"DT_KEY"
  ]
},
{
  "table": "SCHM.CST_DIM_ORC",
  "columns": [
"CST_NM"
  ]
}
  ],
  "metrics": [
"USD_TXN_AMT"
  ],
  "capacity": "MEDIUM",
  "last_modified": 1459175903495,
  "fact_table": "SCHM.TXN_FCT_ORC_SM",
  "filter_condition": "",
  "partition_desc": {
"partition_date_column": "SCHM.TXN_FCT_ORC_SM.TXN_BOOK_DT_KEY",
"partition_time_column": null,
"partition_date_start": 0,
"partition_date_format": "-MM-dd",
"partition_time_format": "HH:mm:ss",
"partition_type": "APPEND",
"partition_condition_builder":
"org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
  }
}


CUBE:
===

{
  "name": "TEST_CUBE",
  "model_name": "TEST_MODEL",
  "description": "",
  "dimensions": [
{
  "name": "CST_DIM_CST_NM",
  "table": "SCHM.CST_DIM_ORC",
  "derived": null,
  "column": "CST_NM"
},
{
  "name": "DT_DIM_DT_KEY",
  "table": "SCHM.DT_DIM_ORC",
  "derived": null,
  "column": "DT_KEY"
}
  ],
  "measures": [
{
  "name": "_COUNT_",
  "function": {
"expression": "COUNT",
"returntype": "bigint",
"parameter": {
  "type": "constant",
  "value": "1",
  "next_parameter": null
}
  }
},
{
  "name": "USD_TXN_AMT",
  "function": {
"expression": "SUM",
"returntype": "decimal(32,8)",
"parameter": {
  "type": "column",
  "value": "USD_TXN_AMT",
  "next_parameter": null
}
  }
}
  ],
  "rowkey": {
"rowkey_columns": [
  {
"column": "CST_NM",
"encoding": "dict"
  },
  {
"column": "DT_KEY",
"encoding": "dict"
  }
]
  },
  "aggregation_groups": [
{
  "includes": [
"CST_NM",
"DT_KEY"
  ],
  "select_rule": {
"hierarchy_dims": [],
"mandatory_dims": [],
"joint_dims": []
  }
}
  ],
  "partition_date_start": 138853440,
  "notify_list": [],
  "hbase_mapping": {
"column_family": [
  {
"name": "f1",
"columns": [
  {
"qualifier": "m",
"measure_refs": [
  "_COUNT_",
  "USD_TXN_AMT"
]
  }
]
  }
]
  },
  "retention_range": "0",
  "auto_merge_time_ranges": [
60480,
241920
  ],
  "engine_type": 2,
  "storage_type": 2
}

Thanks,
Regards,

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/VER1-5-Cannot-find-rowkey-column-DT-KEY-in-cube-CubeDesc-name-TEST-CUBE-tp3982.html
Sent from the Apache Kylin mailing list archive at Nabble.com.