I got the same exception in 1.x-staging branch.

> 在 2015年10月29日,22:48,Yiming Liu <[email protected]> 写道:
> 
> Hello, Kylin experts:
> 
> 
> I have issues when using the sample.sh, and has reported to 
> https://issues.apache.org/jira/browse/KYLIN-1103
> 
> Now I tried to build the sample manually, but met the NPE in step 2. From the 
> log, it seems Kylin MR job could not load the cube definition correctly. 
> Could you give me some help?
> 
> 
> The kylin jobs details has parameter:
> -conf /opt/kylin/conf/kylin_job_conf.xml -cubename kylin_sales_cube_simple 
> -output 
> /kylin/kylin_metadata/kylin-d2f99e2d-146c-4fb7-bcbf-5c317af143dd/kylin_sales_cube_simple/fact_distinct_columns
>  -jobname Kylin_Fact_Distinct_Columns_kylin_sales_cube_simple_Step -tablename 
> default.kylin_intermediate_kylin_sales_cube_simple_19700101000000_20150927000000_d2f99e2d_146c_4fb7_bcbf_5c317af143dd
> 
> 
> the log:
> 2015-10-29 22:30:17.685 - State of Hadoop job: 
> job_1445989444324_0021:ACCEPTED - UNDEFINED 2015-10-29 22:30:27.704 - State 
> of Hadoop job: job_1445989444324_0021:ACCEPTED - UNDEFINED 2015-10-29 
> 22:30:37.721 - State of Hadoop job: job_1445989444324_0021:RUNNING - 
> UNDEFINED 2015-10-29 22:30:47.751 - State of Hadoop job: 
> job_1445989444324_0021:RUNNING - UNDEFINED 2015-10-29 22:30:57.768 - State of 
> Hadoop job: job_1445989444324_0021:RUNNING - UNDEFINED 2015-10-29 
> 22:31:07.786 - State of Hadoop job: job_1445989444324_0021:RUNNING - 
> UNDEFINED 2015-10-29 22:31:17.805 - State of Hadoop job: 
> job_1445989444324_0021:FINISHED - FAILED no counters for job 
> job_1445989444324_0021
> And the MR jobs has the exception log:
> Error: java.lang.NullPointerException at 
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsMapper.setup(FactDistinctColumnsMapper.java:73)
>  at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143) at 
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at 
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at 
> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at 
> java.security.AccessController.doPrivileged(Native Method) at 
> javax.security.auth.Subject.doAs(Subject.java:422) at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>  at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> 
> 
> Dip into the code, it seems the NPE means the "cube" is null. From the code, 
> we could tell the CubeManager could not find my cube. 
> 72       cube = CubeManager.getInstance(config).getCube(cubeName);
> 73       cubeDesc = cube.getDescriptor();
> 
> 
> 
> Then I looked into HBase, the kylin_metadata has the following two records:
> /cube/kylin_sales_cube_simple.json
> {
>  "uuid" : "3a271b47-9363-4434-8bd0-02c2a2a31c2b",
>  "name" : "kylin_sales_cube_simple",
>  "owner" : "ADMIN",
>  "version" : null,
>  "cost" : 50,
>  "status" : "DISABLED",
>  "segments" : [ {
>    "uuid" : "05a31b8b-ac94-45df-ab41-1f425b64e27f",
>    "name" : "19700101000000_20150927000000",
>    "status" : "NEW",
>    "dictionaries" : null,
>    "snapshots" : null,
>    "storage_location_identifier" : "KYLIN_AIKMGGR2BN",
>    "date_range_start" : 0,
>    "date_range_end" : 1443312000000,
>    "size_kb" : 0,
>    "input_records" : 0,
>    "input_records_size" : 0,
>    "last_build_time" : 0,
>    "last_build_job_id" : null,
>    "create_time_utc" : 1446128917265,
>    "binary_signature" : null
>  } ],
>  "last_modified" : 1446128917267,
>  "descriptor" : "kylin_sales_cube_simple",
>  "create_time_utc" : 1446128903052,
>  "size_kb" : 0,
>  "input_records_count" : 0,
>  "input_records_size" : 0
> }
> 
> and /cube_desc/kylin_sales_cube_simple.json
> {
>  "uuid" : "8d759e58-0a97-4913-a7b5-fa3f99fdf67d",
>  "name" : "kylin_sales_cube_simple",
>  "description" : "",
>  "dimensions" : [ {
>    "id" : 1,
>    "name" : "DEFAULT.KYLIN_SALES.LSTG_FORMAT_NAME",
>    "table" : "DEFAULT.KYLIN_SALES",
>    "column" : [ "LSTG_FORMAT_NAME" ],
>    "derived" : null,
>    "hierarchy" : false
>  }, {
>    "id" : 2,
>    "name" : "DEFAULT.KYLIN_SALES.LEAF_CATEG_ID",
>    "table" : "DEFAULT.KYLIN_SALES",
>    "column" : [ "LEAF_CATEG_ID" ],
>    "derived" : null,
>    "hierarchy" : false
>  }, {
>    "id" : 3,
>    "name" : "DEFAULT.KYLIN_SALES.LSTG_SITE_ID",
>    "table" : "DEFAULT.KYLIN_SALES",
>    "column" : [ "LSTG_SITE_ID" ],
>    "derived" : null,
>    "hierarchy" : false
>  } ],
>  "measures" : [ {
>    "id" : 1,
>    "name" : "_COUNT_",
>    "function" : {
>      "expression" : "COUNT",
>      "parameter" : {
>        "type" : "constant",
>        "value" : "1"
>      },
>      "returntype" : "bigint"
>    },
>    "dependent_measure_ref" : null
>  }, {
>    "id" : 2,
>    "name" : "SUM_PRICE",
>    "function" : {
>      "expression" : "SUM",
>      "parameter" : {
>        "type" : "column",
>        "value" : "PRICE"
>      },
>      "returntype" : "decimal(19,4)"
>    },
>    "dependent_measure_ref" : null
>  } ],
>  "rowkey" : {
>    "rowkey_columns" : [ {
>      "column" : "LSTG_FORMAT_NAME",
>      "length" : 0,
>      "dictionary" : "true",
>      "mandatory" : false
>    }, {
>      "column" : "LEAF_CATEG_ID",
>      "length" : 0,
>      "dictionary" : "true",
>      "mandatory" : false
>    }, {
>      "column" : "LSTG_SITE_ID",
>      "length" : 0,
>      "dictionary" : "true",
>      "mandatory" : false
>    } ],
>    "aggregation_groups" : [ [ "LSTG_FORMAT_NAME", "LEAF_CATEG_ID", 
> "LSTG_SITE_ID" ] ]
>  },
>  "signature" : "0FAthGOvTI9p4/K0cTMJ6Q==",
>  "last_modified" : 1446128903023,
>  "model_name" : "kylin_sales_cube_simple",
>  "null_string" : null,
>  "hbase_mapping" : {
>    "column_family" : [ {
>      "name" : "F1",
>      "columns" : [ {
>        "qualifier" : "M",
>        "measure_refs" : [ "_COUNT_", "SUM_PRICE" ]
>      } ]
>    } ]
>  },
>  "notify_list" : [ ],
>  "auto_merge_time_ranges" : [ 604800000, 2419200000 ],
>  "retention_range" : 0
> }

Reply via email to