Do you have quick fix on this? Would love to have community help on HBase 1.x testing and bug fixes.
Thanks. Best Regards! --------------------- Luke Han On Fri, Oct 30, 2015 at 8:59 AM, 王晓雨 <[email protected]> wrote: > I got the same exception in 1.x-staging branch. > > > 在 2015年10月29日，22:48，Yiming Liu <[email protected]> 写道： > > > > Hello, Kylin experts: > > > > > > I have issues when using the sample.sh, and has reported to > https://issues.apache.org/jira/browse/KYLIN-1103 > > > > Now I tried to build the sample manually, but met the NPE in step 2. > From the log, it seems Kylin MR job could not load the cube definition > correctly. Could you give me some help? > > > > > > The kylin jobs details has parameter: > > -conf /opt/kylin/conf/kylin_job_conf.xml -cubename > kylin_sales_cube_simple -output > /kylin/kylin_metadata/kylin-d2f99e2d-146c-4fb7-bcbf-5c317af143dd/kylin_sales_cube_simple/fact_distinct_columns > -jobname Kylin_Fact_Distinct_Columns_kylin_sales_cube_simple_Step > -tablename > default.kylin_intermediate_kylin_sales_cube_simple_19700101000000_20150927000000_d2f99e2d_146c_4fb7_bcbf_5c317af143dd > > > > > > the log: > > 2015-10-29 22:30:17.685 - State of Hadoop job: > job_1445989444324_0021:ACCEPTED - UNDEFINED 2015-10-29 22:30:27.704 - State > of Hadoop job: job_1445989444324_0021:ACCEPTED - UNDEFINED 2015-10-29 > 22:30:37.721 - State of Hadoop job: job_1445989444324_0021:RUNNING - > UNDEFINED 2015-10-29 22:30:47.751 - State of Hadoop job: > job_1445989444324_0021:RUNNING - UNDEFINED 2015-10-29 22:30:57.768 - State > of Hadoop job: job_1445989444324_0021:RUNNING - UNDEFINED 2015-10-29 > 22:31:07.786 - State of Hadoop job: job_1445989444324_0021:RUNNING - > UNDEFINED 2015-10-29 22:31:17.805 - State of Hadoop job: > job_1445989444324_0021:FINISHED - FAILED no counters for job > job_1445989444324_0021 > > And the MR jobs has the exception log: > > Error: java.lang.NullPointerException at > org.apache.kylin.job.hadoop.cube.FactDistinctColumnsMapper.setup(FactDistinctColumnsMapper.java:73) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143) at > org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at > org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at > org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at > java.security.AccessController.doPrivileged(Native Method) at > javax.security.auth.Subject.doAs(Subject.java:422) at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) > > > > > > Dip into the code, it seems the NPE means the "cube" is null. From the > code, we could tell the CubeManager could not find my cube. > > 72 cube = CubeManager.getInstance(config).getCube(cubeName); > > 73 cubeDesc = cube.getDescriptor(); > > > > > > > > Then I looked into HBase, the kylin_metadata has the following two > records: > > /cube/kylin_sales_cube_simple.json > > { > > "uuid" : "3a271b47-9363-4434-8bd0-02c2a2a31c2b", > > "name" : "kylin_sales_cube_simple", > > "owner" : "ADMIN", > > "version" : null, > > "cost" : 50, > > "status" : "DISABLED", > > "segments" : [ { > > "uuid" : "05a31b8b-ac94-45df-ab41-1f425b64e27f", > > "name" : "19700101000000_20150927000000", > > "status" : "NEW", > > "dictionaries" : null, > > "snapshots" : null, > > "storage_location_identifier" : "KYLIN_AIKMGGR2BN", > > "date_range_start" : 0, > > "date_range_end" : 1443312000000, > > "size_kb" : 0, > > "input_records" : 0, > > "input_records_size" : 0, > > "last_build_time" : 0, > > "last_build_job_id" : null, > > "create_time_utc" : 1446128917265, > > "binary_signature" : null > > } ], > > "last_modified" : 1446128917267, > > "descriptor" : "kylin_sales_cube_simple", > > "create_time_utc" : 1446128903052, > > "size_kb" : 0, > > "input_records_count" : 0, > > "input_records_size" : 0 > > } > > > > and /cube_desc/kylin_sales_cube_simple.json > > { > > "uuid" : "8d759e58-0a97-4913-a7b5-fa3f99fdf67d", > > "name" : "kylin_sales_cube_simple", > > "description" : "", > > "dimensions" : [ { > > "id" : 1, > > "name" : "DEFAULT.KYLIN_SALES.LSTG_FORMAT_NAME", > > "table" : "DEFAULT.KYLIN_SALES", > > "column" : [ "LSTG_FORMAT_NAME" ], > > "derived" : null, > > "hierarchy" : false > > }, { > > "id" : 2, > > "name" : "DEFAULT.KYLIN_SALES.LEAF_CATEG_ID", > > "table" : "DEFAULT.KYLIN_SALES", > > "column" : [ "LEAF_CATEG_ID" ], > > "derived" : null, > > "hierarchy" : false > > }, { > > "id" : 3, > > "name" : "DEFAULT.KYLIN_SALES.LSTG_SITE_ID", > > "table" : "DEFAULT.KYLIN_SALES", > > "column" : [ "LSTG_SITE_ID" ], > > "derived" : null, > > "hierarchy" : false > > } ], > > "measures" : [ { > > "id" : 1, > > "name" : "_COUNT_", > > "function" : { > > "expression" : "COUNT", > > "parameter" : { > > "type" : "constant", > > "value" : "1" > > }, > > "returntype" : "bigint" > > }, > > "dependent_measure_ref" : null > > }, { > > "id" : 2, > > "name" : "SUM_PRICE", > > "function" : { > > "expression" : "SUM", > > "parameter" : { > > "type" : "column", > > "value" : "PRICE" > > }, > > "returntype" : "decimal(19,4)" > > }, > > "dependent_measure_ref" : null > > } ], > > "rowkey" : { > > "rowkey_columns" : [ { > > "column" : "LSTG_FORMAT_NAME", > > "length" : 0, > > "dictionary" : "true", > > "mandatory" : false > > }, { > > "column" : "LEAF_CATEG_ID", > > "length" : 0, > > "dictionary" : "true", > > "mandatory" : false > > }, { > > "column" : "LSTG_SITE_ID", > > "length" : 0, > > "dictionary" : "true", > > "mandatory" : false > > } ], > > "aggregation_groups" : [ [ "LSTG_FORMAT_NAME", "LEAF_CATEG_ID", > "LSTG_SITE_ID" ] ] > > }, > > "signature" : "0FAthGOvTI9p4/K0cTMJ6Q==", > > "last_modified" : 1446128903023, > > "model_name" : "kylin_sales_cube_simple", > > "null_string" : null, > > "hbase_mapping" : { > > "column_family" : [ { > > "name" : "F1", > > "columns" : [ { > > "qualifier" : "M", > > "measure_refs" : [ "_COUNT_", "SUM_PRICE" ] > > } ] > > } ] > > }, > > "notify_list" : [ ], > > "auto_merge_time_ranges" : [ 604800000, 2419200000 ], > > "retention_range" : 0 > > } > >
