[
https://issues.apache.org/jira/browse/LENS-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493878#comment-14493878
]
Amareshwari Sriramadasu commented on LENS-455:
----------------------------------------------
Seeing failures on examples :
{noformat}
lens-shell>dimtable list partitions product_table local
fullPartitionSpec :
partSpecElement :
key : dt value : 2014-03-27-12
key : category value : Clothes
partitionParameters :
property :
name : numFiles value : 1
name : COLUMN_STATS_ACCURATE value : false
name : transient_lastDdlTime value : 1429005515
name : totalSize value : 37
name : numRows value : -1
name : cube.storagetable.partition.update.period value : HOURLY
name : rawDataSize value : -1
serdeParameters :
name : db3@local_product_table@dt=2014-03-27-12/category=Clothes
location :
file:/Users/amareshwari.sr/workspace/lens/lens-dist/target/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/client/examples/data/product_local_clothes
inputFormat : org.apache.hadoop.mapred.TextInputFormat
outputFormat : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serdeClassname : org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
updatePeriod : HOURLY
fullPartitionSpec :
partSpecElement :
key : dt value : 2014-03-27-12
key : category value : Food
partitionParameters :
property :
name : numFiles value : 1
name : COLUMN_STATS_ACCURATE value : false
name : transient_lastDdlTime value : 1429005515
name : totalSize value : 44
name : numRows value : -1
name : cube.storagetable.partition.update.period value : HOURLY
name : rawDataSize value : -1
serdeParameters :
name : db3@local_product_table@dt=2014-03-27-12/category=Food
location :
file:/Users/amareshwari.sr/workspace/lens/lens-dist/target/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/client/examples/data/product_local_food
inputFormat : org.apache.hadoop.mapred.TextInputFormat
outputFormat : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serdeClassname : org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
updatePeriod : HOURLY
fullPartitionSpec :
partSpecElement :
key : dt value : 2014-03-27-12
key : category value : Stationary
partitionParameters :
property :
name : numFiles value : 1
name : COLUMN_STATS_ACCURATE value : false
name : transient_lastDdlTime value : 1429005515
name : totalSize value : 62
name : numRows value : -1
name : cube.storagetable.partition.update.period value : HOURLY
name : rawDataSize value : -1
serdeParameters :
name : db3@local_product_table@dt=2014-03-27-12/category=Stationary
location :
file:/Users/amareshwari.sr/workspace/lens/lens-dist/target/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/client/examples/data/product_local_stationary
inputFormat : org.apache.hadoop.mapred.TextInputFormat
outputFormat : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serdeClassname : org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
updatePeriod : HOURLY
fullPartitionSpec :
partSpecElement :
key : dt value : 2014-03-27-12
key : category value : Wearables
partitionParameters :
property :
name : numFiles value : 1
name : COLUMN_STATS_ACCURATE value : false
name : transient_lastDdlTime value : 1429005515
name : totalSize value : 37
name : numRows value : -1
name : cube.storagetable.partition.update.period value : HOURLY
name : rawDataSize value : -1
serdeParameters :
name : db3@local_product_table@dt=2014-03-27-12/category=Wearables
location :
file:/Users/amareshwari.sr/workspace/lens/lens-dist/target/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/client/examples/data/product_local_wearables
inputFormat : org.apache.hadoop.mapred.TextInputFormat
outputFormat : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serdeClassname : org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
updatePeriod : HOURLY
fullPartitionSpec :
partSpecElement :
key : dt value : latest
key : category value : Wearables
partitionParameters :
property :
name : numFiles value : 1
name : cube.storagetable.dt.latest.part.timestamp value : 2014-03-27-12
name : COLUMN_STATS_ACCURATE value : false
name : transient_lastDdlTime value : 1429005515
name : totalSize value : 37
name : numRows value : -1
name : cube.storagetable.partition.update.period value : HOURLY
name : rawDataSize value : -1
serdeParameters :
name : db3@local_product_table@dt=latest/category=Wearables
location :
file:/Users/amareshwari.sr/workspace/lens/lens-dist/target/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.1.0-beta-incubating-SNAPSHOT-bin/client/examples/data/product_local_wearables
inputFormat : org.apache.hadoop.mapred.TextInputFormat
outputFormat : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serdeClassname : org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
updatePeriod : HOURLY
lens-shell>query execute cube select product_details.category, store_sales from
sales where time_range_in(order_time, '2015-04-11-00', '2015-04-13-01')
Launching query failed cause: Driver :org.apache.lens.driver.jdbc.JDBCDriver
Cause :No candidate fact table available to answer the query, because
{"brief":"No fact update periods for given
range","details":{"sales_raw_fact":[{"cause":"NO_CANDIDATE_STORAGES","storageCauses":{"local":{"cause":"UNSUPPORTED"}}}],"sales_aggr_fact1,sales_aggr_fact2":[{"cause":"NO_FACT_UPDATE_PERIODS_FOR_GIVEN_RANGE"}]}}
Driver :org.apache.lens.driver.hive.HiveDriver Cause :No candidate dimension
table available for product to answer the query, because {"brief":"No candidate
storages for any
table","details":{"product_db_table":[{"cause":"NO_CANDIDATE_STORAGES","storageCauses":{"mydb":{"cause":"UNSUPPORTED"}}}],"product_table":[{"cause":"COLUMN_NOT_FOUND","missingColumns":["category"]}]}}
lens-shell>close
{noformat}
The failure seems to be that fix put up here is not working. Still failing with
"product_table":[{"cause":"COLUMN_NOT_FOUND","missingColumns":["category"]}.
For pointing to correct latest partitions for all categories, LENS-499 will be
required.
> Lens not looking up non-timed partition columns while finding dimtables for a
> dimension
> ---------------------------------------------------------------------------------------
>
> Key: LENS-455
> URL: https://issues.apache.org/jira/browse/LENS-455
> Project: Apache Lens
> Issue Type: Bug
> Components: cube
> Reporter: Angad Singh
> Assignee: Rajat Khandelwal
> Fix For: 2.1
>
>
> DimensionX has dimtableA. dimtableA has a partition column dt which is the
> time dimension partition. it also has suppose a partition column "source".
> when one queries "cube select x from DimensionX where source=xyz", lens
> complains:
> No dimension table has the queried columns for user_owned_apps, columns:
> [xyz, source]
> This is because lens doesn't identify the "source" partition column as a
> column of dimtableA
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
