[jira] [Created] (KYLIN-2399) CubeSegmentScanner generated inaccurate

[WangSheng (JIRA)]

WangSheng created KYLIN-2399:


 Summary: CubeSegmentScanner generated inaccurate
 Key: KYLIN-2399
 URL: https://issues.apache.org/jira/browse/KYLIN-2399
 Project: Kylin
  Issue Type: Improvement
  Components: Query Engine
Affects Versions: v1.5.4.1
Reporter: WangSheng
Assignee: liyang
 Fix For: Future


My project has three segment:
2016060100_2016060200,
2016060200_2016060300,
2016060300_2016060400

When I used filter condition like this : day>='2016-06-01' and day<'2016-06-02'
Kylin would generated three CubeSegmentScanner, and each CubeSegmentScanner's 
GTScanRequest are not empty!

When I changed filter condition like this : day>='2016-06-01' and 
day<='2016-06-02'
Kylin would also generated three CubeSegmentScanner, but the last 
CubeSegmentScanner's GTScanRequest is empty!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2398) CubeSegmentScanner generated inaccurate

[WangSheng (JIRA)]

WangSheng created KYLIN-2398:


 Summary: CubeSegmentScanner generated inaccurate
 Key: KYLIN-2398
 URL: https://issues.apache.org/jira/browse/KYLIN-2398
 Project: Kylin
  Issue Type: Improvement
  Components: Query Engine
Affects Versions: v1.5.4.1
Reporter: WangSheng
Assignee: liyang
 Fix For: Future


My project has three segment:
2016060100_2016060200,
2016060200_2016060300,
2016060300_2016060400

When I used filter condition like this : day>='2016-06-01' and day<'2016-06-02'
Kylin would generated three CubeSegmentScanner, and each CubeSegmentScanner's 
GTScanRequest are not empty!

When I changed filter condition like this : day>='2016-06-01' and 
day<='2016-06-02'
Kylin would also generated three CubeSegmentScanner, but the last 
CubeSegmentScanner's GTScanRequest is empty!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2397) CubeSegmentScanner generated inaccurate

[WangSheng (JIRA)]

WangSheng created KYLIN-2397:


 Summary: CubeSegmentScanner generated inaccurate
 Key: KYLIN-2397
 URL: https://issues.apache.org/jira/browse/KYLIN-2397
 Project: Kylin
  Issue Type: Improvement
  Components: Query Engine
Affects Versions: v1.5.4.1
Reporter: WangSheng
Assignee: liyang
 Fix For: Future


My project has three segment:
2016060100_2016060200,
2016060200_2016060300,
2016060300_2016060400

When I used filter condition like this : day>='2016-06-01' and day<'2016-06-02'
Kylin would generated three CubeSegmentScanner, and each CubeSegmentScanner's 
GTScanRequest are not empty!

When I changed filter condition like this : day>='2016-06-01' and 
day<='2016-06-02'
Kylin would also generated three CubeSegmentScanner, but the last 
CubeSegmentScanner's GTScanRequest is empty!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Streaming Build Timestamp parse error

[Copperfield]

When i use timestamp as partition col, it occurs exception as follow: 
java.text.ParseException: Unparseable date: "1484236798000" does not match
(\p{Nd}++)\Q-\E(\p{Nd}++)\Q-\E(\p{Nd}++)\Q
\E(\p{Nd}++)\Q:\E(\p{Nd}++)\Q:\E(\p{Nd}++)
my kylin version is 1.6.0

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/Streaming-Build-Timestamp-parse-error-tp6952.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

[jira] [Created] (KYLIN-2396) Percentile pre-aggregation implementation

[Dong Li (JIRA)]

Dong Li created KYLIN-2396:
--

 Summary: Percentile pre-aggregation implementation
 Key: KYLIN-2396
 URL: https://issues.apache.org/jira/browse/KYLIN-2396
 Project: Kylin
  Issue Type: Bug
Affects Versions: v2.0.0
Reporter: Dong Li
Assignee: Dong Li
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2395) Lots of warning messages about failing to scan jars in kylin.out

[Kaige Liu (JIRA)]

 Kaige Liu created KYLIN-2395:
-

 Summary: Lots of warning messages about failing to scan jars in 
kylin.out
 Key: KYLIN-2395
 URL: https://issues.apache.org/jira/browse/KYLIN-2395
 Project: Kylin
  Issue Type: Bug
Reporter:  Kaige Liu


When starting kylin, tomcat will scan jars under classpath by default. It's 
trivial and annoying. I thinks it's better to disable scanning jars.


Jan 16, 2017 3:49:08 AM org.apache.tomcat.util.scan.StandardJarScanner scan
WARNING: Failed to scan [file:/usr/hdp/2.2.4.2-2/phoenix/hsqldb-1.8.0.10.jar] 
from classloader hierarchy
java.io.FileNotFoundException: /usr/hdp/2.2.4.2-2/phoenix/hsqldb-1.8.0.10.jar 
(No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:215)
at java.util.zip.ZipFile.(ZipFile.java:145)
at java.util.jar.JarFile.(JarFile.java:154)
at java.util.jar.JarFile.(JarFile.java:118)
at 
org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:60)
at 
org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:48)
at 
org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:338)
at 
org.apache.tomcat.util.scan.StandardJarScanner.scan(StandardJarScanner.java:288)
at 
org.apache.catalina.startup.ContextConfig.processJarsForWebFragments(ContextConfig.java:1898)
at 
org.apache.catalina.startup.ContextConfig.webConfig(ContextConfig.java:1126)
at 
org.apache.catalina.startup.ContextConfig.configureStart(ContextConfig.java:775)
at 
org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:299)
at 
org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:94)
at 
org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5087)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
at 
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:752)
at 
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:728)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:734)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:952)
at 
org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1823)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Jan 16, 2017 3:49:08 AM org.apache.tomcat.util.scan.StandardJarScanner scan
WARNING: Failed to scan [file:/usr/hdp/2.2.4.2-2/phoenix/automaton-1.11-8.jar] 
from classloader hierarchy
java.io.FileNotFoundException: /usr/hdp/2.2.4.2-2/phoenix/automaton-1.11-8.jar 
(No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:215)
at java.util.zip.ZipFile.(ZipFile.java:145)
at java.util.jar.JarFile.(JarFile.java:154)
at java.util.jar.JarFile.(JarFile.java:118)
at 
org.apache.tomcat.util.scan.JarFileUrlJar.(JarFileUrlJar.java:60)
at 
org.apache.tomcat.util.scan.JarFactory.newInstance(JarFactory.java:48)
at 
org.apache.tomcat.util.scan.StandardJarScanner.process(StandardJarScanner.java:338)
at 
org.apache.tomcat.util.scan.StandardJarScanner.scan(StandardJarScanner.java:288)
at 
org.apache.catalina.startup.ContextConfig.processJarsForWebFragments(ContextConfig.java:1898)
at 
org.apache.catalina.startup.ContextConfig.webConfig(ContextConfig.java:1126)
at 
org.apache.catalina.startup.ContextConfig.configureStart(ContextConfig.java:775)
at 
org.apache.catalina.startup.ContextConfig.lifecycleEvent(ContextConfig.java:299)
at 
org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:94)
at 
org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5087)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2394) Upgrade Calcite to 1.11

[Billy Liu (JIRA)]

Billy Liu created KYLIN-2394:


 Summary: Upgrade Calcite to 1.11
 Key: KYLIN-2394
 URL: https://issues.apache.org/jira/browse/KYLIN-2394
 Project: Kylin
  Issue Type: New Feature
  Components: Query Engine
Affects Versions: v1.6.0
Reporter: Billy Liu
Assignee: Billy Liu


Calcite has release 1.11.0 recently. In this JIRA, Kylin will upgrade the 
calcite to 1.11.0 and avatica to 1.9.0. 
Some potential refactor may be required, since protobuf 3.0(upgrade from 2.5) 
is needed by Calcite.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: kylin1.6& HuaWei FusionInsight: load hive table on page. retrun error "java.lang.ClassNotFoundException:org.apache.hive.jdbc.HiveDriver"

[ShaoFeng Shi]

Hi Wangbin, please use Google if possible; Similar environment issues have
been asked many times; Usually it was because the
bin/find-*-dependencies.sh script wasn't able to locate the hive/hbase jars
correctly; especially when "beeline" is used and the hive server and client
uses different installation pathes; You can manually modify the script to
overcome such issue.

Secondly, the HBase of FusionInsight is 1.0, which was skipped by Kylin
(Kylin supports 0.98 and 1.1), suggest you re-compile Kylin to get a
working binary package for FI.

BTW, "copy properties from hive-site.xml to KYLIN_HOME/conf/kylin_job_conf.xml"
isn't recommended; You don't need do this. If hive-site.xml is on Kylin's
classpath, it will be parsed and applied.


2017-01-13 13:23 GMT+08:00 :

> Enviroment：
>kylin: 1.6
>
>hadoop:HUAWEI FusionInsigh C60U10.
>
>
> Install kylin1.6 on client node（NOT the oms node） .Then click "load hive
> table" button. It return error message
> "Oops...java.lang.ClassNotFoundException:org.apache.hive.jdbc.HiveDriver "
>
>
>
> I serached the keywords "kylin ClassNotFoundException" on baidu.com ,but
> got nothins useful.
>
>
> install steps:
> 1. unzip the binary version of kylin1.6  on client
> 2.
>source /opt/hadoopclient/bigdata_env
>kinit admin
> 3. copy properties from hivemetastore-site.xml to hive-site.xml
>
> 4. copy properties from hive-site.xml to
> KYLIN_HOME/conf/kylin_job_conf.xml
>
> 5. add the key in kylin_hive_conf.xml  to
> hive.security.authorization.sqlstd.confwhitelist on FusionInsight WEB
>
> 6.   add  the belows to .bash_profile
>  export KYLIN_HOME=x
>   export HIVE_CONF=/x/Hive/config
>  export HCAT_HOME=/xxx/Hive/HCatalog
>
> 7.  source .bash_profile
>
> 8.  vi  kylin.properties
> setkylin.hive.client=beeline
> setkylin.hive.beeline.params="xxx"  (copy connection info from
> CLI beeline )
>
>
> 9.  kylin.sh start （find:
> /opt/huawei/Bigdata/FusionInsight_V100R002C60U10/
> FusionInsight-Hive-1.3.0/hive-1.3.0/bin/..//lib
> :No such file or directory）
>
>
> 10. Click  "Model"  on page. Click "load hive table"  . Then retun error
> message.
>
>
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-2393) Add "hive.auto.convert.join" and "hive.stats.autogather" to kylin_hive_conf.xml

[Shaofeng SHI (JIRA)]

Shaofeng SHI created KYLIN-2393:
---

 Summary: Add "hive.auto.convert.join" and "hive.stats.autogather" 
to kylin_hive_conf.xml
 Key: KYLIN-2393
 URL: https://issues.apache.org/jira/browse/KYLIN-2393
 Project: Kylin
  Issue Type: Improvement
Reporter: Shaofeng SHI
Assignee: Shaofeng SHI
Priority: Minor
 Fix For: v2.0.0


Although "hive.auto.convert.join" and "hive.stats.autogather" are "true" by 
default in Hive (see 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties); we 
notice if they were disabled, Kylin's cube build will be slowed down much. So I 
will add the two parameters to Kylin's conf file with "true" explicitly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)